Nov 04 12:03:07 devstack cinder-volume[76075]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 04 12:03:07 devstack cinder-volume[76075]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 04 12:03:07 devstack cinder-volume[76075]: we strongly recommend against using it for new projects.
Nov 04 12:03:07 devstack cinder-volume[76075]: If you are already using Eventlet, we recommend migrating to a different
Nov 04 12:03:07 devstack cinder-volume[76075]: framework.  For more detail see
Nov 04 12:03:07 devstack cinder-volume[76075]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 04 12:03:07 devstack cinder-volume[76075]:   import eventlet  # noqa
Nov 04 12:03:09 devstack cinder-volume[76075]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76075) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 04 12:03:09 devstack cinder-volume[76075]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76075) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 04 12:03:09 devstack cinder-volume[76075]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76075) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 04 12:03:10 devstack cinder-volume[76075]: INFO dbcounter [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] Registered counter for database cinder
Nov 04 12:03:11 devstack cinder-volume[76075]: DEBUG oslo_db.sqlalchemy.engines [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76075) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 04 12:03:11 devstack cinder-volume[76075]: DEBUG dbcounter [-] [76075] Writer thread running {{(pid=76075) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 04 12:03:11 devstack cinder-volume[76075]: INFO cinder.rpc [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 04 12:03:11 devstack cinder-volume[76075]: INFO cinder.rpc [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 04 12:03:11 devstack cinder-volume[76075]: DEBUG oslo_db.sqlalchemy.engines [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76075) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 04 12:03:11 devstack cinder-volume[76075]: INFO cinder.volume.manager [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] Determined volume DB was empty at startup.
Nov 04 12:03:11 devstack cinder-volume[76075]: DEBUG cinder.volume.manager [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76075) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 04 12:03:11 devstack cinder-volume[76075]: INFO cinder.volume.manager [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] Service not found for updating active_backend_id, assuming default for driver init.
Nov 04 12:03:11 devstack cinder-volume[76075]: WARNING stevedore.named [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 04 12:03:11 devstack cinder-volume[76075]: WARNING castellan.key_manager [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 04 12:03:11 devstack cinder-volume[76075]: WARNING cinder.keymgr.conf_key_mgr [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 04 12:03:11 devstack cinder-volume[76075]: DEBUG cinder.volume.drivers.lvm [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76075) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}}
Nov 04 12:03:11 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:03:11 devstack cinder-volume[76075]: DEBUG oslo_concurrency.processutils [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] CMD "cinder-rtstool verify" returned: 0 in 0.448s {{(pid=76075) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_db.sqlalchemy.engines [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76075) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 04 12:03:12 devstack cinder-volume[76075]: INFO cinder.rpc [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Nov 04 12:03:12 devstack cinder-volume[76075]: INFO cinder.rpc [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Nov 04 12:03:12 devstack cinder-volume[76075]: WARNING stevedore.named [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 04 12:03:12 devstack cinder-volume[76075]: WARNING castellan.key_manager [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 04 12:03:12 devstack cinder-volume[76075]: INFO cinder.volume.manager [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_db.sqlalchemy.engines [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76075) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 04 12:03:12 devstack cinder-volume[76075]: INFO oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] Starting 1 workers
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] Started child 76222 {{(pid=76075) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] Full set of CONF: {{(pid=76075) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] ******************************************************************************** {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] Configuration options gathered from: {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] ================================================================================ {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] allow_availability_zone_fallback = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] allow_compression_on_image_upload = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] allowed_direct_url_schemes     = [] {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] api_rate_limit                 = True {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] auth_strategy                  = keystone {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] az_cache_duration              = 3600 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_availability_zone      = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_host                   = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_name                   = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_stats_polling_interval = 60 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backup_api_class               = cinder.backup.api.API {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backup_name_template           = backup-%s {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76222]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backup_use_same_host           = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backup_use_temp_snapshot       = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] chap_password                  = **** {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] chap_username                  =  {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cinder_internal_tenant_project_id = 935d34e30cd44f7d9799ac889224967b {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cinder_internal_tenant_user_id = c424ab42fb4a456a9a59e66a889b07be {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cloned_volume_same_az          = True {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cluster                        = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] compression_format             = gzip {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] compute_api_class              = cinder.compute.nova.API {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] config_dir                     = [] {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] config_source                  = [] {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] control_exchange               = openstack {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] debug                          = True {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] default_availability_zone      = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] default_group_type             = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] default_volume_type            = lvmdriver-1 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] disk_geometry                  = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] driver_client_cert             = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] driver_client_cert_key         = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] driver_data_namespace          = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] driver_ssl_cert_path           = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] driver_ssl_cert_verify         = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] driver_use_ssl                 = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] enable_force_upload            = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] enable_new_services            = True {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] enable_unsupported_driver      = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] enabled_backends               = ['lvmdriver-1'] {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] enforce_multipath_for_image_xfer = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] filter_function                = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] glance_api_insecure            = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] glance_api_servers             = ['http://192.168.122.228/image'] {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] glance_api_ssl_compression     = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] glance_ca_certificates_file    = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] glance_catalog_info            = image:glance:publicURL {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] glance_certfile                = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] glance_keyfile                 = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] glance_num_retries             = 3 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] glance_request_timeout         = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] goodness_function              = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] graceful_shutdown_timeout      = 5 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] group_api_class                = cinder.group.api.API {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] host                           = devstack {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] image_compress_on_upload       = True {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] image_conversion_address_space_limit = 1 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] image_conversion_cpu_limit     = 60 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76222]: INFO cinder.volume.manager [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Starting volume driver LVMVolumeDriver (3.0.0)
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] image_conversion_disable       = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] image_introspection_address_space_limit = 1 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] image_introspection_cpu_limit  = 60 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] image_upload_use_cinder_backend = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] image_upload_use_internal_tenant = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] image_volume_cache_enabled     = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] image_volume_cache_max_count   = 0 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] image_volume_cache_max_size_gb = 0 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] init_host_max_objects_retrieval = 0 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] instance_format                = [instance: %(uuid)s]  {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] iscsi_target_flags             =  {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] iscsi_write_cache              = on {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] iser_helper                    = tgtadm {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] iser_ip_address                = 192.168.122.228 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] iser_port                      = 3260 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] log_color                      = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] log_config_append              = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] log_dir                        = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] log_file                       = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] log_options                    = True {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] log_rotate_interval            = 1 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] log_rotate_interval_type       = days {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] log_rotation_type              = none {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] max_age                        = 0 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] max_logfile_count              = 30 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] max_logfile_size_mb            = 200 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] max_over_subscription_ratio    = 20.0 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] message_reap_interval          = 86400 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] message_ttl                    = 2592000 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] migration_create_volume_timeout_secs = 300 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] monkey_patch                   = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] monkey_patch_modules           = [] {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] my_ip                          = 192.168.122.228 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] no_snapshot_gb_quota           = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] num_iser_scan_tries            = 3 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] num_shell_tries                = 3 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] num_volume_device_scan_tries   = 3 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] nvmeof_conn_info_version       = 1 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] nvmet_ns_id                    = 10 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] nvmet_port_id                  = 1 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] osapi_max_limit                = 1000 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] osapi_volume_ext_list          = [] {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] osapi_volume_listen            = 0.0.0.0 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] osapi_volume_listen_port       = 8776 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] osapi_volume_use_ssl           = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] osapi_volume_workers           = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] per_volume_size_limit          = -1 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] periodic_fuzzy_delay           = 60 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] periodic_interval              = 60 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] project_id_regex               = [0-9a-f\-]+ {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] public_endpoint                = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] publish_errors                 = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] quota_backup_gigabytes         = 1000 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] quota_backups                  = 10 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:03:12 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] quota_gigabytes                = 1000 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] quota_groups                   = 10 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] quota_snapshots                = 10 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] quota_volumes                  = 10 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] rate_limit_burst               = 0 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] rate_limit_except_level        = CRITICAL {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] rate_limit_interval            = 0 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] reinit_driver_count            = 3 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] replication_device             = **** {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] report_discard_supported       = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] report_interval                = 120 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] reservation_clean_interval     = 86400 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] reservation_expire             = 86400 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] reserved_image_namespaces      = [] {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] reserved_percentage            = 0 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] rpc_response_timeout           = 120 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] run_external_periodic_tasks    = True {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] scst_target_driver             = iscsi {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] scst_target_iqn_name           = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] service_down_time              = 720 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] shell_completion               = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] snapshot_name_template         = snapshot-%s {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] snapshot_same_host             = True {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] split_loggers                  = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] state_path                     = /opt/stack/data/cinder {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] storage_availability_zone      = nova {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] storage_protocol               = iSCSI {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] syslog_log_facility            = LOG_USER {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] target_helper                  = lioadm {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] target_ip_address              = 192.168.122.228 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] target_port                    = 3260 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] target_protocol                = iscsi {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] target_secondary_ip_addresses  = [] {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] trace_flags                    = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] transfer_api_class             = cinder.transfer.api.API {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] transport_url                  = **** {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] until_refresh                  = 0 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] use_chap_auth                  = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] use_default_quota_class        = True {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] use_journal                    = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] use_json                       = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] use_multipath_for_image_xfer   = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] use_stderr                     = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] use_syslog                     = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] verify_glance_signatures       = enabled {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] volume_api_class               = cinder.volume.api.API {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] volume_backend_name            = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] volume_clear                   = zero {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] volume_clear_ionice            = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] volume_clear_size              = 0 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] volume_copy_bps_limit          = 0 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] volume_dd_blocksize            = 1M {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack sudo[76230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] volume_name_template           = volume-%s {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] volume_service_inithost_offload = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] volume_usage_audit_period      = month {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] zoning_mode                    = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:03:12 devstack sudo[76230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_concurrency.disable_process_locking = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] keystone_authtoken.auth_section = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] keystone_authtoken.auth_type   = password {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] keystone_authtoken.auth_version = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] keystone_authtoken.cache       = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] keystone_authtoken.certfile    = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] keystone_authtoken.delay_auth_decision = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] keystone_authtoken.http_connect_timeout = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] keystone_authtoken.include_service_catalog = True {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] keystone_authtoken.insecure    = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] keystone_authtoken.interface   = public {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] keystone_authtoken.keyfile     = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] keystone_authtoken.memcache_password = **** {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] keystone_authtoken.memcache_username = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] keystone_authtoken.region_name = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] keystone_authtoken.service_token_roles_required = True {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] keystone_authtoken.service_type = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] keystone_authtoken.token_cache_time = 300 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.228/identity {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cache.backend                  = dogpile.cache.null {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cache.backend_argument         = **** {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cache.backend_expiration_time  = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cache.config_prefix            = cache.oslo {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cache.debug_cache_backend      = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cache.enable_retry_client      = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cache.enable_socket_keepalive  = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cache.enabled                  = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cache.expiration_time          = 600 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cache.hashclient_retry_attempts = 2 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cache.memcache_dead_retry      = 300 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cache.memcache_pool_maxsize    = 10 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cache.memcache_sasl_enabled    = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cache.password                 = **** {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cache.proxies                  = [] {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cache.redis_db                 = 0 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cache.redis_sentinel_service_name = mymaster {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cache.redis_server             = localhost:6379 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cache.retry_attempts           = 2 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cache.retry_delay              = 0.0 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cache.socket_keepalive_count   = 1 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cache.socket_keepalive_idle    = 1 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cache.socket_keepalive_interval = 1 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cache.socket_timeout           = 1.0 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cache.tls_allowed_ciphers      = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cache.tls_cafile               = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cache.tls_certfile             = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cache.tls_enabled              = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cache.tls_keyfile              = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cache.username                 = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] coordination.backend_url       = **** {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] database.asyncio_connection    = **** {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] database.asyncio_slave_connection = **** {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] database.backend               = sqlalchemy {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] database.connection            = **** {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] database.connection_debug      = 0 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] database.connection_parameters =  {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] database.connection_recycle_time = 3600 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] database.connection_trace      = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] database.db_inc_retry_interval = True {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] database.db_max_retries        = 20 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] database.db_max_retry_interval = 10 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] database.db_retry_interval     = 1 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] database.max_overflow          = 50 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] database.max_pool_size         = 5 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] database.max_retries           = 10 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] database.mysql_wsrep_sync_wait = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] database.pool_timeout          = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] database.retry_interval        = 10 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] database.slave_connection      = **** {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] database.sqlite_synchronous    = True {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] database.synchronous_reader    = True {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] database.use_db_reconnect      = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_tracing.insecure = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] profiler.connection_string     = messaging:// {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] profiler.enabled               = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] profiler.es_doc_type           = notification {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] profiler.es_scroll_size        = 10000 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] profiler.es_scroll_time        = 2m {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] profiler.filter_error_trace    = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] profiler.hmac_keys             = **** {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] profiler.sentinel_service_name = mymaster {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] profiler.socket_timeout        = 0.1 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] profiler.trace_requests        = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] profiler.trace_sqlalchemy      = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] profiler_jaeger.process_tags   = {} {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] profiler_jaeger.service_name_prefix = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] profiler_otlp.service_name_prefix = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_policy.enforce_new_defaults = True {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_policy.policy_default_rule = default {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_policy.policy_file        = policy.yaml {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_policy.remote_timeout     = 60.0 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] privsep_osbrick.group          = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] privsep_osbrick.helper_command = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] privsep_osbrick.user           = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cinder_sys_admin.group         = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cinder_sys_admin.helper_command = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] cinder_sys_admin.user          = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] service_user.auth_section      = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] service_user.auth_type         = password {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] service_user.cafile            = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] service_user.certfile          = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] service_user.collect_timing    = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] service_user.insecure          = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] service_user.keyfile           = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] service_user.send_service_user_token = True {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] service_user.split_loggers     = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] service_user.timeout           = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] service_user.tls_ciphers       = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] service_user.tls_min_version   = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] glance.auth_section            = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] glance.auth_type               = password {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] glance.certfile                = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] glance.collect_timing          = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] glance.insecure                = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] glance.keyfile                 = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] glance.region_name             = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] glance.split_loggers           = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] glance.timeout                 = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] glance.tls_ciphers             = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] glance.tls_min_version         = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.backend_availability_zone = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.chap_password = **** {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.chap_username =  {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.disk_geometry = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.driver_client_cert = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.driver_client_cert_key = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.driver_data_namespace = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.driver_use_ssl = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.enable_unsupported_driver = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.extra_capabilities = {} {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.filter_function = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.goodness_function = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.iscsi_target_flags =  {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.iscsi_write_cache = on {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.iser_helper   = tgtadm {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.iser_ip_address = 192.168.122.228 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.iser_port     = 3260 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.lvm_mirrors   = 0 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.lvm_share_target = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.lvm_type      = auto {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.num_shell_tries = 3 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.nvmet_port_id = 1 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.replication_device = **** {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.report_discard_supported = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.reserved_percentage = 0 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.scst_target_driver = iscsi {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.scst_target_iqn_name = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.storage_protocol = iSCSI {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.target_helper = tgtadm {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.target_ip_address = 192.168.122.228 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.target_port   = 3260 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.target_protocol = iscsi {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.trace_flags   = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.unique_fqdn_network = True {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.use_chap_auth = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.volume_backend_name = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.volume_clear  = zero {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.volume_clear_ionice = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.volume_clear_size = 0 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.volume_group  = cinder-volumes {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_reports.file_event_handler = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_reports.log_dir           = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.backend_availability_zone = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.backend_host       = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.chap_password      = **** {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.chap_username      = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.chiscsi_conf       = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.disk_geometry      = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.driver_client_cert = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.driver_data_namespace = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.driver_use_ssl     = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.extra_capabilities = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.filter_function    = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.goodness_function  = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.iser_helper        = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.iser_ip_address    = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.iser_port          = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.iser_target_prefix = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.lvm_conf_file      = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.lvm_mirrors        = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.lvm_share_target   = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.lvm_type           = auto {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.num_shell_tries    = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.nvmet_port_id      = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.replication_device = **** {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.report_discard_supported = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.reserved_percentage = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.scst_target_driver = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.storage_protocol   = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.target_helper      = lioadm {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.target_ip_address  = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.target_port        = 3260 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.target_protocol    = iscsi {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.trace_flags        = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.use_chap_auth      = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.volume_clear       = zero {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.volume_clear_size  = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] lvmdriver-1.volumes_dir        = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_rabbit.ssl      = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_rabbit.ssl_version =  {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_notifications.driver = [] {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_notifications.retry = -1 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] oslo_messaging_notifications.transport_url = **** {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] key_manager.fixed_key          = **** {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] barbican.barbican_api_version  = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] barbican.barbican_endpoint     = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] barbican.barbican_endpoint_type = public {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] barbican.barbican_region_name  = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] barbican.cafile                = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] barbican.certfile              = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] barbican.collect_timing        = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] barbican.insecure              = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] barbican.keyfile               = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] barbican.number_of_retries     = 60 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] barbican.retry_delay           = 1 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] barbican.send_service_user_token = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] barbican.split_loggers         = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] barbican.timeout               = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] barbican.tls_ciphers           = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] barbican.tls_min_version       = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] barbican.verify_ssl            = True {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] barbican.verify_ssl_path       = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] barbican_service_user.auth_section = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] barbican_service_user.auth_type = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] barbican_service_user.cafile   = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] barbican_service_user.certfile = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] barbican_service_user.collect_timing = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] barbican_service_user.insecure = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] barbican_service_user.keyfile  = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] barbican_service_user.split_loggers = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] barbican_service_user.timeout  = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] barbican_service_user.tls_ciphers = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] barbican_service_user.tls_min_version = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] vault.approle_role_id          = **** {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] vault.approle_secret_id        = **** {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] vault.auth_method              = approle {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] vault.auth_path                = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] vault.kv_mountpoint            = secret {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] vault.kv_path                  = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] vault.kv_version               = 2 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] vault.namespace                = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] vault.root_token_id            = **** {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] vault.ssl_ca_crt_file          = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] vault.timeout                  = 60.0 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] vault.token_file               = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] vault.token_role               = None {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] vault.use_ssl                  = False {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:03:12 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] ******************************************************************************** {{(pid=76075) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 04 12:03:12 devstack sudo[76230]: pam_unix(sudo:session): session closed for user root
Nov 04 12:03:12 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.370s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:03:12 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:03:12 devstack sudo[76355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 04 12:03:12 devstack sudo[76355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:03:13 devstack sudo[76355]: pam_unix(sudo:session): session closed for user root
Nov 04 12:03:13 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.323s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:03:13 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 12:03:13 devstack cinder-volume[76222]: INFO cinder.brick.local_dev.lvm [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Nov 04 12:03:13 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:03:13 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:03:13 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:03:13 devstack sudo[76447]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 04 12:03:13 devstack sudo[76447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:03:13 devstack sudo[76447]: pam_unix(sudo:session): session closed for user root
Nov 04 12:03:13 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:03:13 devstack cinder-volume[76222]: DEBUG cinder.brick.local_dev.lvm [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76222) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}}
Nov 04 12:03:13 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:03:13 devstack sudo[76530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 04 12:03:13 devstack sudo[76530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:03:13 devstack sudo[76530]: pam_unix(sudo:session): session closed for user root
Nov 04 12:03:13 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.532s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:03:13 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:03:13 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:03:13 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:03:13 devstack sudo[76719]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 04 12:03:13 devstack sudo[76719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:03:14 devstack sudo[76719]: pam_unix(sudo:session): session closed for user root
Nov 04 12:03:14 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.342s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:03:14 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:03:14 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:03:14 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:03:14 devstack sudo[76839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Nov 04 12:03:14 devstack sudo[76839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:03:14 devstack sudo[76839]: pam_unix(sudo:session): session closed for user root
Nov 04 12:03:14 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.264s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:03:14 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:03:14 devstack sudo[76842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 04 12:03:14 devstack sudo[76842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:03:14 devstack sudo[76842]: pam_unix(sudo:session): session closed for user root
Nov 04 12:03:14 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:03:14 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:03:14 devstack sudo[76927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 04 12:03:14 devstack sudo[76927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:03:15 devstack sudo[76927]: pam_unix(sudo:session): session closed for user root
Nov 04 12:03:15 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:03:15 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:03:15 devstack sudo[76930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 04 12:03:15 devstack sudo[76930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:03:15 devstack sudo[76930]: pam_unix(sudo:session): session closed for user root
Nov 04 12:03:15 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.305s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:03:15 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:03:15 devstack sudo[76968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 04 12:03:15 devstack sudo[76968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:03:15 devstack sudo[76968]: pam_unix(sudo:session): session closed for user root
Nov 04 12:03:15 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.322s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:03:15 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:03:15 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:03:15 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:03:15 devstack sudo[77023]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 04 12:03:15 devstack sudo[77023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:03:16 devstack sudo[77023]: pam_unix(sudo:session): session closed for user root
Nov 04 12:03:16 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:03:16 devstack cinder-volume[76222]: INFO cinder.volume.drivers.lvm [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Enabling LVM thin provisioning by default because a thin pool exists.
Nov 04 12:03:16 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:03:16 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:03:16 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:03:16 devstack sudo[77033]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 04 12:03:16 devstack sudo[77033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:03:16 devstack sudo[77033]: pam_unix(sudo:session): session closed for user root
Nov 04 12:03:16 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.282s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:03:16 devstack cinder-volume[76222]: DEBUG cinder.volume.drivers.lvm [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Updating volume stats {{(pid=76222) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 04 12:03:16 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:03:16 devstack sudo[77036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 04 12:03:16 devstack sudo[77036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:03:16 devstack sudo[77036]: pam_unix(sudo:session): session closed for user root
Nov 04 12:03:16 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:03:16 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:03:16 devstack sudo[77039]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 04 12:03:16 devstack sudo[77039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:03:16 devstack sudo[77039]: pam_unix(sudo:session): session closed for user root
Nov 04 12:03:16 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:03:16 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:03:16 devstack sudo[77042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 04 12:03:16 devstack sudo[77042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:03:17 devstack sudo[77042]: pam_unix(sudo:session): session closed for user root
Nov 04 12:03:17 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:03:17 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:03:17 devstack sudo[77079]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 04 12:03:17 devstack sudo[77079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:03:17 devstack sudo[77079]: pam_unix(sudo:session): session closed for user root
Nov 04 12:03:17 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:03:17 devstack cinder-volume[76222]: INFO cinder.volume.driver [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Driver hasn't implemented _init_vendor_properties()
Nov 04 12:03:17 devstack cinder-volume[76222]: DEBUG cinder.volume.driver [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76222) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 04 12:03:17 devstack cinder-volume[76222]: DEBUG oslo_db.sqlalchemy.engines [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76222) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 04 12:03:17 devstack cinder-volume[76222]: DEBUG dbcounter [-] [76222] Writer thread running {{(pid=76222) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 04 12:03:17 devstack cinder-volume[76222]: DEBUG cinder.db.api [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Building query based on filter {{(pid=76222) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}}
Nov 04 12:03:17 devstack cinder-volume[76222]: DEBUG cinder.image.image_utils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76222) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 04 12:03:17 devstack cinder-volume[76222]: INFO cinder.keymgr.migration [None req-8f93b093-57e6-41cc-b938-1fc764b0951e None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 04 12:03:17 devstack cinder-volume[76222]: DEBUG cinder.volume.drivers.lvm [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Updating volume stats {{(pid=76222) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 04 12:03:17 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:03:17 devstack sudo[77085]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 04 12:03:17 devstack sudo[77085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:03:18 devstack sudo[77085]: pam_unix(sudo:session): session closed for user root
Nov 04 12:03:18 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.310s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:03:18 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:03:18 devstack sudo[77089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 04 12:03:18 devstack sudo[77089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:03:18 devstack sudo[77089]: pam_unix(sudo:session): session closed for user root
Nov 04 12:03:18 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:03:18 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:03:18 devstack sudo[77093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 04 12:03:18 devstack sudo[77093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:03:18 devstack sudo[77093]: pam_unix(sudo:session): session closed for user root
Nov 04 12:03:18 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:03:18 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:03:18 devstack sudo[77096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 04 12:03:18 devstack sudo[77096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:03:18 devstack sudo[77096]: pam_unix(sudo:session): session closed for user root
Nov 04 12:03:18 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:03:18 devstack cinder-volume[76222]: DEBUG cinder.manager [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Notifying Schedulers of capabilities ... {{(pid=76222) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:03:18 devstack cinder-volume[76222]: INFO cinder.volume.manager [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Driver initialization completed successfully.
Nov 04 12:03:18 devstack cinder-volume[76222]: INFO cinder.manager [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Initiating service 2 cleanup
Nov 04 12:03:18 devstack cinder-volume[76222]: INFO cinder.manager [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Service 2 cleanup completed.
Nov 04 12:03:18 devstack cinder-volume[76222]: DEBUG cinder.service [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Creating RPC server for service cinder-volume {{(pid=76222) start /opt/stack/cinder/cinder/service.py:231}}
Nov 04 12:03:18 devstack cinder-volume[76222]: DEBUG cinder.service [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76222) start /opt/stack/cinder/cinder/service.py:237}}
Nov 04 12:03:19 devstack cinder-volume[76222]: INFO cinder.volume.manager [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Nov 04 12:03:19 devstack cinder-volume[76222]: DEBUG cinder.volume.drivers.lvm [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Updating volume stats {{(pid=76222) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 04 12:03:19 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:03:19 devstack sudo[77099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 04 12:03:19 devstack sudo[77099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:03:19 devstack sudo[77099]: pam_unix(sudo:session): session closed for user root
Nov 04 12:03:19 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:03:19 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:03:19 devstack sudo[77107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 04 12:03:19 devstack sudo[77107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:03:19 devstack sudo[77107]: pam_unix(sudo:session): session closed for user root
Nov 04 12:03:19 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:03:19 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:03:19 devstack sudo[77110]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 04 12:03:19 devstack sudo[77110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:03:19 devstack sudo[77110]: pam_unix(sudo:session): session closed for user root
Nov 04 12:03:19 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:03:19 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:03:19 devstack sudo[77113]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 04 12:03:19 devstack sudo[77113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:03:20 devstack sudo[77113]: pam_unix(sudo:session): session closed for user root
Nov 04 12:03:20 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:03:20 devstack cinder-volume[76222]: INFO cinder.volume.manager [None req-bec3169c-8cff-4cbf-a69e-b8aaa5ac2be9 None None] Driver post RPC initialization completed successfully.
Nov 04 12:03:22 devstack cinder-volume[76075]: DEBUG dbcounter [-] [76075] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76075) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:03:28 devstack cinder-volume[76222]: DEBUG dbcounter [-] [76222] Writing DB stats cinder:SELECT=2 {{(pid=76222) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:03:30 devstack cinder-volume[76222]: DEBUG dbcounter [-] [76222] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76222) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:03:33 devstack cinder-volume[76222]: DEBUG oslo_service.periodic_task [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] Running periodic task VolumeManager._thread_info {{(pid=76222) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:03:33 devstack cinder-volume[76222]: DEBUG cinder.volume.manager [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] thread count: 6 {{(pid=76222) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 12:03:33 devstack cinder-volume[76222]: DEBUG cinder.volume.manager [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] thread info: [<_MainThread(MainThread, started 137887197933696)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137887085550976)>, <Thread(Thread-3 (stat_writer), started daemon 137887093942144)>, <Thread(Rabbit-heartbeat, started daemon 137887093943296)>, <Thread(Thread-5 (_runner), started daemon 137887082483712)>, <Thread(Thread-7 (_runner), started daemon 137887080514432)>] {{(pid=76222) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 12:04:33 devstack cinder-volume[76222]: DEBUG oslo_service.periodic_task [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76222) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:04:33 devstack cinder-volume[76222]: DEBUG cinder.volume.drivers.lvm [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] Updating volume stats {{(pid=76222) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 04 12:04:33 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:04:33 devstack sudo[79633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 04 12:04:33 devstack sudo[79633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:04:33 devstack sudo[79633]: pam_unix(sudo:session): session closed for user root
Nov 04 12:04:33 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:04:33 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:04:33 devstack sudo[79636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 04 12:04:33 devstack sudo[79636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:04:33 devstack sudo[79636]: pam_unix(sudo:session): session closed for user root
Nov 04 12:04:33 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:04:33 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:04:33 devstack sudo[79639]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 04 12:04:33 devstack sudo[79639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:04:33 devstack sudo[79639]: pam_unix(sudo:session): session closed for user root
Nov 04 12:04:33 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:04:33 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:04:33 devstack sudo[79642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 04 12:04:33 devstack sudo[79642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:04:34 devstack sudo[79642]: pam_unix(sudo:session): session closed for user root
Nov 04 12:04:34 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:04:34 devstack cinder-volume[76222]: DEBUG cinder.manager [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] Notifying Schedulers of capabilities ... {{(pid=76222) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:04:34 devstack cinder-volume[76222]: DEBUG oslo_service.periodic_task [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] Running periodic task VolumeManager._thread_info {{(pid=76222) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:04:34 devstack cinder-volume[76222]: DEBUG cinder.volume.manager [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] thread count: 6 {{(pid=76222) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 12:04:34 devstack cinder-volume[76222]: DEBUG cinder.volume.manager [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] thread info: [<_MainThread(MainThread, started 137887197933696)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137887085550976)>, <Thread(Thread-3 (stat_writer), started daemon 137887093942144)>, <Thread(Rabbit-heartbeat, started daemon 137887093943296)>, <Thread(Thread-5 (_runner), started daemon 137887082483712)>, <Thread(Thread-7 (_runner), started daemon 137887080514432)>] {{(pid=76222) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 12:05:30 devstack cinder-volume[76222]: DEBUG dbcounter [-] [76222] Writing DB stats cinder:SELECT=1 {{(pid=76222) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:05:30 devstack cinder-volume[76222]: DEBUG dbcounter [-] [76222] Writing DB stats cinder:UPDATE=1 {{(pid=76222) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:05:33 devstack cinder-volume[76222]: DEBUG oslo_service.periodic_task [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76222) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:05:33 devstack cinder-volume[76222]: DEBUG cinder.volume.drivers.lvm [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] Updating volume stats {{(pid=76222) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 04 12:05:33 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:05:33 devstack sudo[82664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 04 12:05:33 devstack sudo[82664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:05:33 devstack sudo[82664]: pam_unix(sudo:session): session closed for user root
Nov 04 12:05:33 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:05:33 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:05:33 devstack sudo[82667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 04 12:05:33 devstack sudo[82667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:05:33 devstack sudo[82667]: pam_unix(sudo:session): session closed for user root
Nov 04 12:05:33 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:05:33 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:05:33 devstack sudo[82675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 04 12:05:33 devstack sudo[82675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:05:33 devstack sudo[82675]: pam_unix(sudo:session): session closed for user root
Nov 04 12:05:33 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.248s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:05:33 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:05:33 devstack sudo[82678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 04 12:05:33 devstack sudo[82678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:05:34 devstack sudo[82678]: pam_unix(sudo:session): session closed for user root
Nov 04 12:05:34 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:05:34 devstack cinder-volume[76222]: DEBUG cinder.manager [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] Notifying Schedulers of capabilities ... {{(pid=76222) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:05:34 devstack cinder-volume[76222]: DEBUG oslo_service.periodic_task [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] Running periodic task VolumeManager._thread_info {{(pid=76222) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:05:34 devstack cinder-volume[76222]: DEBUG cinder.volume.manager [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] thread count: 6 {{(pid=76222) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 12:05:34 devstack cinder-volume[76222]: DEBUG cinder.volume.manager [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] thread info: [<_MainThread(MainThread, started 137887197933696)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137887085550976)>, <Thread(Thread-3 (stat_writer), started daemon 137887093942144)>, <Thread(Rabbit-heartbeat, started daemon 137887093943296)>, <Thread(Thread-5 (_runner), started daemon 137887082483712)>, <Thread(Thread-7 (_runner), started daemon 137887080514432)>] {{(pid=76222) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 12:06:33 devstack cinder-volume[76222]: DEBUG oslo_service.periodic_task [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76222) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:06:33 devstack cinder-volume[76222]: DEBUG cinder.volume.drivers.lvm [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] Updating volume stats {{(pid=76222) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 04 12:06:33 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:06:33 devstack sudo[85000]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 04 12:06:33 devstack sudo[85000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:06:33 devstack sudo[85000]: pam_unix(sudo:session): session closed for user root
Nov 04 12:06:33 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:06:33 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:06:33 devstack sudo[85011]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 04 12:06:33 devstack sudo[85011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:06:33 devstack sudo[85011]: pam_unix(sudo:session): session closed for user root
Nov 04 12:06:33 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:06:33 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:06:33 devstack sudo[85024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 04 12:06:33 devstack sudo[85024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:06:33 devstack sudo[85024]: pam_unix(sudo:session): session closed for user root
Nov 04 12:06:33 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:06:33 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:06:33 devstack sudo[85027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 04 12:06:33 devstack sudo[85027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:06:34 devstack sudo[85027]: pam_unix(sudo:session): session closed for user root
Nov 04 12:06:34 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:06:34 devstack cinder-volume[76222]: DEBUG cinder.manager [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] Notifying Schedulers of capabilities ... {{(pid=76222) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:07:30 devstack cinder-volume[76222]: DEBUG dbcounter [-] [76222] Writing DB stats cinder:SELECT=1 {{(pid=76222) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:07:30 devstack cinder-volume[76222]: DEBUG dbcounter [-] [76222] Writing DB stats cinder:UPDATE=1 {{(pid=76222) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:07:33 devstack cinder-volume[76222]: DEBUG oslo_service.periodic_task [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76222) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:07:33 devstack cinder-volume[76222]: DEBUG cinder.volume.drivers.lvm [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] Updating volume stats {{(pid=76222) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}}
Nov 04 12:07:33 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:07:33 devstack sudo[86119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Nov 04 12:07:33 devstack sudo[86119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:07:33 devstack sudo[86119]: pam_unix(sudo:session): session closed for user root
Nov 04 12:07:33 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:07:33 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:07:33 devstack sudo[86131]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 04 12:07:33 devstack sudo[86131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:07:33 devstack sudo[86131]: pam_unix(sudo:session): session closed for user root
Nov 04 12:07:33 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:07:33 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:07:33 devstack sudo[86138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Nov 04 12:07:33 devstack sudo[86138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:07:33 devstack sudo[86138]: pam_unix(sudo:session): session closed for user root
Nov 04 12:07:33 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:07:33 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:07:33 devstack sudo[86160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Nov 04 12:07:33 devstack sudo[86160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:07:34 devstack sudo[86160]: pam_unix(sudo:session): session closed for user root
Nov 04 12:07:34 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:07:34 devstack cinder-volume[76222]: DEBUG cinder.manager [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] Notifying Schedulers of capabilities ... {{(pid=76222) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:07:34 devstack cinder-volume[76222]: DEBUG oslo_service.periodic_task [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] Running periodic task VolumeManager._thread_info {{(pid=76222) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:07:34 devstack cinder-volume[76222]: DEBUG cinder.volume.manager [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] thread count: 6 {{(pid=76222) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 12:07:34 devstack cinder-volume[76222]: DEBUG cinder.volume.manager [None req-b931e6a8-5b0f-4122-a697-2c3475c1891f None None] thread info: [<_MainThread(MainThread, started 137887197933696)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137887085550976)>, <Thread(Thread-3 (stat_writer), started daemon 137887093942144)>, <Thread(Rabbit-heartbeat, started daemon 137887093943296)>, <Thread(Thread-5 (_runner), started daemon 137887082483712)>, <Thread(Thread-7 (_runner), started daemon 137887080514432)>] {{(pid=76222) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 12:07:36 devstack cinder-volume[76075]: INFO oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] Caught SIGTERM, stopping children
Nov 04 12:07:36 devstack cinder-volume[76075]: DEBUG oslo_concurrency.lockutils [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] Acquiring lock "singleton_lock" {{(pid=76075) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 04 12:07:36 devstack cinder-volume[76075]: DEBUG oslo_concurrency.lockutils [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] Acquired lock "singleton_lock" {{(pid=76075) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 04 12:07:36 devstack cinder-volume[76075]: DEBUG oslo_concurrency.lockutils [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] Releasing lock "singleton_lock" {{(pid=76075) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 04 12:07:36 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] Stop services. {{(pid=76075) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Nov 04 12:07:36 devstack cinder-volume[76075]: DEBUG oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] Killing children. {{(pid=76075) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Nov 04 12:07:36 devstack cinder-volume[76075]: INFO oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] Waiting on 1 children to exit
Nov 04 12:07:39 devstack cinder-volume[76222]: DEBUG oslo_concurrency.lockutils [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] Acquiring lock "singleton_lock" {{(pid=76222) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 04 12:07:39 devstack cinder-volume[76222]: DEBUG oslo_concurrency.lockutils [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] Acquired lock "singleton_lock" {{(pid=76222) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 04 12:07:39 devstack cinder-volume[76222]: DEBUG oslo_concurrency.lockutils [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] Releasing lock "singleton_lock" {{(pid=76222) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 04 12:07:39 devstack cinder-volume[76222]: WARNING amqp [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 04 12:07:39 devstack cinder-volume[76222]: WARNING amqp [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 04 12:07:39 devstack cinder-volume[76075]: INFO oslo_service.backend._eventlet.service [None req-1daef958-77c0-4d5a-9589-aa4976fdec7e None None] Child 76222 exited with status 0
Nov 04 12:07:39 devstack cinder-volume[86318]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 04 12:07:39 devstack cinder-volume[86318]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 04 12:07:39 devstack cinder-volume[86318]: we strongly recommend against using it for new projects.
Nov 04 12:07:39 devstack cinder-volume[86318]: If you are already using Eventlet, we recommend migrating to a different
Nov 04 12:07:39 devstack cinder-volume[86318]: framework.  For more detail see
Nov 04 12:07:39 devstack cinder-volume[86318]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 04 12:07:39 devstack cinder-volume[86318]:   import eventlet  # noqa
Nov 04 12:07:41 devstack cinder-volume[86318]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86318) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 04 12:07:41 devstack cinder-volume[86318]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86318) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 04 12:07:41 devstack cinder-volume[86318]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86318) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 04 12:07:42 devstack cinder-volume[86318]: INFO dbcounter [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] Registered counter for database cinder
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_db.sqlalchemy.engines [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86318) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG dbcounter [-] [86318] Writer thread running {{(pid=86318) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 04 12:07:42 devstack cinder-volume[86318]: INFO cinder.rpc [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 04 12:07:42 devstack cinder-volume[86318]: INFO cinder.rpc [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_db.sqlalchemy.engines [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86318) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 04 12:07:42 devstack cinder-volume[86318]: INFO cinder.volume.manager [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] Determined volume DB was empty at startup.
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG cinder.volume.manager [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86318) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 04 12:07:42 devstack cinder-volume[86318]: INFO cinder.volume.manager [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] Service not found for updating active_backend_id, assuming default for driver init.
Nov 04 12:07:42 devstack cinder-volume[86318]: WARNING stevedore.named [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 04 12:07:42 devstack cinder-volume[86318]: WARNING castellan.key_manager [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 04 12:07:42 devstack cinder-volume[86318]: WARNING cinder.keymgr.conf_key_mgr [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 04 12:07:42 devstack cinder-volume[86318]: INFO cinder.volume.manager [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] Image-volume cache disabled for host devstack@QuobyteHD.
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_db.sqlalchemy.engines [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86318) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 04 12:07:42 devstack cinder-volume[86318]: INFO oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] Starting 1 workers
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] Started child 86539 {{(pid=86318) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] Full set of CONF: {{(pid=86318) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] ******************************************************************************** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] Configuration options gathered from: {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] ================================================================================ {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] allow_availability_zone_fallback = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] allow_compression_on_image_upload = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] allowed_direct_url_schemes     = [] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] api_rate_limit                 = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] auth_strategy                  = keystone {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_availability_zone      = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_host                   = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_name                   = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_stats_polling_interval = 60 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86539]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backup_api_class               = cinder.backup.api.API {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backup_name_template           = backup-%s {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backup_use_same_host           = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backup_use_temp_snapshot       = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] chap_password                  = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] chap_username                  =  {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cinder_internal_tenant_project_id = 935d34e30cd44f7d9799ac889224967b {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cinder_internal_tenant_user_id = c424ab42fb4a456a9a59e66a889b07be {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cluster                        = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] compression_format             = gzip {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] compute_api_class              = cinder.compute.nova.API {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] config_dir                     = [] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] config_source                  = [] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] control_exchange               = openstack {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] debug                          = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] default_availability_zone      = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] default_group_type             = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] default_volume_type            = QuobyteHD {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] disk_geometry                  = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] driver_client_cert             = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] driver_client_cert_key         = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] driver_data_namespace          = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] driver_ssl_cert_path           = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] driver_ssl_cert_verify         = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] driver_use_ssl                 = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] enable_new_services            = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] enable_unsupported_driver      = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] enabled_backends               = ['QuobyteHD'] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] enforce_multipath_for_image_xfer = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] filter_function                = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] glance_api_insecure            = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] glance_api_servers             = ['http://192.168.122.228/image'] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] glance_api_ssl_compression     = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] glance_ca_certificates_file    = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] glance_catalog_info            = image:glance:publicURL {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] glance_certfile                = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] glance_keyfile                 = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] glance_num_retries             = 3 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] glance_request_timeout         = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] goodness_function              = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] graceful_shutdown_timeout      = 5 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] group_api_class                = cinder.group.api.API {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] host                           = devstack {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] image_compress_on_upload       = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] image_conversion_address_space_limit = 1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] image_conversion_cpu_limit     = 60 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] image_conversion_disable       = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] image_introspection_address_space_limit = 1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] image_introspection_cpu_limit  = 60 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] image_upload_use_cinder_backend = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] image_upload_use_internal_tenant = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] image_volume_cache_enabled     = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] image_volume_cache_max_count   = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] image_volume_cache_max_size_gb = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] init_host_max_objects_retrieval = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] instance_format                = [instance: %(uuid)s]  {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] iscsi_target_flags             =  {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] iscsi_write_cache              = on {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] iser_helper                    = tgtadm {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] iser_ip_address                = 192.168.122.228 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] iser_port                      = 3260 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] log_color                      = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] log_config_append              = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] log_dir                        = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] log_file                       = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] log_options                    = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] log_rotate_interval            = 1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] log_rotate_interval_type       = days {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] log_rotation_type              = none {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] max_age                        = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] max_logfile_count              = 30 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] max_logfile_size_mb            = 200 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] max_over_subscription_ratio    = 20.0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] message_reap_interval          = 86400 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] message_ttl                    = 2592000 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] migration_create_volume_timeout_secs = 300 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] monkey_patch                   = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] monkey_patch_modules           = [] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] my_ip                          = 192.168.122.228 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] no_snapshot_gb_quota           = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] num_iser_scan_tries            = 3 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] num_shell_tries                = 3 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] num_volume_device_scan_tries   = 3 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] nvmeof_conn_info_version       = 1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] nvmet_ns_id                    = 10 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] nvmet_port_id                  = 1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] osapi_max_limit                = 1000 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] osapi_volume_ext_list          = [] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] osapi_volume_listen_port       = 8776 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] osapi_volume_use_ssl           = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] osapi_volume_workers           = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] per_volume_size_limit          = -1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] periodic_fuzzy_delay           = 60 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] periodic_interval              = 60 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] public_endpoint                = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] publish_errors                 = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] quota_backup_gigabytes         = 1000 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] quota_backups                  = 10 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] quota_gigabytes                = 1000 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] quota_groups                   = 10 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] quota_snapshots                = 10 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] quota_volumes                  = 10 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] rate_limit_burst               = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] rate_limit_except_level        = CRITICAL {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] rate_limit_interval            = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] reinit_driver_count            = 3 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] replication_device             = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] report_discard_supported       = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] report_interval                = 120 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] reservation_clean_interval     = 86400 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] reservation_expire             = 86400 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] reserved_image_namespaces      = [] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] reserved_percentage            = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] rpc_response_timeout           = 120 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] run_external_periodic_tasks    = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] scst_target_driver             = iscsi {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] scst_target_iqn_name           = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86539]: INFO cinder.volume.manager [None req-6510e742-39b5-42d3-82cc-8cd1a1a00bb2 None None] Starting volume driver QuobyteDriver (1.2.1)
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] service_down_time              = 720 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86539]: DEBUG cinder.volume.drivers.remotefs [None req-6510e742-39b5-42d3-82cc-8cd1a1a00bb2 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86539) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] shell_completion               = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] snapshot_name_template         = snapshot-%s {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] split_loggers                  = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] state_path                     = /opt/stack/data/cinder {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] storage_availability_zone      = nova {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] storage_protocol               = iSCSI {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] syslog_log_facility            = LOG_USER {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] target_helper                  = lioadm {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] target_ip_address              = 192.168.122.228 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] target_port                    = 3260 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] target_protocol                = iscsi {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] target_secondary_ip_addresses  = [] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] trace_flags                    = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] transport_url                  = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] until_refresh                  = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] use_chap_auth                  = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] use_default_quota_class        = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] use_journal                    = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] use_json                       = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] use_multipath_for_image_xfer   = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] use_stderr                     = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] use_syslog                     = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] verify_glance_signatures       = enabled {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] volume_api_class               = cinder.volume.api.API {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] volume_backend_name            = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] volume_clear                   = zero {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] volume_clear_ionice            = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] volume_clear_size              = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] volume_copy_bps_limit          = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] volume_dd_blocksize            = 1M {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] volume_name_template           = volume-%s {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] volume_service_inithost_offload = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] volume_usage_audit_period      = month {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] zoning_mode                    = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_concurrency.disable_process_locking = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] keystone_authtoken.auth_section = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] keystone_authtoken.auth_type   = password {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] keystone_authtoken.auth_version = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] keystone_authtoken.cache       = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] keystone_authtoken.certfile    = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] keystone_authtoken.include_service_catalog = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] keystone_authtoken.insecure    = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] keystone_authtoken.interface   = public {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] keystone_authtoken.keyfile     = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] keystone_authtoken.memcache_password = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] keystone_authtoken.memcache_username = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] keystone_authtoken.region_name = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] keystone_authtoken.service_type = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.228/identity {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cache.backend                  = dogpile.cache.null {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cache.backend_argument         = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cache.backend_expiration_time  = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cache.config_prefix            = cache.oslo {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cache.debug_cache_backend      = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cache.enable_retry_client      = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cache.enable_socket_keepalive  = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cache.enabled                  = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cache.expiration_time          = 600 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cache.hashclient_retry_attempts = 2 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cache.memcache_dead_retry      = 300 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cache.memcache_pool_maxsize    = 10 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cache.memcache_sasl_enabled    = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cache.password                 = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cache.proxies                  = [] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cache.redis_db                 = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cache.redis_server             = localhost:6379 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cache.retry_attempts           = 2 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cache.retry_delay              = 0.0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cache.socket_keepalive_count   = 1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cache.socket_keepalive_idle    = 1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cache.socket_keepalive_interval = 1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cache.socket_timeout           = 1.0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cache.tls_allowed_ciphers      = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cache.tls_cafile               = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cache.tls_certfile             = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cache.tls_enabled              = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cache.tls_keyfile              = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cache.username                 = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] coordination.backend_url       = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] database.asyncio_connection    = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] database.asyncio_slave_connection = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] database.backend               = sqlalchemy {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] database.connection            = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] database.connection_debug      = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] database.connection_parameters =  {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] database.connection_recycle_time = 3600 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] database.connection_trace      = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] database.db_inc_retry_interval = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] database.db_max_retries        = 20 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] database.db_max_retry_interval = 10 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] database.db_retry_interval     = 1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] database.max_overflow          = 50 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] database.max_pool_size         = 5 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] database.max_retries           = 10 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:42 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] database.mysql_wsrep_sync_wait = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] database.pool_timeout          = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] database.retry_interval        = 10 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] database.slave_connection      = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] database.sqlite_synchronous    = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] database.synchronous_reader    = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] database.use_db_reconnect      = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_tracing.insecure = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] profiler.connection_string     = messaging:// {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] profiler.enabled               = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] profiler.es_doc_type           = notification {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] profiler.es_scroll_size        = 10000 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] profiler.es_scroll_time        = 2m {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] profiler.filter_error_trace    = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] profiler.hmac_keys             = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] profiler.sentinel_service_name = mymaster {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] profiler.socket_timeout        = 0.1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] profiler.trace_requests        = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] profiler.trace_sqlalchemy      = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] profiler_jaeger.process_tags   = {} {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] profiler_jaeger.service_name_prefix = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] profiler_otlp.service_name_prefix = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_policy.enforce_new_defaults = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_policy.policy_default_rule = default {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_policy.policy_file        = policy.yaml {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] privsep_osbrick.group          = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86539]: DEBUG cinder.volume.drivers.quobyte [None req-6510e742-39b5-42d3-82cc-8cd1a1a00bb2 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86539) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Nov 04 12:07:43 devstack cinder-volume[86539]: WARNING cinder.volume.drivers.quobyte [None req-6510e742-39b5-42d3-82cc-8cd1a1a00bb2 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] privsep_osbrick.helper_command = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] privsep_osbrick.user           = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cinder_sys_admin.group         = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cinder_sys_admin.helper_command = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] cinder_sys_admin.user          = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] service_user.auth_section      = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] service_user.auth_type         = password {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] service_user.cafile            = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] service_user.certfile          = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86539]: WARNING cinder.volume.drivers.quobyte [None req-6510e742-39b5-42d3-82cc-8cd1a1a00bb2 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] service_user.collect_timing    = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] service_user.insecure          = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] service_user.keyfile           = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] service_user.send_service_user_token = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] service_user.split_loggers     = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] service_user.timeout           = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] service_user.tls_ciphers       = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] service_user.tls_min_version   = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] glance.auth_section            = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] glance.auth_type               = password {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86539]: DEBUG oslo_concurrency.processutils [None req-6510e742-39b5-42d3-82cc-8cd1a1a00bb2 None None] Running cmd (subprocess): mount.quobyte {{(pid=86539) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] glance.certfile                = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] glance.collect_timing          = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] glance.insecure                = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] glance.keyfile                 = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] glance.region_name             = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] glance.split_loggers           = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] glance.timeout                 = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] glance.tls_ciphers             = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] glance.tls_min_version         = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.backend_availability_zone = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.chap_password = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.chap_username =  {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.disk_geometry = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.driver_client_cert = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.driver_client_cert_key = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.driver_data_namespace = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.driver_use_ssl = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.extra_capabilities = {} {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.filter_function = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.goodness_function = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.iscsi_target_flags =  {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.iscsi_write_cache = on {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.iser_helper   = tgtadm {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.iser_ip_address = 192.168.122.228 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.iser_port     = 3260 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.nas_host      =  {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.nas_login     = admin {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.nas_mount_options = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.nas_password  = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.nas_private_key =  {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.nas_share_path =  {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.num_shell_tries = 3 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.quobyte_volume_url = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.replication_device = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.report_discard_supported = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.reserved_percentage = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.target_helper = tgtadm {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.target_ip_address = 192.168.122.228 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.target_port   = 3260 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.target_protocol = iscsi {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.trace_flags   = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.unique_fqdn_network = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.use_chap_auth = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.volume_backend_name = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.volume_clear  = zero {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.volume_clear_ionice = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.volume_clear_size = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_reports.file_event_handler = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_reports.log_dir           = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.backend_availability_zone = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.backend_host         = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.chap_password        = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.chap_username        = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.chiscsi_conf         = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.disk_geometry        = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.driver_client_cert   = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.driver_data_namespace = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.driver_use_ssl       = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.extra_capabilities   = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.filter_function      = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.goodness_function    = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.iser_helper          = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.iser_ip_address      = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.iser_port            = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.iser_target_prefix   = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.nas_host             = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.nas_login            = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.nas_mount_options    = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.nas_password         = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.nas_private_key      = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.nas_share_path       = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.nas_ssh_port         = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.num_shell_tries      = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.nvmet_port_id        = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.replication_device   = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.report_discard_supported = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.reserved_percentage  = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.scst_target_driver   = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.storage_protocol     = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.target_helper        = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.target_ip_address    = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.target_port          = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.target_prefix        = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.target_protocol      = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.trace_flags          = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.use_chap_auth        = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.volume_clear         = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.volume_clear_size    = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] QuobyteHD.volumes_dir          = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack quobyte-client[86542]: Reading configuration file: /etc/quobyte/client.cfg
Nov 04 12:07:43 devstack quobyte-client[86542]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86539]: DEBUG oslo_concurrency.processutils [None req-6510e742-39b5-42d3-82cc-8cd1a1a00bb2 None None] CMD "mount.quobyte" returned: 1 in 0.118s {{(pid=86539) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86539]: DEBUG oslo_concurrency.lockutils [None req-6510e742-39b5-42d3-82cc-8cd1a1a00bb2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86539) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86539]: DEBUG oslo_concurrency.lockutils [None req-6510e742-39b5-42d3-82cc-8cd1a1a00bb2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86539) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_rabbit.ssl      = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86539]: DEBUG cinder.volume.drivers.quobyte [None req-6510e742-39b5-42d3-82cc-8cd1a1a00bb2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=86539) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_notifications.driver = [] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_notifications.retry = -1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] key_manager.fixed_key          = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] barbican.barbican_api_version  = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86539]: INFO cinder.volume.drivers.quobyte [None req-6510e742-39b5-42d3-82cc-8cd1a1a00bb2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 ...
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] barbican.barbican_endpoint     = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] barbican.barbican_endpoint_type = public {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86539]: DEBUG oslo_concurrency.processutils [None req-6510e742-39b5-42d3-82cc-8cd1a1a00bb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 -c /etc/quobyte/client-cinder.cfg {{(pid=86539) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] barbican.barbican_region_name  = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] barbican.cafile                = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] barbican.certfile              = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] barbican.collect_timing        = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] barbican.insecure              = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] barbican.keyfile               = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] barbican.number_of_retries     = 60 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] barbican.retry_delay           = 1 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] barbican.send_service_user_token = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] barbican.split_loggers         = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] barbican.timeout               = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] barbican.tls_ciphers           = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] barbican.tls_min_version       = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] barbican.verify_ssl            = True {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] barbican.verify_ssl_path       = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] barbican_service_user.auth_section = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] barbican_service_user.auth_type = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] barbican_service_user.cafile   = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] barbican_service_user.certfile = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] barbican_service_user.collect_timing = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] barbican_service_user.insecure = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] barbican_service_user.keyfile  = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] barbican_service_user.split_loggers = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] barbican_service_user.timeout  = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] barbican_service_user.tls_ciphers = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] barbican_service_user.tls_min_version = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] vault.approle_role_id          = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] vault.approle_secret_id        = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] vault.auth_method              = approle {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] vault.auth_path                = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] vault.kv_mountpoint            = secret {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] vault.kv_path                  = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] vault.kv_version               = 2 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] vault.namespace                = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] vault.root_token_id            = **** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] vault.ssl_ca_crt_file          = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] vault.timeout                  = 60.0 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] vault.token_file               = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] vault.token_role               = None {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] vault.use_ssl                  = False {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:43 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] ******************************************************************************** {{(pid=86318) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 04 12:07:43 devstack sudo[86545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 -c /etc/quobyte/client-cinder.cfg
Nov 04 12:07:43 devstack sudo[86545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:07:43 devstack sudo[86545]: pam_unix(sudo:session): session closed for user root
Nov 04 12:07:43 devstack cinder-volume[86539]: DEBUG oslo_concurrency.processutils [None req-6510e742-39b5-42d3-82cc-8cd1a1a00bb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.408s {{(pid=86539) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:07:43 devstack cinder-volume[86539]: INFO cinder.volume.drivers.quobyte [None req-6510e742-39b5-42d3-82cc-8cd1a1a00bb2 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 succeeded
Nov 04 12:07:43 devstack cinder-volume[86539]: DEBUG cinder.volume.drivers.quobyte [None req-6510e742-39b5-42d3-82cc-8cd1a1a00bb2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=86539) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:07:43 devstack cinder-volume[86539]: DEBUG oslo_concurrency.lockutils [None req-6510e742-39b5-42d3-82cc-8cd1a1a00bb2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.426s {{(pid=86539) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:07:43 devstack cinder-volume[86539]: DEBUG oslo_concurrency.processutils [None req-6510e742-39b5-42d3-82cc-8cd1a1a00bb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=86539) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:07:43 devstack sudo[86647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:07:43 devstack sudo[86647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:07:43 devstack sudo[86647]: pam_unix(sudo:session): session closed for user root
Nov 04 12:07:43 devstack cinder-volume[86539]: DEBUG oslo_concurrency.processutils [None req-6510e742-39b5-42d3-82cc-8cd1a1a00bb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.242s {{(pid=86539) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:07:43 devstack cinder-volume[86539]: INFO cinder.volume.driver [None req-6510e742-39b5-42d3-82cc-8cd1a1a00bb2 None None] Driver hasn't implemented _init_vendor_properties()
Nov 04 12:07:43 devstack cinder-volume[86539]: DEBUG cinder.volume.driver [None req-6510e742-39b5-42d3-82cc-8cd1a1a00bb2 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6071128845215, 'free_capacity_gb': 1773.6071128845215, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86539) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 04 12:07:43 devstack cinder-volume[86539]: DEBUG oslo_db.sqlalchemy.engines [None req-6510e742-39b5-42d3-82cc-8cd1a1a00bb2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86539) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 04 12:07:43 devstack cinder-volume[86539]: DEBUG dbcounter [-] [86539] Writer thread running {{(pid=86539) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 04 12:07:43 devstack cinder-volume[86539]: DEBUG cinder.db.api [None req-6510e742-39b5-42d3-82cc-8cd1a1a00bb2 None None] Building query based on filter {{(pid=86539) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}}
Nov 04 12:07:43 devstack cinder-volume[86539]: DEBUG cinder.image.image_utils [None req-6510e742-39b5-42d3-82cc-8cd1a1a00bb2 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86539) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 04 12:07:43 devstack cinder-volume[86539]: INFO cinder.keymgr.migration [None req-e7932e6a-399e-4997-8e0b-c46256e12026 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 04 12:07:43 devstack cinder-volume[86539]: DEBUG oslo_concurrency.lockutils [None req-6510e742-39b5-42d3-82cc-8cd1a1a00bb2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86539) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:07:43 devstack cinder-volume[86539]: DEBUG oslo_concurrency.lockutils [None req-6510e742-39b5-42d3-82cc-8cd1a1a00bb2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86539) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:07:43 devstack cinder-volume[86539]: DEBUG cinder.volume.drivers.quobyte [None req-6510e742-39b5-42d3-82cc-8cd1a1a00bb2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=86539) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:07:43 devstack cinder-volume[86539]: DEBUG cinder.volume.drivers.quobyte [None req-6510e742-39b5-42d3-82cc-8cd1a1a00bb2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=86539) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:07:43 devstack cinder-volume[86539]: DEBUG oslo_concurrency.lockutils [None req-6510e742-39b5-42d3-82cc-8cd1a1a00bb2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86539) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:07:43 devstack cinder-volume[86539]: DEBUG oslo_concurrency.processutils [None req-6510e742-39b5-42d3-82cc-8cd1a1a00bb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=86539) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:07:44 devstack sudo[86650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:07:44 devstack sudo[86650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:07:44 devstack sudo[86650]: pam_unix(sudo:session): session closed for user root
Nov 04 12:07:44 devstack cinder-volume[86539]: DEBUG oslo_concurrency.processutils [None req-6510e742-39b5-42d3-82cc-8cd1a1a00bb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.229s {{(pid=86539) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:07:44 devstack cinder-volume[86539]: DEBUG cinder.manager [None req-6510e742-39b5-42d3-82cc-8cd1a1a00bb2 None None] Notifying Schedulers of capabilities ... {{(pid=86539) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:07:44 devstack cinder-volume[86539]: INFO cinder.volume.manager [None req-6510e742-39b5-42d3-82cc-8cd1a1a00bb2 None None] Driver initialization completed successfully.
Nov 04 12:07:44 devstack cinder-volume[86539]: INFO cinder.manager [None req-6510e742-39b5-42d3-82cc-8cd1a1a00bb2 None None] Initiating service 3 cleanup
Nov 04 12:07:44 devstack cinder-volume[86539]: INFO cinder.manager [None req-6510e742-39b5-42d3-82cc-8cd1a1a00bb2 None None] Service 3 cleanup completed.
Nov 04 12:07:44 devstack cinder-volume[86539]: DEBUG cinder.service [None req-6510e742-39b5-42d3-82cc-8cd1a1a00bb2 None None] Creating RPC server for service cinder-volume {{(pid=86539) start /opt/stack/cinder/cinder/service.py:231}}
Nov 04 12:07:44 devstack cinder-volume[86539]: DEBUG cinder.service [None req-6510e742-39b5-42d3-82cc-8cd1a1a00bb2 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86539) start /opt/stack/cinder/cinder/service.py:237}}
Nov 04 12:07:44 devstack cinder-volume[86539]: INFO cinder.volume.manager [None req-6510e742-39b5-42d3-82cc-8cd1a1a00bb2 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Nov 04 12:07:44 devstack cinder-volume[86539]: DEBUG oslo_concurrency.lockutils [None req-6510e742-39b5-42d3-82cc-8cd1a1a00bb2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86539) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:07:44 devstack cinder-volume[86539]: DEBUG oslo_concurrency.lockutils [None req-6510e742-39b5-42d3-82cc-8cd1a1a00bb2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86539) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:07:44 devstack cinder-volume[86539]: DEBUG cinder.volume.drivers.quobyte [None req-6510e742-39b5-42d3-82cc-8cd1a1a00bb2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=86539) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:07:44 devstack cinder-volume[86539]: DEBUG cinder.volume.drivers.quobyte [None req-6510e742-39b5-42d3-82cc-8cd1a1a00bb2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=86539) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:07:44 devstack cinder-volume[86539]: DEBUG oslo_concurrency.lockutils [None req-6510e742-39b5-42d3-82cc-8cd1a1a00bb2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86539) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:07:44 devstack cinder-volume[86539]: DEBUG oslo_concurrency.processutils [None req-6510e742-39b5-42d3-82cc-8cd1a1a00bb2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=86539) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:07:44 devstack sudo[86653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:07:44 devstack sudo[86653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:07:44 devstack sudo[86653]: pam_unix(sudo:session): session closed for user root
Nov 04 12:07:44 devstack cinder-volume[86539]: DEBUG oslo_concurrency.processutils [None req-6510e742-39b5-42d3-82cc-8cd1a1a00bb2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.264s {{(pid=86539) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:07:44 devstack cinder-volume[86539]: INFO cinder.volume.manager [None req-6510e742-39b5-42d3-82cc-8cd1a1a00bb2 None None] Driver post RPC initialization completed successfully.
Nov 04 12:07:45 devstack cinder-volume[86539]: DEBUG oslo_service.periodic_task [None req-b5ea26b2-9c50-40b4-9a3a-afcb0d14b500 None None] Running periodic task VolumeManager._thread_info {{(pid=86539) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:07:45 devstack cinder-volume[86539]: DEBUG cinder.volume.manager [None req-b5ea26b2-9c50-40b4-9a3a-afcb0d14b500 None None] thread count: 6 {{(pid=86539) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 12:07:45 devstack cinder-volume[86539]: DEBUG cinder.volume.manager [None req-b5ea26b2-9c50-40b4-9a3a-afcb0d14b500 None None] thread info: [<_MainThread(MainThread, started 139551798857856)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 139551688301440)>, <Thread(Thread-3 (stat_writer), started daemon 139551683711808)>, <Thread(Rabbit-heartbeat, started daemon 139551686607424)>, <Thread(Thread-5 (_runner), started daemon 139551682687168)>, <Thread(Thread-7 (_runner), started daemon 139551682704128)>] {{(pid=86539) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 12:07:49 devstack cinder-volume[86539]: DEBUG oslo_concurrency.lockutils [None req-ee618363-798e-47bd-a1ec-8f4dde8a1b82 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86539) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:07:49 devstack cinder-volume[86539]: DEBUG oslo_concurrency.lockutils [None req-ee618363-798e-47bd-a1ec-8f4dde8a1b82 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86539) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:07:49 devstack cinder-volume[86539]: DEBUG cinder.volume.drivers.quobyte [None req-ee618363-798e-47bd-a1ec-8f4dde8a1b82 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=86539) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:07:49 devstack cinder-volume[86539]: DEBUG cinder.volume.drivers.quobyte [None req-ee618363-798e-47bd-a1ec-8f4dde8a1b82 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=86539) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:07:49 devstack cinder-volume[86539]: DEBUG oslo_concurrency.lockutils [None req-ee618363-798e-47bd-a1ec-8f4dde8a1b82 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86539) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:07:49 devstack cinder-volume[86539]: DEBUG oslo_concurrency.processutils [None req-ee618363-798e-47bd-a1ec-8f4dde8a1b82 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=86539) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:07:49 devstack cinder-volume[86318]: INFO oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] Caught SIGTERM, stopping children
Nov 04 12:07:49 devstack cinder-volume[86318]: DEBUG oslo_concurrency.lockutils [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] Acquiring lock "singleton_lock" {{(pid=86318) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 04 12:07:49 devstack cinder-volume[86318]: DEBUG oslo_concurrency.lockutils [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] Acquired lock "singleton_lock" {{(pid=86318) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 04 12:07:49 devstack cinder-volume[86318]: DEBUG oslo_concurrency.lockutils [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] Releasing lock "singleton_lock" {{(pid=86318) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 04 12:07:49 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] Stop services. {{(pid=86318) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}}
Nov 04 12:07:49 devstack sudo[86845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:07:49 devstack cinder-volume[86318]: DEBUG oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] Killing children. {{(pid=86318) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}}
Nov 04 12:07:49 devstack cinder-volume[86318]: INFO oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] Waiting on 1 children to exit
Nov 04 12:07:49 devstack sudo[86845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:07:49 devstack sudo[86845]: pam_unix(sudo:session): session closed for user root
Nov 04 12:07:49 devstack cinder-volume[86539]: DEBUG oslo_concurrency.processutils [None req-ee618363-798e-47bd-a1ec-8f4dde8a1b82 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.465s {{(pid=86539) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:07:49 devstack cinder-volume[86539]: DEBUG cinder.manager [None req-ee618363-798e-47bd-a1ec-8f4dde8a1b82 None None] Notifying Schedulers of capabilities ... {{(pid=86539) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ee618363-798e-47bd-a1ec-8f4dde8a1b82 None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ee618363-798e-47bd-a1ec-8f4dde8a1b82 None None] Unable to connect to AMQP server on 192.168.122.228:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server [None req-ee618363-798e-47bd-a1ec-8f4dde8a1b82 None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.228:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1109, in ensure
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server     ret, channel = autoretry_method()
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server                    ^^^^^^^^^^^^^^^^^^
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 558, in _ensured
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server     return fun(*args, **kwargs)
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 641, in __call__
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server     return fun(*args, channel=channels[0], **kwargs), channels[0]
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1098, in execute_method
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server     method()
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1575, in _publish
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server     self._producer.publish(
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 190, in publish
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server     return _publish(
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 214, in _publish
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server     return channel.basic_publish(
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server     self.wait([spec.Basic.Ack, spec.Basic.Nack],
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 99, in wait
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server     self.connection.drain_events(timeout=timeout)
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 526, in drain_events
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server     while not self.blocking_read(timeout):
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server               ^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 532, in blocking_read
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server     return self.on_inbound_frame(frame)
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/method_framing.py", line 53, in on_frame
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server     callback(channel, method_sig, buf, None)
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 538, in on_inbound_method
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server     return self.channels[channel_id].dispatch_method(
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server     listener(*args)
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 293, in _on_close
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server     raise error_for_code(
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server 
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server 
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 176, in _process_incoming
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server              ^^^^^^^^^^^^^^^^^^^^^^
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server     self._publish_service_capabilities(context)
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/manager.py", line 220, in _publish_service_capabilities
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server     self.scheduler_rpcapi.update_service_capabilities(
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server   File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server     cctxt.cast(ctxt, 'update_service_capabilities', **msg_args)
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/client.py", line 161, in cast
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server     self.transport._send(
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/transport.py", line 123, in _send
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server     return self._driver.send(target, ctxt, message,
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 824, in send
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server     return self._send(target, ctxt, message, wait_for_reply, timeout,
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 799, in _send
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server     conn.fanout_send(target.topic, msg, retry=retry)
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1694, in fanout_send
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server     self._ensure_publishing(self._publish, exchange, msg, retry=retry)
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1524, in _ensure_publishing
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server     self.ensure(method, retry=retry, error_callback=_error_callback)
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1135, in ensure
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server     raise exceptions.MessageDeliveryFailure(msg)
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.228:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/'
Nov 04 12:07:49 devstack cinder-volume[86539]: ERROR oslo_messaging.rpc.server 
Nov 04 12:07:52 devstack cinder-volume[86539]: DEBUG oslo_concurrency.lockutils [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] Acquiring lock "singleton_lock" {{(pid=86539) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 04 12:07:52 devstack cinder-volume[86539]: DEBUG oslo_concurrency.lockutils [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] Acquired lock "singleton_lock" {{(pid=86539) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 04 12:07:52 devstack cinder-volume[86539]: DEBUG oslo_concurrency.lockutils [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] Releasing lock "singleton_lock" {{(pid=86539) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 04 12:07:52 devstack cinder-volume[86539]: WARNING amqp [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 04 12:07:52 devstack cinder-volume[86539]: WARNING amqp [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] Received method (60, 30) during closing channel 1. This method will be ignored
Nov 04 12:07:52 devstack cinder-volume[86318]: INFO oslo_service.backend._eventlet.service [None req-68b69dfb-b0c7-4ca1-95f4-70904f832b58 None None] Child 86539 exited with status 0
Nov 04 12:07:53 devstack cinder-volume[86862]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning:
Nov 04 12:07:53 devstack cinder-volume[86862]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 04 12:07:53 devstack cinder-volume[86862]: we strongly recommend against using it for new projects.
Nov 04 12:07:53 devstack cinder-volume[86862]: If you are already using Eventlet, we recommend migrating to a different
Nov 04 12:07:53 devstack cinder-volume[86862]: framework.  For more detail see
Nov 04 12:07:53 devstack cinder-volume[86862]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 04 12:07:53 devstack cinder-volume[86862]:   import eventlet  # noqa
Nov 04 12:07:56 devstack cinder-volume[86862]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86862) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}}
Nov 04 12:07:56 devstack cinder-volume[86862]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86862) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}}
Nov 04 12:07:56 devstack cinder-volume[86862]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86862) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}}
Nov 04 12:07:56 devstack cinder-volume[86862]: INFO dbcounter [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] Registered counter for database cinder
Nov 04 12:07:56 devstack cinder-volume[86862]: DEBUG oslo_db.sqlalchemy.engines [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86862) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG dbcounter [-] [86862] Writer thread running {{(pid=86862) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 04 12:07:57 devstack cinder-volume[86862]: INFO cinder.rpc [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Nov 04 12:07:57 devstack cinder-volume[86862]: INFO cinder.rpc [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_db.sqlalchemy.engines [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86862) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 04 12:07:57 devstack cinder-volume[86862]: INFO cinder.volume.manager [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] Determined volume DB was empty at startup.
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG cinder.volume.manager [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86862) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}}
Nov 04 12:07:57 devstack cinder-volume[86862]: WARNING stevedore.named [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Nov 04 12:07:57 devstack cinder-volume[86862]: WARNING castellan.key_manager [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 04 12:07:57 devstack cinder-volume[86862]: WARNING cinder.keymgr.conf_key_mgr [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Nov 04 12:07:57 devstack cinder-volume[86862]: INFO cinder.volume.manager [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] Image-volume cache disabled for host devstack@QuobyteHD.
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_db.sqlalchemy.engines [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86862) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 04 12:07:57 devstack cinder-volume[86862]: INFO oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] Starting 1 workers
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] Started child 87169 {{(pid=86862) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] Full set of CONF: {{(pid=86862) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] ******************************************************************************** {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] Configuration options gathered from: {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] ================================================================================ {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}}
Nov 04 12:07:57 devstack cinder-volume[87169]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0)
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] allow_availability_zone_fallback = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] allow_compression_on_image_upload = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] allowed_direct_url_schemes     = [] {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] api_rate_limit                 = True {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] auth_strategy                  = keystone {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_availability_zone      = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_host                   = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_name                   = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_stats_polling_interval = 60 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backup_api_class               = cinder.backup.api.API {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backup_name_template           = backup-%s {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backup_use_same_host           = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backup_use_temp_snapshot       = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] chap_password                  = **** {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] chap_username                  =  {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cinder_internal_tenant_project_id = 935d34e30cd44f7d9799ac889224967b {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cinder_internal_tenant_user_id = c424ab42fb4a456a9a59e66a889b07be {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cluster                        = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] compression_format             = gzip {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] compute_api_class              = cinder.compute.nova.API {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] config_dir                     = [] {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] config_source                  = [] {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] control_exchange               = openstack {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] debug                          = True {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] default_availability_zone      = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] default_group_type             = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] default_log_levels             = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] default_volume_type            = QuobyteHD {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] disk_geometry                  = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] driver_client_cert             = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] driver_client_cert_key         = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] driver_data_namespace          = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] driver_ssl_cert_path           = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] driver_ssl_cert_verify         = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] driver_use_ssl                 = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] enable_new_services            = True {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] enable_unsupported_driver      = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] enabled_backends               = ['QuobyteHD'] {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] enforce_multipath_for_image_xfer = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] filter_function                = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] glance_api_insecure            = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] glance_api_servers             = ['http://192.168.122.228/image'] {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] glance_api_ssl_compression     = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] glance_ca_certificates_file    = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] glance_catalog_info            = image:glance:publicURL {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] glance_certfile                = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] glance_keyfile                 = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] glance_num_retries             = 3 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] glance_request_timeout         = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] goodness_function              = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] graceful_shutdown_timeout      = 5 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] group_api_class                = cinder.group.api.API {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] host                           = devstack {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] image_compress_on_upload       = True {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] image_conversion_address_space_limit = 1 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] image_conversion_cpu_limit     = 60 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] image_conversion_disable       = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] image_introspection_address_space_limit = 1 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] image_introspection_cpu_limit  = 60 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] image_upload_use_cinder_backend = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] image_upload_use_internal_tenant = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] image_volume_cache_enabled     = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] image_volume_cache_max_count   = 0 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] image_volume_cache_max_size_gb = 0 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] init_host_max_objects_retrieval = 0 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] instance_format                = [instance: %(uuid)s]  {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] iscsi_target_flags             =  {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] iscsi_write_cache              = on {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] iser_helper                    = tgtadm {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] iser_ip_address                = 192.168.122.228 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] iser_port                      = 3260 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] log_color                      = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] log_config_append              = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] log_dir                        = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-f9fbc06b-9689-488f-ba83-ac80a484f693 None None] Starting volume driver QuobyteDriver (1.2.1)
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] log_file                       = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-f9fbc06b-9689-488f-ba83-ac80a484f693 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87169) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] log_options                    = True {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] log_rotate_interval            = 1 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] log_rotate_interval_type       = days {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] log_rotation_type              = none {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] max_age                        = 0 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] max_logfile_count              = 30 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] max_logfile_size_mb            = 200 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] max_over_subscription_ratio    = 20.0 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] message_reap_interval          = 86400 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] message_ttl                    = 2592000 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] migration_create_volume_timeout_secs = 300 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] monkey_patch                   = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] monkey_patch_modules           = [] {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] my_ip                          = 192.168.122.228 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] no_snapshot_gb_quota           = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] num_iser_scan_tries            = 3 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] num_shell_tries                = 3 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] num_volume_device_scan_tries   = 3 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] nvmeof_conn_info_version       = 1 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] nvmet_ns_id                    = 10 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] nvmet_port_id                  = 1 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] osapi_max_limit                = 1000 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] osapi_volume_ext_list          = [] {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] osapi_volume_listen            = 0.0.0.0 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] osapi_volume_listen_port       = 8776 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] osapi_volume_use_ssl           = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] osapi_volume_workers           = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] per_volume_size_limit          = -1 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] periodic_fuzzy_delay           = 60 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] periodic_interval              = 60 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] project_id_regex               = [0-9a-f\-]+ {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] public_endpoint                = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] publish_errors                 = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] quota_backup_gigabytes         = 1000 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] quota_backups                  = 10 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] quota_gigabytes                = 1000 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] quota_groups                   = 10 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] quota_snapshots                = 10 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] quota_volumes                  = 10 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] rate_limit_burst               = 0 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] rate_limit_except_level        = CRITICAL {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] rate_limit_interval            = 0 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] reinit_driver_count            = 3 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] replication_device             = **** {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] report_discard_supported       = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] report_interval                = 120 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] reservation_clean_interval     = 86400 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] reservation_expire             = 86400 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] reserved_image_namespaces      = [] {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] reserved_percentage            = 0 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] rpc_response_timeout           = 120 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] run_external_periodic_tasks    = True {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] scst_target_driver             = iscsi {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] scst_target_iqn_name           = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] service_down_time              = 720 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] shell_completion               = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] snapshot_name_template         = snapshot-%s {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] split_loggers                  = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] state_path                     = /opt/stack/data/cinder {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] storage_availability_zone      = nova {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] storage_protocol               = iSCSI {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] syslog_log_facility            = LOG_USER {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] target_helper                  = lioadm {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] target_ip_address              = 192.168.122.228 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] target_port                    = 3260 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] target_protocol                = iscsi {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] target_secondary_ip_addresses  = [] {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] trace_flags                    = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] transfer_api_class             = cinder.transfer.api.API {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] transport_url                  = **** {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] until_refresh                  = 0 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] use_chap_auth                  = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] use_default_quota_class        = True {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] use_journal                    = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] use_json                       = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] use_multipath_for_image_xfer   = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] use_stderr                     = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] use_syslog                     = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] verify_glance_signatures       = enabled {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] volume_api_class               = cinder.volume.api.API {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] volume_backend_name            = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] volume_clear                   = zero {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] volume_clear_ionice            = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] volume_clear_size              = 0 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] volume_copy_bps_limit          = 0 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] volume_dd_blocksize            = 1M {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] volume_name_template           = volume-%s {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] volume_service_inithost_offload = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] volume_usage_audit_period      = month {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] zoning_mode                    = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_concurrency.disable_process_locking = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] os_brick.lock_path             = /opt/stack/data/os_brick {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f9fbc06b-9689-488f-ba83-ac80a484f693 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87169) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] keystone_authtoken.auth_section = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] keystone_authtoken.auth_type   = password {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] keystone_authtoken.auth_version = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] keystone_authtoken.cache       = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.quobyte [None req-f9fbc06b-9689-488f-ba83-ac80a484f693 None None] The NAS file operations will be run as root, allowing root level access at the storage backend.
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.quobyte [None req-f9fbc06b-9689-488f-ba83-ac80a484f693 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access).
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] keystone_authtoken.certfile    = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] keystone_authtoken.delay_auth_decision = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] keystone_authtoken.http_connect_timeout = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f9fbc06b-9689-488f-ba83-ac80a484f693 None None] Running cmd (subprocess): mount.quobyte {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] keystone_authtoken.include_service_catalog = True {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] keystone_authtoken.insecure    = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] keystone_authtoken.interface   = public {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] keystone_authtoken.keyfile     = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] keystone_authtoken.memcache_password = **** {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] keystone_authtoken.memcache_username = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] keystone_authtoken.region_name = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] keystone_authtoken.service_token_roles_required = True {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] keystone_authtoken.service_type = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] keystone_authtoken.token_cache_time = 300 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.228/identity {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cache.backend                  = dogpile.cache.null {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cache.backend_argument         = **** {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cache.backend_expiration_time  = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cache.config_prefix            = cache.oslo {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cache.debug_cache_backend      = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cache.enable_retry_client      = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cache.enable_socket_keepalive  = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cache.enabled                  = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cache.expiration_time          = 600 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cache.hashclient_dead_timeout  = 60.0 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cache.hashclient_retry_attempts = 2 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cache.memcache_dead_retry      = 300 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cache.memcache_pool_maxsize    = 10 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cache.memcache_sasl_enabled    = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cache.password                 = **** {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cache.proxies                  = [] {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cache.redis_db                 = 0 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cache.redis_sentinel_service_name = mymaster {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cache.redis_server             = localhost:6379 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cache.retry_attempts           = 2 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cache.retry_delay              = 0.0 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cache.socket_keepalive_count   = 1 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cache.socket_keepalive_idle    = 1 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cache.socket_keepalive_interval = 1 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cache.socket_timeout           = 1.0 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cache.tls_allowed_ciphers      = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cache.tls_cafile               = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cache.tls_certfile             = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cache.tls_enabled              = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cache.tls_keyfile              = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cache.username                 = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] coordination.backend_url       = **** {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] database.asyncio_connection    = **** {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] database.asyncio_slave_connection = **** {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] database.backend               = sqlalchemy {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] database.connection            = **** {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] database.connection_debug      = 0 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] database.connection_parameters =  {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] database.connection_recycle_time = 3600 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] database.connection_trace      = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] database.db_inc_retry_interval = True {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] database.db_max_retries        = 20 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] database.db_max_retry_interval = 10 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] database.db_retry_interval     = 1 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] database.max_overflow          = 50 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] database.max_pool_size         = 5 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] database.max_retries           = 10 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] database.mysql_wsrep_sync_wait = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] database.pool_timeout          = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] database.retry_interval        = 10 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] database.slave_connection      = **** {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] database.sqlite_synchronous    = True {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] database.synchronous_reader    = True {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] database.use_db_reconnect      = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_tracing.insecure = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] profiler.connection_string     = messaging:// {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] profiler.enabled               = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] profiler.es_doc_type           = notification {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] profiler.es_scroll_size        = 10000 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] profiler.es_scroll_time        = 2m {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] profiler.filter_error_trace    = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] profiler.hmac_keys             = **** {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] profiler.sentinel_service_name = mymaster {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] profiler.socket_timeout        = 0.1 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] profiler.trace_requests        = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] profiler.trace_sqlalchemy      = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] profiler_jaeger.process_tags   = {} {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] profiler_jaeger.service_name_prefix = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] profiler_otlp.service_name_prefix = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_policy.enforce_new_defaults = True {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_policy.policy_default_rule = default {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_policy.policy_file        = policy.yaml {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_policy.remote_timeout     = 60.0 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] privsep_osbrick.group          = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] privsep_osbrick.helper_command = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] privsep_osbrick.logger_name    = brick_privsep_hide_output {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] privsep_osbrick.user           = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cinder_sys_admin.group         = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cinder_sys_admin.helper_command = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack quobyte-client[87170]: Reading configuration file: /etc/quobyte/client.cfg
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack quobyte-client[87170]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] cinder_sys_admin.user          = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] service_user.auth_section      = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] service_user.auth_type         = password {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] service_user.cafile            = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] service_user.certfile          = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] service_user.collect_timing    = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] service_user.insecure          = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] service_user.keyfile           = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] service_user.send_service_user_token = True {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] service_user.split_loggers     = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] service_user.timeout           = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] service_user.tls_ciphers       = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] service_user.tls_min_version   = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] glance.auth_section            = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] glance.auth_type               = password {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] glance.certfile                = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] glance.collect_timing          = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] glance.insecure                = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] glance.keyfile                 = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] glance.region_name             = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] glance.split_loggers           = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] glance.timeout                 = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] glance.tls_ciphers             = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] glance.tls_min_version         = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.backend_availability_zone = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.chap_password = **** {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.chap_username =  {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.disk_geometry = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.driver_client_cert = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.driver_client_cert_key = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.driver_data_namespace = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.driver_use_ssl = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f9fbc06b-9689-488f-ba83-ac80a484f693 None None] CMD "mount.quobyte" returned: 1 in 0.066s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.enable_unsupported_driver = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.extra_capabilities = {} {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f9fbc06b-9689-488f-ba83-ac80a484f693 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.filter_function = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f9fbc06b-9689-488f-ba83-ac80a484f693 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.goodness_function = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f9fbc06b-9689-488f-ba83-ac80a484f693 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.iscsi_target_flags =  {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.iscsi_write_cache = on {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.iser_helper   = tgtadm {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.iser_ip_address = 192.168.122.228 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.iser_port     = 3260 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.nas_host      =  {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.nas_login     = admin {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.nas_mount_options = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.nas_password  = **** {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.nas_private_key =  {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.nas_share_path =  {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.nas_ssh_port  = 22 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.num_shell_tries = 3 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f9fbc06b-9689-488f-ba83-ac80a484f693 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.nvmet_port_id = 1 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f9fbc06b-9689-488f-ba83-ac80a484f693 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.quobyte_client_cfg = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f9fbc06b-9689-488f-ba83-ac80a484f693 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.quobyte_volume_url = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.replication_device = **** {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.report_discard_supported = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.reserved_percentage = 0 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.scst_target_driver = iscsi {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.scst_target_iqn_name = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.storage_protocol = iSCSI {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.target_helper = tgtadm {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.target_ip_address = 192.168.122.228 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.target_port   = 3260 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.target_protocol = iscsi {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.trace_flags   = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.unique_fqdn_network = True {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.use_chap_auth = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.volume_backend_name = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.volume_clear  = zero {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.volume_clear_ionice = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.volume_clear_size = 0 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_reports.file_event_handler = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_reports.log_dir           = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.backend_availability_zone = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.backend_host         = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.chap_password        = **** {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.chap_username        = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.chiscsi_conf         = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.disk_geometry        = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.driver_client_cert   = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.driver_client_cert_key = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.driver_data_namespace = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.driver_use_ssl       = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.extra_capabilities   = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.filter_function      = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.goodness_function    = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.iscsi_target_flags   = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.iscsi_write_cache    = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack sudo[87171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.iser_helper          = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.iser_ip_address      = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.iser_port            = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.iser_target_prefix   = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack sudo[87171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.nas_host             = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.nas_login            = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.nas_mount_options    = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.nas_password         = **** {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.nas_private_key      = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.nas_share_path       = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.nas_ssh_port         = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.num_shell_tries      = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.nvmet_ns_id          = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.nvmet_port_id        = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.quobyte_volume_url   = quobyte://osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.replication_device   = **** {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.report_discard_supported = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.reserved_percentage  = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.scst_target_driver   = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.storage_protocol     = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.target_helper        = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.target_ip_address    = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.target_port          = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.target_prefix        = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.target_protocol      = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.trace_flags          = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.unique_fqdn_network  = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.use_chap_auth        = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.volume_clear         = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.volume_clear_ionice  = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.volume_clear_size    = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] QuobyteHD.volumes_dir          = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_rabbit.ssl      = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_rabbit.ssl_version =  {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_notifications.driver = [] {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_notifications.retry = -1 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] oslo_messaging_notifications.transport_url = **** {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] key_manager.fixed_key          = **** {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] barbican.barbican_api_version  = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] barbican.barbican_endpoint     = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] barbican.barbican_endpoint_type = public {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] barbican.barbican_region_name  = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] barbican.cafile                = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] barbican.certfile              = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] barbican.collect_timing        = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] barbican.insecure              = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] barbican.keyfile               = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] barbican.number_of_retries     = 60 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] barbican.retry_delay           = 1 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] barbican.send_service_user_token = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] barbican.split_loggers         = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] barbican.timeout               = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] barbican.tls_ciphers           = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] barbican.tls_min_version       = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] barbican.verify_ssl            = True {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] barbican.verify_ssl_path       = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] barbican_service_user.auth_section = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] barbican_service_user.auth_type = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] barbican_service_user.cafile   = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] barbican_service_user.certfile = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] barbican_service_user.collect_timing = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] barbican_service_user.insecure = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] barbican_service_user.keyfile  = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] barbican_service_user.split_loggers = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] barbican_service_user.timeout  = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] barbican_service_user.tls_ciphers = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] barbican_service_user.tls_min_version = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] vault.approle_role_id          = **** {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] vault.approle_secret_id        = **** {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] vault.auth_method              = approle {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] vault.auth_path                = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] vault.kv_mountpoint            = secret {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] vault.kv_path                  = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] vault.kv_version               = 2 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] vault.namespace                = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] vault.root_token_id            = **** {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] vault.ssl_ca_crt_file          = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] vault.timeout                  = 60.0 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] vault.token_file               = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] vault.token_role               = None {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] vault.use_ssl                  = False {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}}
Nov 04 12:07:57 devstack cinder-volume[86862]: DEBUG oslo_service.backend._eventlet.service [None req-7d93c3b7-ebe2-4c79-8e99-03eaf649715f None None] ******************************************************************************** {{(pid=86862) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}}
Nov 04 12:07:58 devstack sudo[87171]: pam_unix(sudo:session): session closed for user root
Nov 04 12:07:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f9fbc06b-9689-488f-ba83-ac80a484f693 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.240s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:07:58 devstack cinder-volume[87169]: INFO cinder.volume.driver [None req-f9fbc06b-9689-488f-ba83-ac80a484f693 None None] Driver hasn't implemented _init_vendor_properties()
Nov 04 12:07:58 devstack cinder-volume[87169]: DEBUG cinder.volume.driver [None req-f9fbc06b-9689-488f-ba83-ac80a484f693 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6071128845215, 'free_capacity_gb': 1773.6071128845215, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87169) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}}
Nov 04 12:07:58 devstack cinder-volume[87169]: DEBUG oslo_db.sqlalchemy.engines [None req-f9fbc06b-9689-488f-ba83-ac80a484f693 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87169) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}}
Nov 04 12:07:58 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writer thread running {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}}
Nov 04 12:07:58 devstack cinder-volume[87169]: DEBUG cinder.db.api [None req-f9fbc06b-9689-488f-ba83-ac80a484f693 None None] Building query based on filter {{(pid=87169) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}}
Nov 04 12:07:58 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-f9fbc06b-9689-488f-ba83-ac80a484f693 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87169) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}}
Nov 04 12:07:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f9fbc06b-9689-488f-ba83-ac80a484f693 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:07:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f9fbc06b-9689-488f-ba83-ac80a484f693 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:07:58 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f9fbc06b-9689-488f-ba83-ac80a484f693 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:07:58 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f9fbc06b-9689-488f-ba83-ac80a484f693 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:07:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f9fbc06b-9689-488f-ba83-ac80a484f693 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:07:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f9fbc06b-9689-488f-ba83-ac80a484f693 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:07:58 devstack cinder-volume[87169]: INFO cinder.keymgr.migration [None req-5189c386-4b03-487b-b5ec-85a620f57b61 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Nov 04 12:07:58 devstack sudo[87182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:07:58 devstack sudo[87182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:07:58 devstack sudo[87182]: pam_unix(sudo:session): session closed for user root
Nov 04 12:07:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f9fbc06b-9689-488f-ba83-ac80a484f693 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.225s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:07:58 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-f9fbc06b-9689-488f-ba83-ac80a484f693 None None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:07:58 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-f9fbc06b-9689-488f-ba83-ac80a484f693 None None] Driver initialization completed successfully.
Nov 04 12:07:58 devstack cinder-volume[87169]: INFO cinder.manager [None req-f9fbc06b-9689-488f-ba83-ac80a484f693 None None] Initiating service 3 cleanup
Nov 04 12:07:58 devstack cinder-volume[87169]: INFO cinder.manager [None req-f9fbc06b-9689-488f-ba83-ac80a484f693 None None] Service 3 cleanup completed.
Nov 04 12:07:58 devstack cinder-volume[87169]: DEBUG cinder.service [None req-f9fbc06b-9689-488f-ba83-ac80a484f693 None None] Creating RPC server for service cinder-volume {{(pid=87169) start /opt/stack/cinder/cinder/service.py:231}}
Nov 04 12:07:58 devstack cinder-volume[87169]: DEBUG cinder.service [None req-f9fbc06b-9689-488f-ba83-ac80a484f693 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87169) start /opt/stack/cinder/cinder/service.py:237}}
Nov 04 12:07:58 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-f9fbc06b-9689-488f-ba83-ac80a484f693 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1)
Nov 04 12:07:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f9fbc06b-9689-488f-ba83-ac80a484f693 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:07:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f9fbc06b-9689-488f-ba83-ac80a484f693 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:07:58 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f9fbc06b-9689-488f-ba83-ac80a484f693 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:07:58 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f9fbc06b-9689-488f-ba83-ac80a484f693 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:07:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f9fbc06b-9689-488f-ba83-ac80a484f693 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:07:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f9fbc06b-9689-488f-ba83-ac80a484f693 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:07:58 devstack sudo[87195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:07:58 devstack sudo[87195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:07:58 devstack sudo[87195]: pam_unix(sudo:session): session closed for user root
Nov 04 12:07:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f9fbc06b-9689-488f-ba83-ac80a484f693 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.243s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:07:58 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-f9fbc06b-9689-488f-ba83-ac80a484f693 None None] Driver post RPC initialization completed successfully.
Nov 04 12:08:07 devstack cinder-volume[86862]: DEBUG dbcounter [-] [86862] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86862) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:08:08 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:08:08 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=4 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:08:49 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager._thread_info {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:08:49 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread count: 6 {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 12:08:49 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread info: [<_MainThread(MainThread, started 137165867425920)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137165754678912)>, <Thread(Thread-3 (stat_writer), started daemon 137165754130752)>, <Thread(Rabbit-heartbeat, started daemon 137165752997504)>, <Thread(Thread-5 (_runner), started daemon 137165753227712)>, <Thread(Thread-7 (_runner), started daemon 137165751273856)>] {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 12:09:14 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe4911da-af5b-443a-b6cf-4231b861a633 tempest-DeleteServersTestJSON-1787686260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:09:14 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-fe4911da-af5b-443a-b6cf-4231b861a633 tempest-DeleteServersTestJSON-1787686260 None] Flow 'volume_create_manager' (f4c2540d-e986-4caf-adc5-93bb8a89863d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:09:14 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-fe4911da-af5b-443a-b6cf-4231b861a633 tempest-DeleteServersTestJSON-1787686260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a42920c-f9f5-4a97-ba6d-1b58b49223a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:09:14 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-fe4911da-af5b-443a-b6cf-4231b861a633 tempest-DeleteServersTestJSON-1787686260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a42920c-f9f5-4a97-ba6d-1b58b49223a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1090163663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=959c11fe-7191-476e-a89d-c160c1f72ca9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528aad30accb43dab20fa49a4846d7ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:09:14Z,use_quota=True,user_id='5ab96765c4bf410583e688a52381df89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:09:14 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-fe4911da-af5b-443a-b6cf-4231b861a633 tempest-DeleteServersTestJSON-1787686260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b7938a1-c7a3-448f-9728-3eeaaa28d873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:09:14 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-fe4911da-af5b-443a-b6cf-4231b861a633 tempest-DeleteServersTestJSON-1787686260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b7938a1-c7a3-448f-9728-3eeaaa28d873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:09:14 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-fe4911da-af5b-443a-b6cf-4231b861a633 tempest-DeleteServersTestJSON-1787686260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65ebfb1e-7270-4ee6-89fe-72dbffaac694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:09:14 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-fe4911da-af5b-443a-b6cf-4231b861a633 tempest-DeleteServersTestJSON-1787686260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65ebfb1e-7270-4ee6-89fe-72dbffaac694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '959c11fe-7191-476e-a89d-c160c1f72ca9', 'volume_name': 'volume-959c11fe-7191-476e-a89d-c160c1f72ca9', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:09:14 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-fe4911da-af5b-443a-b6cf-4231b861a633 tempest-DeleteServersTestJSON-1787686260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78b9943e-0602-4747-9e69-2894e2880ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:09:14 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-fe4911da-af5b-443a-b6cf-4231b861a633 tempest-DeleteServersTestJSON-1787686260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78b9943e-0602-4747-9e69-2894e2880ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:09:14 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-fe4911da-af5b-443a-b6cf-4231b861a633 tempest-DeleteServersTestJSON-1787686260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bb44b8f-bcbf-43bd-810c-7e2e1ef271d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:09:14 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-fe4911da-af5b-443a-b6cf-4231b861a633 tempest-DeleteServersTestJSON-1787686260 None] Volume 959c11fe-7191-476e-a89d-c160c1f72ca9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-959c11fe-7191-476e-a89d-c160c1f72ca9', 'volume_size': 1}
Nov 04 12:09:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-fe4911da-af5b-443a-b6cf-4231b861a633 tempest-DeleteServersTestJSON-1787686260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:09:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-fe4911da-af5b-443a-b6cf-4231b861a633 tempest-DeleteServersTestJSON-1787686260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:09:14 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-fe4911da-af5b-443a-b6cf-4231b861a633 tempest-DeleteServersTestJSON-1787686260 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1090163663',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=959c11fe-7191-476e-a89d-c160c1f72ca9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='528aad30accb43dab20fa49a4846d7ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:09:14Z,use_quota=True,user_id='5ab96765c4bf410583e688a52381df89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:09:14 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-fe4911da-af5b-443a-b6cf-4231b861a633 tempest-DeleteServersTestJSON-1787686260 None] Creating volume 959c11fe-7191-476e-a89d-c160c1f72ca9 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:09:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-fe4911da-af5b-443a-b6cf-4231b861a633 tempest-DeleteServersTestJSON-1787686260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:09:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-fe4911da-af5b-443a-b6cf-4231b861a633 tempest-DeleteServersTestJSON-1787686260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:09:14 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-fe4911da-af5b-443a-b6cf-4231b861a633 tempest-DeleteServersTestJSON-1787686260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:09:14 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-fe4911da-af5b-443a-b6cf-4231b861a633 tempest-DeleteServersTestJSON-1787686260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:09:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-fe4911da-af5b-443a-b6cf-4231b861a633 tempest-DeleteServersTestJSON-1787686260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:09:14 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-fe4911da-af5b-443a-b6cf-4231b861a633 tempest-DeleteServersTestJSON-1787686260 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:09:14 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-fe4911da-af5b-443a-b6cf-4231b861a633 tempest-DeleteServersTestJSON-1787686260 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:09:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fe4911da-af5b-443a-b6cf-4231b861a633 tempest-DeleteServersTestJSON-1787686260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-959c11fe-7191-476e-a89d-c160c1f72ca9 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:09:14 devstack sudo[87860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-959c11fe-7191-476e-a89d-c160c1f72ca9 1073741824
Nov 04 12:09:14 devstack sudo[87860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:09:16 devstack sudo[87860]: pam_unix(sudo:session): session closed for user root
Nov 04 12:09:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fe4911da-af5b-443a-b6cf-4231b861a633 tempest-DeleteServersTestJSON-1787686260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-959c11fe-7191-476e-a89d-c160c1f72ca9 1073741824" returned: 0 in 1.418s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:09:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fe4911da-af5b-443a-b6cf-4231b861a633 tempest-DeleteServersTestJSON-1787686260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-959c11fe-7191-476e-a89d-c160c1f72ca9 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:09:16 devstack sudo[88202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-959c11fe-7191-476e-a89d-c160c1f72ca9
Nov 04 12:09:16 devstack sudo[88202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:09:16 devstack sudo[88202]: pam_unix(sudo:session): session closed for user root
Nov 04 12:09:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fe4911da-af5b-443a-b6cf-4231b861a633 tempest-DeleteServersTestJSON-1787686260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-959c11fe-7191-476e-a89d-c160c1f72ca9" returned: 0 in 0.660s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:09:16 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-fe4911da-af5b-443a-b6cf-4231b861a633 tempest-DeleteServersTestJSON-1787686260 None] <== create_volume: return (2217ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:09:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-fe4911da-af5b-443a-b6cf-4231b861a633 tempest-DeleteServersTestJSON-1787686260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.220s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:09:16 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-fe4911da-af5b-443a-b6cf-4231b861a633 tempest-DeleteServersTestJSON-1787686260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bb44b8f-bcbf-43bd-810c-7e2e1ef271d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-959c11fe-7191-476e-a89d-c160c1f72ca9', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:09:16 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-fe4911da-af5b-443a-b6cf-4231b861a633 tempest-DeleteServersTestJSON-1787686260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75adba46-ead9-4012-b0d2-641c4b944ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:09:16 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-fe4911da-af5b-443a-b6cf-4231b861a633 tempest-DeleteServersTestJSON-1787686260 None] Volume volume-959c11fe-7191-476e-a89d-c160c1f72ca9 (959c11fe-7191-476e-a89d-c160c1f72ca9): created successfully
Nov 04 12:09:16 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-fe4911da-af5b-443a-b6cf-4231b861a633 tempest-DeleteServersTestJSON-1787686260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75adba46-ead9-4012-b0d2-641c4b944ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:09:16 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-fe4911da-af5b-443a-b6cf-4231b861a633 tempest-DeleteServersTestJSON-1787686260 None] Flow 'volume_create_manager' (f4c2540d-e986-4caf-adc5-93bb8a89863d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:09:17 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-fe4911da-af5b-443a-b6cf-4231b861a633 tempest-DeleteServersTestJSON-1787686260 None] Created volume successfully.
Nov 04 12:09:20 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-574b7705-53c2-48e0-85c2-4cdada715339 tempest-VolumesAdminNegativeTest-945691552 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:09:20 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-574b7705-53c2-48e0-85c2-4cdada715339 tempest-VolumesAdminNegativeTest-945691552 None] Flow 'volume_create_manager' (54008631-5f1d-4930-b550-89a236f1d0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:09:20 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-574b7705-53c2-48e0-85c2-4cdada715339 tempest-VolumesAdminNegativeTest-945691552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (315a8e1a-986e-4eb6-ad58-10c6180e0983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:09:20 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-574b7705-53c2-48e0-85c2-4cdada715339 tempest-VolumesAdminNegativeTest-945691552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (315a8e1a-986e-4eb6-ad58-10c6180e0983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-200955969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e75d06ee-ea1f-400f-983b-c1c3571f7f0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34868a0a71b94d02af73c6b2d8e3331b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:09:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:09:20Z,use_quota=True,user_id='95b31276467f4bdc83ddcc53060dd825',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:09:20 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-574b7705-53c2-48e0-85c2-4cdada715339 tempest-VolumesAdminNegativeTest-945691552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4355f74-5224-4403-b209-802afa8b44a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:09:20 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-574b7705-53c2-48e0-85c2-4cdada715339 tempest-VolumesAdminNegativeTest-945691552 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4355f74-5224-4403-b209-802afa8b44a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:09:20 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-574b7705-53c2-48e0-85c2-4cdada715339 tempest-VolumesAdminNegativeTest-945691552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35293146-e40d-47d4-8dee-6aba1deda496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:09:20 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-574b7705-53c2-48e0-85c2-4cdada715339 tempest-VolumesAdminNegativeTest-945691552 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35293146-e40d-47d4-8dee-6aba1deda496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e75d06ee-ea1f-400f-983b-c1c3571f7f0a', 'volume_name': 'volume-e75d06ee-ea1f-400f-983b-c1c3571f7f0a', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:09:20 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-574b7705-53c2-48e0-85c2-4cdada715339 tempest-VolumesAdminNegativeTest-945691552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd5c0f79-538c-407b-97be-cd7c9964e46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:09:20 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-574b7705-53c2-48e0-85c2-4cdada715339 tempest-VolumesAdminNegativeTest-945691552 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd5c0f79-538c-407b-97be-cd7c9964e46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:09:20 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-574b7705-53c2-48e0-85c2-4cdada715339 tempest-VolumesAdminNegativeTest-945691552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bcf123d-de4c-42cb-a804-2adea80aac7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:09:20 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-574b7705-53c2-48e0-85c2-4cdada715339 tempest-VolumesAdminNegativeTest-945691552 None] Volume e75d06ee-ea1f-400f-983b-c1c3571f7f0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e75d06ee-ea1f-400f-983b-c1c3571f7f0a', 'volume_size': 1}
Nov 04 12:09:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-574b7705-53c2-48e0-85c2-4cdada715339 tempest-VolumesAdminNegativeTest-945691552 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:09:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-574b7705-53c2-48e0-85c2-4cdada715339 tempest-VolumesAdminNegativeTest-945691552 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:09:20 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-574b7705-53c2-48e0-85c2-4cdada715339 tempest-VolumesAdminNegativeTest-945691552 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:09:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-200955969',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e75d06ee-ea1f-400f-983b-c1c3571f7f0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34868a0a71b94d02af73c6b2d8e3331b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:09:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:09:20Z,use_quota=True,user_id='95b31276467f4bdc83ddcc53060dd825',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:09:20 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-574b7705-53c2-48e0-85c2-4cdada715339 tempest-VolumesAdminNegativeTest-945691552 None] Creating volume e75d06ee-ea1f-400f-983b-c1c3571f7f0a {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:09:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-574b7705-53c2-48e0-85c2-4cdada715339 tempest-VolumesAdminNegativeTest-945691552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:09:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-574b7705-53c2-48e0-85c2-4cdada715339 tempest-VolumesAdminNegativeTest-945691552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:09:20 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-574b7705-53c2-48e0-85c2-4cdada715339 tempest-VolumesAdminNegativeTest-945691552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:09:20 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-574b7705-53c2-48e0-85c2-4cdada715339 tempest-VolumesAdminNegativeTest-945691552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:09:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-574b7705-53c2-48e0-85c2-4cdada715339 tempest-VolumesAdminNegativeTest-945691552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:09:20 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-574b7705-53c2-48e0-85c2-4cdada715339 tempest-VolumesAdminNegativeTest-945691552 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:09:20 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-574b7705-53c2-48e0-85c2-4cdada715339 tempest-VolumesAdminNegativeTest-945691552 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:09:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-574b7705-53c2-48e0-85c2-4cdada715339 tempest-VolumesAdminNegativeTest-945691552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e75d06ee-ea1f-400f-983b-c1c3571f7f0a 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:09:20 devstack sudo[88309]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e75d06ee-ea1f-400f-983b-c1c3571f7f0a 1073741824
Nov 04 12:09:20 devstack sudo[88309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:09:21 devstack sudo[88309]: pam_unix(sudo:session): session closed for user root
Nov 04 12:09:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-574b7705-53c2-48e0-85c2-4cdada715339 tempest-VolumesAdminNegativeTest-945691552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e75d06ee-ea1f-400f-983b-c1c3571f7f0a 1073741824" returned: 0 in 1.399s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:09:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-574b7705-53c2-48e0-85c2-4cdada715339 tempest-VolumesAdminNegativeTest-945691552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e75d06ee-ea1f-400f-983b-c1c3571f7f0a {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:09:22 devstack sudo[88323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e75d06ee-ea1f-400f-983b-c1c3571f7f0a
Nov 04 12:09:22 devstack sudo[88323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:09:22 devstack sudo[88323]: pam_unix(sudo:session): session closed for user root
Nov 04 12:09:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-574b7705-53c2-48e0-85c2-4cdada715339 tempest-VolumesAdminNegativeTest-945691552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e75d06ee-ea1f-400f-983b-c1c3571f7f0a" returned: 0 in 0.639s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:09:22 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-574b7705-53c2-48e0-85c2-4cdada715339 tempest-VolumesAdminNegativeTest-945691552 None] <== create_volume: return (2147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:09:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-574b7705-53c2-48e0-85c2-4cdada715339 tempest-VolumesAdminNegativeTest-945691552 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.158s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:09:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-574b7705-53c2-48e0-85c2-4cdada715339 tempest-VolumesAdminNegativeTest-945691552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bcf123d-de4c-42cb-a804-2adea80aac7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e75d06ee-ea1f-400f-983b-c1c3571f7f0a', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:09:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-574b7705-53c2-48e0-85c2-4cdada715339 tempest-VolumesAdminNegativeTest-945691552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3328378e-338b-46ff-9b40-5deb50f3d233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:09:22 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-574b7705-53c2-48e0-85c2-4cdada715339 tempest-VolumesAdminNegativeTest-945691552 None] Volume volume-e75d06ee-ea1f-400f-983b-c1c3571f7f0a (e75d06ee-ea1f-400f-983b-c1c3571f7f0a): created successfully
Nov 04 12:09:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-574b7705-53c2-48e0-85c2-4cdada715339 tempest-VolumesAdminNegativeTest-945691552 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3328378e-338b-46ff-9b40-5deb50f3d233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:09:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-574b7705-53c2-48e0-85c2-4cdada715339 tempest-VolumesAdminNegativeTest-945691552 None] Flow 'volume_create_manager' (54008631-5f1d-4930-b550-89a236f1d0ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:09:22 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-574b7705-53c2-48e0-85c2-4cdada715339 tempest-VolumesAdminNegativeTest-945691552 None] Created volume successfully.
Nov 04 12:09:24 devstack cinder-volume[87169]: WARNING py.warnings [req-801a9092-0fdc-4bb1-a8ce-f621f0e4004f req-5ca06fb1-8f93-43dc-8fa8-408194d069ff tempest-DeleteServersTestJSON-1787686260 None] /opt/stack/cinder/cinder/db/api.py:2442: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volume_attachment", "volumes_1" and FROM element "volumes".  Apply join condition(s) between each element to resolve.
Nov 04 12:09:24 devstack cinder-volume[87169]:   .first()
Nov 04 12:09:24 devstack cinder-volume[87169]: 
Nov 04 12:09:24 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-365790da-1463-4302-a184-5c2d5d67e615 tempest-VolumesAdminNegativeTest-945691552 None] Acquiring lock "cinder-e75d06ee-ea1f-400f-983b-c1c3571f7f0a-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:09:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-801a9092-0fdc-4bb1-a8ce-f621f0e4004f req-5ca06fb1-8f93-43dc-8fa8-408194d069ff tempest-DeleteServersTestJSON-1787686260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:09:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-801a9092-0fdc-4bb1-a8ce-f621f0e4004f req-5ca06fb1-8f93-43dc-8fa8-408194d069ff tempest-DeleteServersTestJSON-1787686260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:09:24 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-365790da-1463-4302-a184-5c2d5d67e615 tempest-VolumesAdminNegativeTest-945691552 None] Lock "cinder-e75d06ee-ea1f-400f-983b-c1c3571f7f0a-delete_volume" acquired by "delete_volume" :: waited 0.122s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:09:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-801a9092-0fdc-4bb1-a8ce-f621f0e4004f req-5ca06fb1-8f93-43dc-8fa8-408194d069ff tempest-DeleteServersTestJSON-1787686260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.326s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:09:24 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-801a9092-0fdc-4bb1-a8ce-f621f0e4004f req-5ca06fb1-8f93-43dc-8fa8-408194d069ff tempest-DeleteServersTestJSON-1787686260 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79', 'name': 'volume-959c11fe-7191-476e-a89d-c160c1f72ca9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6879a527-0a0b-4bc0-bdb6-cedcdff4fd3f', 'enforce_multipath': True} {{(pid=87169) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 04 12:09:24 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-365790da-1463-4302-a184-5c2d5d67e615 tempest-VolumesAdminNegativeTest-945691552 None] Acquiring lock "cinder-quobyte-e75d06ee-ea1f-400f-983b-c1c3571f7f0a" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:09:24 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-365790da-1463-4302-a184-5c2d5d67e615 tempest-VolumesAdminNegativeTest-945691552 None] Lock "cinder-quobyte-e75d06ee-ea1f-400f-983b-c1c3571f7f0a" acquired by "delete_volume" :: waited 0.091s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:09:24 devstack cinder-volume[87169]: INFO oslo.privsep.daemon [None req-365790da-1463-4302-a184-5c2d5d67e615 tempest-VolumesAdminNegativeTest-945691552 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpjg690nob/privsep.sock']
Nov 04 12:09:24 devstack sudo[88340]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpjg690nob/privsep.sock
Nov 04 12:09:24 devstack sudo[88340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:09:25 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-801a9092-0fdc-4bb1-a8ce-f621f0e4004f req-5ca06fb1-8f93-43dc-8fa8-408194d069ff tempest-DeleteServersTestJSON-1787686260 None] attachment_update completed successfully.
Nov 04 12:09:26 devstack cinder-volume[87169]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning:
Nov 04 12:09:26 devstack cinder-volume[87169]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and
Nov 04 12:09:26 devstack cinder-volume[87169]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects.
Nov 04 12:09:26 devstack cinder-volume[87169]: WARNING oslo.privsep.daemon [-] privsep log: 
Nov 04 12:09:26 devstack cinder-volume[87169]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different
Nov 04 12:09:26 devstack cinder-volume[87169]: WARNING oslo.privsep.daemon [-] privsep log: framework.  For more detail see
Nov 04 12:09:26 devstack cinder-volume[87169]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html
Nov 04 12:09:26 devstack cinder-volume[87169]: WARNING oslo.privsep.daemon [-] privsep log: 
Nov 04 12:09:26 devstack cinder-volume[87169]: WARNING oslo.privsep.daemon [-] privsep log:   import eventlet
Nov 04 12:09:27 devstack sudo[88340]: pam_unix(sudo:session): session closed for user root
Nov 04 12:09:27 devstack cinder-volume[87169]: INFO oslo.privsep.daemon [None req-365790da-1463-4302-a184-5c2d5d67e615 tempest-VolumesAdminNegativeTest-945691552 None] Spawned new privsep daemon via rootwrap
Nov 04 12:09:27 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [None req-365790da-1463-4302-a184-5c2d5d67e615 tempest-VolumesAdminNegativeTest-945691552 None] Accepted privsep connection to /tmp/tmpjg690nob/privsep.sock {{(pid=87169) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}}
Nov 04 12:09:27 devstack cinder-volume[87169]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 04 12:09:27 devstack cinder-volume[87169]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 04 12:09:27 devstack cinder-volume[87169]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 04 12:09:27 devstack cinder-volume[87169]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88763
Nov 04 12:09:27 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90dc23d-c986-4f7c-8f3b-3a5c274fc77b]: (2,) {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:09:27 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf894d33-f1cd-497b-bf4f-d7e0c5d909b7]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:09:27 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-365790da-1463-4302-a184-5c2d5d67e615 tempest-VolumesAdminNegativeTest-945691552 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e75d06ee-ea1f-400f-983b-c1c3571f7f0a {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:09:27 devstack sudo[88765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e75d06ee-ea1f-400f-983b-c1c3571f7f0a
Nov 04 12:09:27 devstack sudo[88765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:09:28 devstack sudo[88765]: pam_unix(sudo:session): session closed for user root
Nov 04 12:09:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-365790da-1463-4302-a184-5c2d5d67e615 tempest-VolumesAdminNegativeTest-945691552 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e75d06ee-ea1f-400f-983b-c1c3571f7f0a" returned: 0 in 0.799s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:09:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-365790da-1463-4302-a184-5c2d5d67e615 tempest-VolumesAdminNegativeTest-945691552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e75d06ee-ea1f-400f-983b-c1c3571f7f0a {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:09:28 devstack sudo[88776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e75d06ee-ea1f-400f-983b-c1c3571f7f0a
Nov 04 12:09:28 devstack sudo[88776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:09:29 devstack sudo[88776]: pam_unix(sudo:session): session closed for user root
Nov 04 12:09:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-365790da-1463-4302-a184-5c2d5d67e615 tempest-VolumesAdminNegativeTest-945691552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e75d06ee-ea1f-400f-983b-c1c3571f7f0a" returned: 0 in 0.814s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:09:29 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-365790da-1463-4302-a184-5c2d5d67e615 tempest-VolumesAdminNegativeTest-945691552 None] Lock "cinder-quobyte-e75d06ee-ea1f-400f-983b-c1c3571f7f0a" released by "delete_volume" :: held 4.412s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:09:29 devstack cinder-volume[87169]: WARNING cinder.quota [None req-365790da-1463-4302-a184-5c2d5d67e615 tempest-VolumesAdminNegativeTest-945691552 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 04 12:09:29 devstack cinder-volume[87169]: WARNING cinder.quota [None req-365790da-1463-4302-a184-5c2d5d67e615 tempest-VolumesAdminNegativeTest-945691552 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 04 12:09:29 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-365790da-1463-4302-a184-5c2d5d67e615 tempest-VolumesAdminNegativeTest-945691552 None] Created reservations ['966ca3f3-3378-4014-9f76-1a137a7e1320', '92547fcd-f54c-47ff-9d0f-625e56506ceb', '727d313f-aea6-4df5-a96c-b6a36517d341', 'a5eaf4e3-265c-4a70-9b24-80edec49ad84'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:09:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-365790da-1463-4302-a184-5c2d5d67e615 tempest-VolumesAdminNegativeTest-945691552 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:09:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-365790da-1463-4302-a184-5c2d5d67e615 tempest-VolumesAdminNegativeTest-945691552 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:09:29 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-365790da-1463-4302-a184-5c2d5d67e615 tempest-VolumesAdminNegativeTest-945691552 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:09:29 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-365790da-1463-4302-a184-5c2d5d67e615 tempest-VolumesAdminNegativeTest-945691552 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:09:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-365790da-1463-4302-a184-5c2d5d67e615 tempest-VolumesAdminNegativeTest-945691552 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:09:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-365790da-1463-4302-a184-5c2d5d67e615 tempest-VolumesAdminNegativeTest-945691552 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:09:29 devstack sudo[88812]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:09:29 devstack sudo[88812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:09:30 devstack sudo[88812]: pam_unix(sudo:session): session closed for user root
Nov 04 12:09:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-365790da-1463-4302-a184-5c2d5d67e615 tempest-VolumesAdminNegativeTest-945691552 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.825s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:09:30 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-365790da-1463-4302-a184-5c2d5d67e615 tempest-VolumesAdminNegativeTest-945691552 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:09:30 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-365790da-1463-4302-a184-5c2d5d67e615 tempest-VolumesAdminNegativeTest-945691552 None] Deleted volume successfully.
Nov 04 12:09:30 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-365790da-1463-4302-a184-5c2d5d67e615 tempest-VolumesAdminNegativeTest-945691552 None] Lock "cinder-e75d06ee-ea1f-400f-983b-c1c3571f7f0a-delete_volume" released by "delete_volume" :: held 6.232s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:09:32 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-888adfa2-4e10-4325-998d-a8d4afbfe2cc req-2f25d41c-c713-4722-9d22-f4d74c05aebf tempest-DeleteServersTestJSON-1787686260 None] Terminate volume connection completed successfully.
Nov 04 12:09:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-888adfa2-4e10-4325-998d-a8d4afbfe2cc req-2f25d41c-c713-4722-9d22-f4d74c05aebf tempest-DeleteServersTestJSON-1787686260 None] Deleting attachment 6879a527-0a0b-4bc0-bdb6-cedcdff4fd3f. {{(pid=87169) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 12:09:34 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-764094bc-6c32-45a0-a366-fe84a6bd8c3f tempest-DeleteServersTestJSON-1787686260 None] Acquiring lock "cinder-959c11fe-7191-476e-a89d-c160c1f72ca9-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:09:34 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-764094bc-6c32-45a0-a366-fe84a6bd8c3f tempest-DeleteServersTestJSON-1787686260 None] Lock "cinder-959c11fe-7191-476e-a89d-c160c1f72ca9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:09:34 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-764094bc-6c32-45a0-a366-fe84a6bd8c3f tempest-DeleteServersTestJSON-1787686260 None] Acquiring lock "cinder-quobyte-959c11fe-7191-476e-a89d-c160c1f72ca9" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:09:34 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-764094bc-6c32-45a0-a366-fe84a6bd8c3f tempest-DeleteServersTestJSON-1787686260 None] Lock "cinder-quobyte-959c11fe-7191-476e-a89d-c160c1f72ca9" acquired by "delete_volume" :: waited 0.022s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:09:34 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e52b4b-6a3a-4d25-a993-7b60720af3a8]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:09:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-764094bc-6c32-45a0-a366-fe84a6bd8c3f tempest-DeleteServersTestJSON-1787686260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-959c11fe-7191-476e-a89d-c160c1f72ca9 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:09:34 devstack sudo[88923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-959c11fe-7191-476e-a89d-c160c1f72ca9
Nov 04 12:09:34 devstack sudo[88923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:09:34 devstack sudo[88923]: pam_unix(sudo:session): session closed for user root
Nov 04 12:09:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-764094bc-6c32-45a0-a366-fe84a6bd8c3f tempest-DeleteServersTestJSON-1787686260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-959c11fe-7191-476e-a89d-c160c1f72ca9" returned: 0 in 0.403s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:09:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-764094bc-6c32-45a0-a366-fe84a6bd8c3f tempest-DeleteServersTestJSON-1787686260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-959c11fe-7191-476e-a89d-c160c1f72ca9 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:09:34 devstack sudo[88929]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-959c11fe-7191-476e-a89d-c160c1f72ca9
Nov 04 12:09:34 devstack sudo[88929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:09:35 devstack sudo[88929]: pam_unix(sudo:session): session closed for user root
Nov 04 12:09:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-764094bc-6c32-45a0-a366-fe84a6bd8c3f tempest-DeleteServersTestJSON-1787686260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-959c11fe-7191-476e-a89d-c160c1f72ca9" returned: 0 in 0.326s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:09:35 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-764094bc-6c32-45a0-a366-fe84a6bd8c3f tempest-DeleteServersTestJSON-1787686260 None] Lock "cinder-quobyte-959c11fe-7191-476e-a89d-c160c1f72ca9" released by "delete_volume" :: held 0.783s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:09:35 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-764094bc-6c32-45a0-a366-fe84a6bd8c3f tempest-DeleteServersTestJSON-1787686260 None] Created reservations ['4d90d499-3b83-4399-9666-bda3a8b6d9a2', '2f2837ac-a17e-4bd3-913c-1e87ed8fd495', '741d4b39-df16-4467-9b36-35a4b389dc22', '3cc33552-c354-494e-939d-8003c61045ad'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:09:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-764094bc-6c32-45a0-a366-fe84a6bd8c3f tempest-DeleteServersTestJSON-1787686260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:09:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-764094bc-6c32-45a0-a366-fe84a6bd8c3f tempest-DeleteServersTestJSON-1787686260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:09:35 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-764094bc-6c32-45a0-a366-fe84a6bd8c3f tempest-DeleteServersTestJSON-1787686260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:09:35 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-764094bc-6c32-45a0-a366-fe84a6bd8c3f tempest-DeleteServersTestJSON-1787686260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:09:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-764094bc-6c32-45a0-a366-fe84a6bd8c3f tempest-DeleteServersTestJSON-1787686260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:09:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-764094bc-6c32-45a0-a366-fe84a6bd8c3f tempest-DeleteServersTestJSON-1787686260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:09:35 devstack sudo[88933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:09:35 devstack sudo[88933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:09:35 devstack sudo[88933]: pam_unix(sudo:session): session closed for user root
Nov 04 12:09:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-764094bc-6c32-45a0-a366-fe84a6bd8c3f tempest-DeleteServersTestJSON-1787686260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.318s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:09:35 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-764094bc-6c32-45a0-a366-fe84a6bd8c3f tempest-DeleteServersTestJSON-1787686260 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:09:35 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-764094bc-6c32-45a0-a366-fe84a6bd8c3f tempest-DeleteServersTestJSON-1787686260 None] Deleted volume successfully.
Nov 04 12:09:35 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-764094bc-6c32-45a0-a366-fe84a6bd8c3f tempest-DeleteServersTestJSON-1787686260 None] Lock "cinder-959c11fe-7191-476e-a89d-c160c1f72ca9-delete_volume" released by "delete_volume" :: held 1.347s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:09:45 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=17,cinder:UPDATE=26,cinder:INSERT=6,cinder:DELETE=3 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:09:45 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:UPDATE=21,cinder:SELECT=26,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:09:49 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:09:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:09:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:09:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:09:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:09:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:09:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:09:49 devstack sudo[88946]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:09:49 devstack sudo[88946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:09:50 devstack sudo[88946]: pam_unix(sudo:session): session closed for user root
Nov 04 12:09:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.274s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:09:50 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:09:50 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager._thread_info {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:09:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread count: 8 {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 12:09:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread info: [<_MainThread(MainThread, started 137165867425920)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137165754678912)>, <Thread(Thread-3 (stat_writer), started daemon 137165754130752)>, <Thread(Rabbit-heartbeat, started daemon 137165752997504)>, <Thread(Thread-5 (_runner), started daemon 137165753227712)>, <Thread(Thread-7 (_runner), started daemon 137165751273856)>, <Thread(fd_logger, started daemon 137165755322048)>, <Thread(privsep_reader, started daemon 137165748896704)>] {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 12:09:57 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-3df2f126-6bcd-4a76-9083-7407b4c38f08 tempest-ServerActionsTestOtherA-305064589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:09:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3df2f126-6bcd-4a76-9083-7407b4c38f08 tempest-ServerActionsTestOtherA-305064589 None] Flow 'volume_create_manager' (256e644b-8fa0-4824-a9e3-35e304aec397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:09:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3df2f126-6bcd-4a76-9083-7407b4c38f08 tempest-ServerActionsTestOtherA-305064589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37fc1282-fe32-45b9-975a-be7deb6bedb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:09:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3df2f126-6bcd-4a76-9083-7407b4c38f08 tempest-ServerActionsTestOtherA-305064589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37fc1282-fe32-45b9-975a-be7deb6bedb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1626228537',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52346bcf-6155-4587-b4d5-5ff349f2a384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c85b50ad66324f12b075d197014a3bb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:09:58Z,use_quota=True,user_id='e5083e0eed6a48b49ed0f3e265ab795c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:09:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3df2f126-6bcd-4a76-9083-7407b4c38f08 tempest-ServerActionsTestOtherA-305064589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f052e847-bbb4-4682-8ebe-25e580f96cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:09:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3df2f126-6bcd-4a76-9083-7407b4c38f08 tempest-ServerActionsTestOtherA-305064589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f052e847-bbb4-4682-8ebe-25e580f96cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:09:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3df2f126-6bcd-4a76-9083-7407b4c38f08 tempest-ServerActionsTestOtherA-305064589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0763a01-75da-40ad-a52b-256dbad98e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:09:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3df2f126-6bcd-4a76-9083-7407b4c38f08 tempest-ServerActionsTestOtherA-305064589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0763a01-75da-40ad-a52b-256dbad98e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52346bcf-6155-4587-b4d5-5ff349f2a384', 'volume_name': 'volume-52346bcf-6155-4587-b4d5-5ff349f2a384', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:09:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3df2f126-6bcd-4a76-9083-7407b4c38f08 tempest-ServerActionsTestOtherA-305064589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71edbb09-6851-4bb4-872a-2a83e9fc0242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:09:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3df2f126-6bcd-4a76-9083-7407b4c38f08 tempest-ServerActionsTestOtherA-305064589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71edbb09-6851-4bb4-872a-2a83e9fc0242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:09:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3df2f126-6bcd-4a76-9083-7407b4c38f08 tempest-ServerActionsTestOtherA-305064589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a087885-1793-4c0f-b258-c334f292aea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:09:57 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-3df2f126-6bcd-4a76-9083-7407b4c38f08 tempest-ServerActionsTestOtherA-305064589 None] Volume 52346bcf-6155-4587-b4d5-5ff349f2a384: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52346bcf-6155-4587-b4d5-5ff349f2a384', 'volume_size': 1}
Nov 04 12:09:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3df2f126-6bcd-4a76-9083-7407b4c38f08 tempest-ServerActionsTestOtherA-305064589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:09:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3df2f126-6bcd-4a76-9083-7407b4c38f08 tempest-ServerActionsTestOtherA-305064589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:09:57 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3df2f126-6bcd-4a76-9083-7407b4c38f08 tempest-ServerActionsTestOtherA-305064589 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1626228537',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52346bcf-6155-4587-b4d5-5ff349f2a384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c85b50ad66324f12b075d197014a3bb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:09:58Z,use_quota=True,user_id='e5083e0eed6a48b49ed0f3e265ab795c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:09:57 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-3df2f126-6bcd-4a76-9083-7407b4c38f08 tempest-ServerActionsTestOtherA-305064589 None] Creating volume 52346bcf-6155-4587-b4d5-5ff349f2a384 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:09:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3df2f126-6bcd-4a76-9083-7407b4c38f08 tempest-ServerActionsTestOtherA-305064589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:09:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3df2f126-6bcd-4a76-9083-7407b4c38f08 tempest-ServerActionsTestOtherA-305064589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:09:57 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3df2f126-6bcd-4a76-9083-7407b4c38f08 tempest-ServerActionsTestOtherA-305064589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:09:57 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3df2f126-6bcd-4a76-9083-7407b4c38f08 tempest-ServerActionsTestOtherA-305064589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:09:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3df2f126-6bcd-4a76-9083-7407b4c38f08 tempest-ServerActionsTestOtherA-305064589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:09:57 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3df2f126-6bcd-4a76-9083-7407b4c38f08 tempest-ServerActionsTestOtherA-305064589 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:09:57 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-3df2f126-6bcd-4a76-9083-7407b4c38f08 tempest-ServerActionsTestOtherA-305064589 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:09:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3df2f126-6bcd-4a76-9083-7407b4c38f08 tempest-ServerActionsTestOtherA-305064589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-52346bcf-6155-4587-b4d5-5ff349f2a384 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:09:57 devstack sudo[88966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-52346bcf-6155-4587-b4d5-5ff349f2a384 1073741824
Nov 04 12:09:57 devstack sudo[88966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:09:58 devstack sudo[88966]: pam_unix(sudo:session): session closed for user root
Nov 04 12:09:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3df2f126-6bcd-4a76-9083-7407b4c38f08 tempest-ServerActionsTestOtherA-305064589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-52346bcf-6155-4587-b4d5-5ff349f2a384 1073741824" returned: 0 in 0.523s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:09:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3df2f126-6bcd-4a76-9083-7407b4c38f08 tempest-ServerActionsTestOtherA-305064589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-52346bcf-6155-4587-b4d5-5ff349f2a384 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:09:58 devstack sudo[88971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-52346bcf-6155-4587-b4d5-5ff349f2a384
Nov 04 12:09:58 devstack sudo[88971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:09:58 devstack sudo[88971]: pam_unix(sudo:session): session closed for user root
Nov 04 12:09:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3df2f126-6bcd-4a76-9083-7407b4c38f08 tempest-ServerActionsTestOtherA-305064589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-52346bcf-6155-4587-b4d5-5ff349f2a384" returned: 0 in 0.312s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:09:58 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3df2f126-6bcd-4a76-9083-7407b4c38f08 tempest-ServerActionsTestOtherA-305064589 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:09:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3df2f126-6bcd-4a76-9083-7407b4c38f08 tempest-ServerActionsTestOtherA-305064589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:09:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3df2f126-6bcd-4a76-9083-7407b4c38f08 tempest-ServerActionsTestOtherA-305064589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a087885-1793-4c0f-b258-c334f292aea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52346bcf-6155-4587-b4d5-5ff349f2a384', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:09:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3df2f126-6bcd-4a76-9083-7407b4c38f08 tempest-ServerActionsTestOtherA-305064589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63845df8-5e8a-4ede-82c3-0b62300cb9fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:09:58 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-3df2f126-6bcd-4a76-9083-7407b4c38f08 tempest-ServerActionsTestOtherA-305064589 None] Volume volume-52346bcf-6155-4587-b4d5-5ff349f2a384 (52346bcf-6155-4587-b4d5-5ff349f2a384): created successfully
Nov 04 12:09:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3df2f126-6bcd-4a76-9083-7407b4c38f08 tempest-ServerActionsTestOtherA-305064589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63845df8-5e8a-4ede-82c3-0b62300cb9fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:09:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3df2f126-6bcd-4a76-9083-7407b4c38f08 tempest-ServerActionsTestOtherA-305064589 None] Flow 'volume_create_manager' (256e644b-8fa0-4824-a9e3-35e304aec397) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:09:58 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-3df2f126-6bcd-4a76-9083-7407b4c38f08 tempest-ServerActionsTestOtherA-305064589 None] Created volume successfully.
Nov 04 12:10:08 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:10:08 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=1,cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:10:14 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-76bcac28-d866-44c5-b0fe-6ac38b1db3ef tempest-BackendsCapabilitiesAdminTestsJSON-599754382 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6071128845215, 'free_capacity_gb': 1773.6071128845215, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87169) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 04 12:10:14 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-60f83082-3d85-4808-8240-14dde3fa15aa tempest-BackendsCapabilitiesAdminTestsJSON-599754382 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6071128845215, 'free_capacity_gb': 1773.6071128845215, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87169) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 04 12:10:17 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aa88c1c-6ea4-47b4-b6f4-b2c629a41012 tempest-TaggedAttachmentsTest-1045611021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:10:17 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6aa88c1c-6ea4-47b4-b6f4-b2c629a41012 tempest-TaggedAttachmentsTest-1045611021 None] Flow 'volume_create_manager' (5f80d673-6c81-4ca6-81a9-663d37cb5c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:10:17 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6aa88c1c-6ea4-47b4-b6f4-b2c629a41012 tempest-TaggedAttachmentsTest-1045611021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eed2fe4-afce-4523-ac27-26cea422bffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:10:17 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6aa88c1c-6ea4-47b4-b6f4-b2c629a41012 tempest-TaggedAttachmentsTest-1045611021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eed2fe4-afce-4523-ac27-26cea422bffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-948137436',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24a09c34-80ce-4097-8b66-49440332af12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbd0397113cb4ff191602854230c32f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:10:17Z,use_quota=True,user_id='4ca6b7b0a7e448d395d87f93f345a65c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:10:17 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6aa88c1c-6ea4-47b4-b6f4-b2c629a41012 tempest-TaggedAttachmentsTest-1045611021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fb80a9c-f05a-4e56-9095-5b32853cb64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:10:17 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6aa88c1c-6ea4-47b4-b6f4-b2c629a41012 tempest-TaggedAttachmentsTest-1045611021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1fb80a9c-f05a-4e56-9095-5b32853cb64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:10:17 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6aa88c1c-6ea4-47b4-b6f4-b2c629a41012 tempest-TaggedAttachmentsTest-1045611021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff4cfba3-ff40-4911-a8e5-504b5a49adac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:10:17 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6aa88c1c-6ea4-47b4-b6f4-b2c629a41012 tempest-TaggedAttachmentsTest-1045611021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff4cfba3-ff40-4911-a8e5-504b5a49adac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24a09c34-80ce-4097-8b66-49440332af12', 'volume_name': 'volume-24a09c34-80ce-4097-8b66-49440332af12', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:10:17 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6aa88c1c-6ea4-47b4-b6f4-b2c629a41012 tempest-TaggedAttachmentsTest-1045611021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9932c092-5718-4598-b07b-3ac399c80719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:10:17 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6aa88c1c-6ea4-47b4-b6f4-b2c629a41012 tempest-TaggedAttachmentsTest-1045611021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9932c092-5718-4598-b07b-3ac399c80719) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:10:17 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6aa88c1c-6ea4-47b4-b6f4-b2c629a41012 tempest-TaggedAttachmentsTest-1045611021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (defb60a5-4a69-41e8-ac3b-63fc2da15f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:10:17 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-6aa88c1c-6ea4-47b4-b6f4-b2c629a41012 tempest-TaggedAttachmentsTest-1045611021 None] Volume 24a09c34-80ce-4097-8b66-49440332af12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24a09c34-80ce-4097-8b66-49440332af12', 'volume_size': 1}
Nov 04 12:10:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-6aa88c1c-6ea4-47b4-b6f4-b2c629a41012 tempest-TaggedAttachmentsTest-1045611021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:10:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-6aa88c1c-6ea4-47b4-b6f4-b2c629a41012 tempest-TaggedAttachmentsTest-1045611021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:10:17 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-6aa88c1c-6ea4-47b4-b6f4-b2c629a41012 tempest-TaggedAttachmentsTest-1045611021 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-948137436',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24a09c34-80ce-4097-8b66-49440332af12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbd0397113cb4ff191602854230c32f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:10:17Z,use_quota=True,user_id='4ca6b7b0a7e448d395d87f93f345a65c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:10:17 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-6aa88c1c-6ea4-47b4-b6f4-b2c629a41012 tempest-TaggedAttachmentsTest-1045611021 None] Creating volume 24a09c34-80ce-4097-8b66-49440332af12 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:10:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-6aa88c1c-6ea4-47b4-b6f4-b2c629a41012 tempest-TaggedAttachmentsTest-1045611021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:10:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-6aa88c1c-6ea4-47b4-b6f4-b2c629a41012 tempest-TaggedAttachmentsTest-1045611021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:10:17 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-6aa88c1c-6ea4-47b4-b6f4-b2c629a41012 tempest-TaggedAttachmentsTest-1045611021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:10:17 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-6aa88c1c-6ea4-47b4-b6f4-b2c629a41012 tempest-TaggedAttachmentsTest-1045611021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:10:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-6aa88c1c-6ea4-47b4-b6f4-b2c629a41012 tempest-TaggedAttachmentsTest-1045611021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:10:17 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-6aa88c1c-6ea4-47b4-b6f4-b2c629a41012 tempest-TaggedAttachmentsTest-1045611021 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:10:17 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-6aa88c1c-6ea4-47b4-b6f4-b2c629a41012 tempest-TaggedAttachmentsTest-1045611021 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:10:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6aa88c1c-6ea4-47b4-b6f4-b2c629a41012 tempest-TaggedAttachmentsTest-1045611021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-24a09c34-80ce-4097-8b66-49440332af12 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:10:17 devstack sudo[89149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-24a09c34-80ce-4097-8b66-49440332af12 1073741824
Nov 04 12:10:17 devstack sudo[89149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:10:18 devstack sudo[89149]: pam_unix(sudo:session): session closed for user root
Nov 04 12:10:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6aa88c1c-6ea4-47b4-b6f4-b2c629a41012 tempest-TaggedAttachmentsTest-1045611021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-24a09c34-80ce-4097-8b66-49440332af12 1073741824" returned: 0 in 0.836s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:10:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6aa88c1c-6ea4-47b4-b6f4-b2c629a41012 tempest-TaggedAttachmentsTest-1045611021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-24a09c34-80ce-4097-8b66-49440332af12 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:10:18 devstack sudo[89156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-24a09c34-80ce-4097-8b66-49440332af12
Nov 04 12:10:18 devstack sudo[89156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:10:18 devstack sudo[89156]: pam_unix(sudo:session): session closed for user root
Nov 04 12:10:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6aa88c1c-6ea4-47b4-b6f4-b2c629a41012 tempest-TaggedAttachmentsTest-1045611021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-24a09c34-80ce-4097-8b66-49440332af12" returned: 0 in 0.488s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:10:19 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-6aa88c1c-6ea4-47b4-b6f4-b2c629a41012 tempest-TaggedAttachmentsTest-1045611021 None] <== create_volume: return (1455ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:10:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-6aa88c1c-6ea4-47b4-b6f4-b2c629a41012 tempest-TaggedAttachmentsTest-1045611021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.458s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:10:19 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6aa88c1c-6ea4-47b4-b6f4-b2c629a41012 tempest-TaggedAttachmentsTest-1045611021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (defb60a5-4a69-41e8-ac3b-63fc2da15f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24a09c34-80ce-4097-8b66-49440332af12', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:10:19 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6aa88c1c-6ea4-47b4-b6f4-b2c629a41012 tempest-TaggedAttachmentsTest-1045611021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da2aed17-d921-4234-98f6-35e8e019da59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:10:19 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-6aa88c1c-6ea4-47b4-b6f4-b2c629a41012 tempest-TaggedAttachmentsTest-1045611021 None] Volume volume-24a09c34-80ce-4097-8b66-49440332af12 (24a09c34-80ce-4097-8b66-49440332af12): created successfully
Nov 04 12:10:19 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6aa88c1c-6ea4-47b4-b6f4-b2c629a41012 tempest-TaggedAttachmentsTest-1045611021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da2aed17-d921-4234-98f6-35e8e019da59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:10:19 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6aa88c1c-6ea4-47b4-b6f4-b2c629a41012 tempest-TaggedAttachmentsTest-1045611021 None] Flow 'volume_create_manager' (5f80d673-6c81-4ca6-81a9-663d37cb5c6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:10:19 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-6aa88c1c-6ea4-47b4-b6f4-b2c629a41012 tempest-TaggedAttachmentsTest-1045611021 None] Created volume successfully.
Nov 04 12:10:28 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-613a1de4-9a2a-49e7-8a66-ba845dfa1b9a tempest-GroupsV320Test-2085733792 None] Group tempest-GroupsV320Test-Group-248571976: creating
Nov 04 12:10:28 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-613a1de4-9a2a-49e7-8a66-ba845dfa1b9a tempest-GroupsV320Test-2085733792 None] Group tempest-GroupsV320Test-Group-248571976: created successfully
Nov 04 12:10:28 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-613a1de4-9a2a-49e7-8a66-ba845dfa1b9a tempest-GroupsV320Test-2085733792 None] Create group completed successfully.
Nov 04 12:10:32 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-6ac5b912-9ec8-47ad-9125-a1a7ea418032 tempest-GroupsV320Test-2085733792 None] Created reservations ['a2e59a63-93e4-4125-b8a6-0da80376870b'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:10:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-6ac5b912-9ec8-47ad-9125-a1a7ea418032 tempest-GroupsV320Test-2085733792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:10:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-6ac5b912-9ec8-47ad-9125-a1a7ea418032 tempest-GroupsV320Test-2085733792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:10:32 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-6ac5b912-9ec8-47ad-9125-a1a7ea418032 tempest-GroupsV320Test-2085733792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:10:32 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-6ac5b912-9ec8-47ad-9125-a1a7ea418032 tempest-GroupsV320Test-2085733792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:10:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-6ac5b912-9ec8-47ad-9125-a1a7ea418032 tempest-GroupsV320Test-2085733792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:10:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6ac5b912-9ec8-47ad-9125-a1a7ea418032 tempest-GroupsV320Test-2085733792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:10:32 devstack sudo[89317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:10:32 devstack sudo[89317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:10:32 devstack sudo[89317]: pam_unix(sudo:session): session closed for user root
Nov 04 12:10:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6ac5b912-9ec8-47ad-9125-a1a7ea418032 tempest-GroupsV320Test-2085733792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.493s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:10:32 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-6ac5b912-9ec8-47ad-9125-a1a7ea418032 tempest-GroupsV320Test-2085733792 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:10:32 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-6ac5b912-9ec8-47ad-9125-a1a7ea418032 tempest-GroupsV320Test-2085733792 None] Delete group completed successfully.
Nov 04 12:10:38 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-e22ea55c-66f8-43c7-88b2-8bd5c74ba2a3 tempest-ServersNegativeTestJSON-1124031446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:10:38 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e22ea55c-66f8-43c7-88b2-8bd5c74ba2a3 tempest-ServersNegativeTestJSON-1124031446 None] Flow 'volume_create_manager' (ba0d98ea-465b-46de-96c8-a2e23799ac54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:10:38 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e22ea55c-66f8-43c7-88b2-8bd5c74ba2a3 tempest-ServersNegativeTestJSON-1124031446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55782b90-56de-42ae-91b6-0ca6eae59bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:10:38 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e22ea55c-66f8-43c7-88b2-8bd5c74ba2a3 tempest-ServersNegativeTestJSON-1124031446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55782b90-56de-42ae-91b6-0ca6eae59bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-167442268',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f039147a-ecc0-4520-a32a-a753d34959f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='198e6f8b5c7044a38c864d9b3599074c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:10:39Z,use_quota=True,user_id='4a0857789a2f472890871ae3b457dd53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:10:38 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e22ea55c-66f8-43c7-88b2-8bd5c74ba2a3 tempest-ServersNegativeTestJSON-1124031446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c4c943-3012-4bd3-a047-e738ea638ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:10:38 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e22ea55c-66f8-43c7-88b2-8bd5c74ba2a3 tempest-ServersNegativeTestJSON-1124031446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83c4c943-3012-4bd3-a047-e738ea638ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:10:38 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e22ea55c-66f8-43c7-88b2-8bd5c74ba2a3 tempest-ServersNegativeTestJSON-1124031446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (996317c8-09b7-4ae2-bfa3-afd93861fd34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:10:38 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e22ea55c-66f8-43c7-88b2-8bd5c74ba2a3 tempest-ServersNegativeTestJSON-1124031446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (996317c8-09b7-4ae2-bfa3-afd93861fd34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f039147a-ecc0-4520-a32a-a753d34959f1', 'volume_name': 'volume-f039147a-ecc0-4520-a32a-a753d34959f1', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:10:38 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e22ea55c-66f8-43c7-88b2-8bd5c74ba2a3 tempest-ServersNegativeTestJSON-1124031446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ad7ec8b-0ecd-4303-91d9-6c2262089b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:10:38 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e22ea55c-66f8-43c7-88b2-8bd5c74ba2a3 tempest-ServersNegativeTestJSON-1124031446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ad7ec8b-0ecd-4303-91d9-6c2262089b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:10:38 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e22ea55c-66f8-43c7-88b2-8bd5c74ba2a3 tempest-ServersNegativeTestJSON-1124031446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcfcda3e-d40c-420b-b306-13663b388c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:10:38 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-e22ea55c-66f8-43c7-88b2-8bd5c74ba2a3 tempest-ServersNegativeTestJSON-1124031446 None] Volume f039147a-ecc0-4520-a32a-a753d34959f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f039147a-ecc0-4520-a32a-a753d34959f1', 'volume_size': 1}
Nov 04 12:10:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e22ea55c-66f8-43c7-88b2-8bd5c74ba2a3 tempest-ServersNegativeTestJSON-1124031446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:10:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e22ea55c-66f8-43c7-88b2-8bd5c74ba2a3 tempest-ServersNegativeTestJSON-1124031446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:10:38 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e22ea55c-66f8-43c7-88b2-8bd5c74ba2a3 tempest-ServersNegativeTestJSON-1124031446 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:10:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-167442268',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f039147a-ecc0-4520-a32a-a753d34959f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='198e6f8b5c7044a38c864d9b3599074c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:10:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:10:39Z,use_quota=True,user_id='4a0857789a2f472890871ae3b457dd53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:10:38 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-e22ea55c-66f8-43c7-88b2-8bd5c74ba2a3 tempest-ServersNegativeTestJSON-1124031446 None] Creating volume f039147a-ecc0-4520-a32a-a753d34959f1 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:10:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e22ea55c-66f8-43c7-88b2-8bd5c74ba2a3 tempest-ServersNegativeTestJSON-1124031446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:10:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e22ea55c-66f8-43c7-88b2-8bd5c74ba2a3 tempest-ServersNegativeTestJSON-1124031446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:10:38 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e22ea55c-66f8-43c7-88b2-8bd5c74ba2a3 tempest-ServersNegativeTestJSON-1124031446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:10:38 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e22ea55c-66f8-43c7-88b2-8bd5c74ba2a3 tempest-ServersNegativeTestJSON-1124031446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:10:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e22ea55c-66f8-43c7-88b2-8bd5c74ba2a3 tempest-ServersNegativeTestJSON-1124031446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:10:38 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e22ea55c-66f8-43c7-88b2-8bd5c74ba2a3 tempest-ServersNegativeTestJSON-1124031446 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:10:38 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-e22ea55c-66f8-43c7-88b2-8bd5c74ba2a3 tempest-ServersNegativeTestJSON-1124031446 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:10:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e22ea55c-66f8-43c7-88b2-8bd5c74ba2a3 tempest-ServersNegativeTestJSON-1124031446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f039147a-ecc0-4520-a32a-a753d34959f1 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:10:39 devstack sudo[89475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f039147a-ecc0-4520-a32a-a753d34959f1 1073741824
Nov 04 12:10:39 devstack sudo[89475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:10:39 devstack sudo[89475]: pam_unix(sudo:session): session closed for user root
Nov 04 12:10:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e22ea55c-66f8-43c7-88b2-8bd5c74ba2a3 tempest-ServersNegativeTestJSON-1124031446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f039147a-ecc0-4520-a32a-a753d34959f1 1073741824" returned: 0 in 0.880s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:10:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e22ea55c-66f8-43c7-88b2-8bd5c74ba2a3 tempest-ServersNegativeTestJSON-1124031446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f039147a-ecc0-4520-a32a-a753d34959f1 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:10:39 devstack sudo[89480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f039147a-ecc0-4520-a32a-a753d34959f1
Nov 04 12:10:39 devstack sudo[89480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:10:40 devstack sudo[89480]: pam_unix(sudo:session): session closed for user root
Nov 04 12:10:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e22ea55c-66f8-43c7-88b2-8bd5c74ba2a3 tempest-ServersNegativeTestJSON-1124031446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f039147a-ecc0-4520-a32a-a753d34959f1" returned: 0 in 0.342s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:10:40 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e22ea55c-66f8-43c7-88b2-8bd5c74ba2a3 tempest-ServersNegativeTestJSON-1124031446 None] <== create_volume: return (1314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:10:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e22ea55c-66f8-43c7-88b2-8bd5c74ba2a3 tempest-ServersNegativeTestJSON-1124031446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.322s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:10:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e22ea55c-66f8-43c7-88b2-8bd5c74ba2a3 tempest-ServersNegativeTestJSON-1124031446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcfcda3e-d40c-420b-b306-13663b388c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f039147a-ecc0-4520-a32a-a753d34959f1', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:10:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e22ea55c-66f8-43c7-88b2-8bd5c74ba2a3 tempest-ServersNegativeTestJSON-1124031446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18c810d5-dbc8-4fd8-9962-8495d9ee229b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:10:40 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-e22ea55c-66f8-43c7-88b2-8bd5c74ba2a3 tempest-ServersNegativeTestJSON-1124031446 None] Volume volume-f039147a-ecc0-4520-a32a-a753d34959f1 (f039147a-ecc0-4520-a32a-a753d34959f1): created successfully
Nov 04 12:10:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e22ea55c-66f8-43c7-88b2-8bd5c74ba2a3 tempest-ServersNegativeTestJSON-1124031446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18c810d5-dbc8-4fd8-9962-8495d9ee229b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:10:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e22ea55c-66f8-43c7-88b2-8bd5c74ba2a3 tempest-ServersNegativeTestJSON-1124031446 None] Flow 'volume_create_manager' (ba0d98ea-465b-46de-96c8-a2e23799ac54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:10:40 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-e22ea55c-66f8-43c7-88b2-8bd5c74ba2a3 tempest-ServersNegativeTestJSON-1124031446 None] Created volume successfully.
Nov 04 12:10:43 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-21250d49-b89d-462d-87ce-8f0a2969d046 tempest-SnapshotsActionsTest-1932493596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:10:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-21250d49-b89d-462d-87ce-8f0a2969d046 tempest-SnapshotsActionsTest-1932493596 None] Flow 'volume_create_manager' (6dc0f289-3a41-4a6c-8fd8-8677c850f441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:10:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-21250d49-b89d-462d-87ce-8f0a2969d046 tempest-SnapshotsActionsTest-1932493596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bea9116f-1605-4e93-8f62-3d12fc10608e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:10:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-21250d49-b89d-462d-87ce-8f0a2969d046 tempest-SnapshotsActionsTest-1932493596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bea9116f-1605-4e93-8f62-3d12fc10608e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:10:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-582709435',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=553dbd22-1dba-473d-aef7-c5510ab60c55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='575e20605f494df7b2f2e48015cc4c6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:10:43Z,use_quota=True,user_id='34a2fbe0f0f7484f96d34cdc6e005ae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:10:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-21250d49-b89d-462d-87ce-8f0a2969d046 tempest-SnapshotsActionsTest-1932493596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b133012-24bf-430c-913f-d4cc11d25cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:10:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-21250d49-b89d-462d-87ce-8f0a2969d046 tempest-SnapshotsActionsTest-1932493596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b133012-24bf-430c-913f-d4cc11d25cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:10:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-21250d49-b89d-462d-87ce-8f0a2969d046 tempest-SnapshotsActionsTest-1932493596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc637a56-24af-4b3e-80ce-433836ecb5f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:10:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-21250d49-b89d-462d-87ce-8f0a2969d046 tempest-SnapshotsActionsTest-1932493596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc637a56-24af-4b3e-80ce-433836ecb5f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '553dbd22-1dba-473d-aef7-c5510ab60c55', 'volume_name': 'volume-553dbd22-1dba-473d-aef7-c5510ab60c55', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:10:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-21250d49-b89d-462d-87ce-8f0a2969d046 tempest-SnapshotsActionsTest-1932493596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff6ceb55-e039-4d1d-8547-1a8d6414e71f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:10:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-21250d49-b89d-462d-87ce-8f0a2969d046 tempest-SnapshotsActionsTest-1932493596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff6ceb55-e039-4d1d-8547-1a8d6414e71f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:10:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-21250d49-b89d-462d-87ce-8f0a2969d046 tempest-SnapshotsActionsTest-1932493596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89ef1c35-6830-475d-9cad-71341859d9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:10:43 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-21250d49-b89d-462d-87ce-8f0a2969d046 tempest-SnapshotsActionsTest-1932493596 None] Volume 553dbd22-1dba-473d-aef7-c5510ab60c55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-553dbd22-1dba-473d-aef7-c5510ab60c55', 'volume_size': 1}
Nov 04 12:10:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-21250d49-b89d-462d-87ce-8f0a2969d046 tempest-SnapshotsActionsTest-1932493596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:10:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-21250d49-b89d-462d-87ce-8f0a2969d046 tempest-SnapshotsActionsTest-1932493596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:10:43 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-21250d49-b89d-462d-87ce-8f0a2969d046 tempest-SnapshotsActionsTest-1932493596 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:10:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-582709435',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=553dbd22-1dba-473d-aef7-c5510ab60c55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='575e20605f494df7b2f2e48015cc4c6e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:10:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:10:43Z,use_quota=True,user_id='34a2fbe0f0f7484f96d34cdc6e005ae8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:10:43 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-21250d49-b89d-462d-87ce-8f0a2969d046 tempest-SnapshotsActionsTest-1932493596 None] Creating volume 553dbd22-1dba-473d-aef7-c5510ab60c55 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:10:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-21250d49-b89d-462d-87ce-8f0a2969d046 tempest-SnapshotsActionsTest-1932493596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:10:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-21250d49-b89d-462d-87ce-8f0a2969d046 tempest-SnapshotsActionsTest-1932493596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:10:43 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-21250d49-b89d-462d-87ce-8f0a2969d046 tempest-SnapshotsActionsTest-1932493596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:10:43 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-21250d49-b89d-462d-87ce-8f0a2969d046 tempest-SnapshotsActionsTest-1932493596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:10:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-21250d49-b89d-462d-87ce-8f0a2969d046 tempest-SnapshotsActionsTest-1932493596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:10:43 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-21250d49-b89d-462d-87ce-8f0a2969d046 tempest-SnapshotsActionsTest-1932493596 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:10:43 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-21250d49-b89d-462d-87ce-8f0a2969d046 tempest-SnapshotsActionsTest-1932493596 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:10:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-21250d49-b89d-462d-87ce-8f0a2969d046 tempest-SnapshotsActionsTest-1932493596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:10:43 devstack sudo[89488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55 1073741824
Nov 04 12:10:43 devstack sudo[89488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:10:44 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f9b161e-22f5-4e5a-ae81-43f0693f466f tempest-ServersNegativeTestJSON-1124031446 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:10:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8f9b161e-22f5-4e5a-ae81-43f0693f466f tempest-ServersNegativeTestJSON-1124031446 None] Flow 'volume_create_manager' (a33208b6-d938-48e0-a71b-a12e5811331a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:10:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8f9b161e-22f5-4e5a-ae81-43f0693f466f tempest-ServersNegativeTestJSON-1124031446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bda4c899-04ec-454b-b2d8-12d910e2f26e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:10:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8f9b161e-22f5-4e5a-ae81-43f0693f466f tempest-ServersNegativeTestJSON-1124031446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bda4c899-04ec-454b-b2d8-12d910e2f26e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1310550641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c09f021-5d0b-4eb4-9a3c-e77a60dcfc44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='198e6f8b5c7044a38c864d9b3599074c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:10:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:10:44Z,use_quota=True,user_id='4a0857789a2f472890871ae3b457dd53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:10:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8f9b161e-22f5-4e5a-ae81-43f0693f466f tempest-ServersNegativeTestJSON-1124031446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d744e394-dc93-4fdd-b029-b68b8244d66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:10:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8f9b161e-22f5-4e5a-ae81-43f0693f466f tempest-ServersNegativeTestJSON-1124031446 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d744e394-dc93-4fdd-b029-b68b8244d66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:10:44 devstack sudo[89488]: pam_unix(sudo:session): session closed for user root
Nov 04 12:10:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8f9b161e-22f5-4e5a-ae81-43f0693f466f tempest-ServersNegativeTestJSON-1124031446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f71370-2e6b-46e0-87f9-fdbf1e7120c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:10:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8f9b161e-22f5-4e5a-ae81-43f0693f466f tempest-ServersNegativeTestJSON-1124031446 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71f71370-2e6b-46e0-87f9-fdbf1e7120c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c09f021-5d0b-4eb4-9a3c-e77a60dcfc44', 'volume_name': 'volume-0c09f021-5d0b-4eb4-9a3c-e77a60dcfc44', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:10:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8f9b161e-22f5-4e5a-ae81-43f0693f466f tempest-ServersNegativeTestJSON-1124031446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ffe171-57a7-4322-90a0-d92eb83b77c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:10:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8f9b161e-22f5-4e5a-ae81-43f0693f466f tempest-ServersNegativeTestJSON-1124031446 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ffe171-57a7-4322-90a0-d92eb83b77c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:10:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8f9b161e-22f5-4e5a-ae81-43f0693f466f tempest-ServersNegativeTestJSON-1124031446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce726a29-260d-4252-9979-0ae0b2d2b688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:10:44 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-8f9b161e-22f5-4e5a-ae81-43f0693f466f tempest-ServersNegativeTestJSON-1124031446 None] Volume 0c09f021-5d0b-4eb4-9a3c-e77a60dcfc44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c09f021-5d0b-4eb4-9a3c-e77a60dcfc44', 'volume_size': 1}
Nov 04 12:10:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8f9b161e-22f5-4e5a-ae81-43f0693f466f tempest-ServersNegativeTestJSON-1124031446 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:10:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-21250d49-b89d-462d-87ce-8f0a2969d046 tempest-SnapshotsActionsTest-1932493596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55 1073741824" returned: 0 in 0.859s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:10:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-21250d49-b89d-462d-87ce-8f0a2969d046 tempest-SnapshotsActionsTest-1932493596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:10:44 devstack sudo[89494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55
Nov 04 12:10:44 devstack sudo[89494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:10:44 devstack sudo[89494]: pam_unix(sudo:session): session closed for user root
Nov 04 12:10:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-21250d49-b89d-462d-87ce-8f0a2969d046 tempest-SnapshotsActionsTest-1932493596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55" returned: 0 in 0.256s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:10:44 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-21250d49-b89d-462d-87ce-8f0a2969d046 tempest-SnapshotsActionsTest-1932493596 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:10:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-21250d49-b89d-462d-87ce-8f0a2969d046 tempest-SnapshotsActionsTest-1932493596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.159s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:10:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8f9b161e-22f5-4e5a-ae81-43f0693f466f tempest-ServersNegativeTestJSON-1124031446 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.293s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:10:44 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-8f9b161e-22f5-4e5a-ae81-43f0693f466f tempest-ServersNegativeTestJSON-1124031446 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:10:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1310550641',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c09f021-5d0b-4eb4-9a3c-e77a60dcfc44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='198e6f8b5c7044a38c864d9b3599074c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:10:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:10:44Z,use_quota=True,user_id='4a0857789a2f472890871ae3b457dd53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:10:44 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-8f9b161e-22f5-4e5a-ae81-43f0693f466f tempest-ServersNegativeTestJSON-1124031446 None] Creating volume 0c09f021-5d0b-4eb4-9a3c-e77a60dcfc44 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:10:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8f9b161e-22f5-4e5a-ae81-43f0693f466f tempest-ServersNegativeTestJSON-1124031446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:10:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8f9b161e-22f5-4e5a-ae81-43f0693f466f tempest-ServersNegativeTestJSON-1124031446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:10:44 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-8f9b161e-22f5-4e5a-ae81-43f0693f466f tempest-ServersNegativeTestJSON-1124031446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:10:44 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-8f9b161e-22f5-4e5a-ae81-43f0693f466f tempest-ServersNegativeTestJSON-1124031446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:10:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8f9b161e-22f5-4e5a-ae81-43f0693f466f tempest-ServersNegativeTestJSON-1124031446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:10:44 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-8f9b161e-22f5-4e5a-ae81-43f0693f466f tempest-ServersNegativeTestJSON-1124031446 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:10:44 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-8f9b161e-22f5-4e5a-ae81-43f0693f466f tempest-ServersNegativeTestJSON-1124031446 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:10:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8f9b161e-22f5-4e5a-ae81-43f0693f466f tempest-ServersNegativeTestJSON-1124031446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0c09f021-5d0b-4eb4-9a3c-e77a60dcfc44 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:10:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-21250d49-b89d-462d-87ce-8f0a2969d046 tempest-SnapshotsActionsTest-1932493596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89ef1c35-6830-475d-9cad-71341859d9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-553dbd22-1dba-473d-aef7-c5510ab60c55', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:10:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-21250d49-b89d-462d-87ce-8f0a2969d046 tempest-SnapshotsActionsTest-1932493596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55388f01-a7f0-4398-9e99-6de9605d45d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:10:44 devstack sudo[89497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0c09f021-5d0b-4eb4-9a3c-e77a60dcfc44 1073741824
Nov 04 12:10:44 devstack sudo[89497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:10:44 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-21250d49-b89d-462d-87ce-8f0a2969d046 tempest-SnapshotsActionsTest-1932493596 None] Volume volume-553dbd22-1dba-473d-aef7-c5510ab60c55 (553dbd22-1dba-473d-aef7-c5510ab60c55): created successfully
Nov 04 12:10:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-21250d49-b89d-462d-87ce-8f0a2969d046 tempest-SnapshotsActionsTest-1932493596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55388f01-a7f0-4398-9e99-6de9605d45d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:10:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-21250d49-b89d-462d-87ce-8f0a2969d046 tempest-SnapshotsActionsTest-1932493596 None] Flow 'volume_create_manager' (6dc0f289-3a41-4a6c-8fd8-8677c850f441) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:10:44 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-21250d49-b89d-462d-87ce-8f0a2969d046 tempest-SnapshotsActionsTest-1932493596 None] Created volume successfully.
Nov 04 12:10:44 devstack sudo[89497]: pam_unix(sudo:session): session closed for user root
Nov 04 12:10:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8f9b161e-22f5-4e5a-ae81-43f0693f466f tempest-ServersNegativeTestJSON-1124031446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0c09f021-5d0b-4eb4-9a3c-e77a60dcfc44 1073741824" returned: 0 in 0.478s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:10:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8f9b161e-22f5-4e5a-ae81-43f0693f466f tempest-ServersNegativeTestJSON-1124031446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0c09f021-5d0b-4eb4-9a3c-e77a60dcfc44 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:10:44 devstack sudo[89503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0c09f021-5d0b-4eb4-9a3c-e77a60dcfc44
Nov 04 12:10:44 devstack sudo[89503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:10:45 devstack sudo[89503]: pam_unix(sudo:session): session closed for user root
Nov 04 12:10:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8f9b161e-22f5-4e5a-ae81-43f0693f466f tempest-ServersNegativeTestJSON-1124031446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0c09f021-5d0b-4eb4-9a3c-e77a60dcfc44" returned: 0 in 0.264s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:10:45 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-8f9b161e-22f5-4e5a-ae81-43f0693f466f tempest-ServersNegativeTestJSON-1124031446 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:10:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8f9b161e-22f5-4e5a-ae81-43f0693f466f tempest-ServersNegativeTestJSON-1124031446 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:10:45 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8f9b161e-22f5-4e5a-ae81-43f0693f466f tempest-ServersNegativeTestJSON-1124031446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce726a29-260d-4252-9979-0ae0b2d2b688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c09f021-5d0b-4eb4-9a3c-e77a60dcfc44', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:10:45 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8f9b161e-22f5-4e5a-ae81-43f0693f466f tempest-ServersNegativeTestJSON-1124031446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03b9aee8-a7c2-4e88-aea1-133f5cc62109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:10:45 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-8f9b161e-22f5-4e5a-ae81-43f0693f466f tempest-ServersNegativeTestJSON-1124031446 None] Volume volume-0c09f021-5d0b-4eb4-9a3c-e77a60dcfc44 (0c09f021-5d0b-4eb4-9a3c-e77a60dcfc44): created successfully
Nov 04 12:10:45 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8f9b161e-22f5-4e5a-ae81-43f0693f466f tempest-ServersNegativeTestJSON-1124031446 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03b9aee8-a7c2-4e88-aea1-133f5cc62109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:10:45 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8f9b161e-22f5-4e5a-ae81-43f0693f466f tempest-ServersNegativeTestJSON-1124031446 None] Flow 'volume_create_manager' (a33208b6-d938-48e0-a71b-a12e5811331a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:10:45 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-8f9b161e-22f5-4e5a-ae81-43f0693f466f tempest-ServersNegativeTestJSON-1124031446 None] Created volume successfully.
Nov 04 12:10:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-4e826dc7-5bd2-409b-b9eb-cbdd2fdd74f1 tempest-SnapshotsActionsTest-1932493596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:10:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-4e826dc7-5bd2-409b-b9eb-cbdd2fdd74f1 tempest-SnapshotsActionsTest-1932493596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:10:45 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-4e826dc7-5bd2-409b-b9eb-cbdd2fdd74f1 tempest-SnapshotsActionsTest-1932493596 None] Creating offline snapshot 837ef147-e20a-46b2-885c-e51518a48b99 of volume 553dbd22-1dba-473d-aef7-c5510ab60c55 {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:10:45 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[194cdbe8-4459-495f-8fa7-5914202b1ef5]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:10:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4e826dc7-5bd2-409b-b9eb-cbdd2fdd74f1 tempest-SnapshotsActionsTest-1932493596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:10:45 devstack sudo[89506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55
Nov 04 12:10:45 devstack sudo[89506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:10:45 devstack sudo[89506]: pam_unix(sudo:session): session closed for user root
Nov 04 12:10:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4e826dc7-5bd2-409b-b9eb-cbdd2fdd74f1 tempest-SnapshotsActionsTest-1932493596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55" returned: 0 in 0.346s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:10:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4e826dc7-5bd2-409b-b9eb-cbdd2fdd74f1 tempest-SnapshotsActionsTest-1932493596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:10:45 devstack sudo[89511]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99 1G
Nov 04 12:10:45 devstack sudo[89511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:10:46 devstack sudo[89511]: pam_unix(sudo:session): session closed for user root
Nov 04 12:10:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4e826dc7-5bd2-409b-b9eb-cbdd2fdd74f1 tempest-SnapshotsActionsTest-1932493596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99 1G" returned: 0 in 0.449s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:10:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4e826dc7-5bd2-409b-b9eb-cbdd2fdd74f1 tempest-SnapshotsActionsTest-1932493596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-553dbd22-1dba-473d-aef7-c5510ab60c55 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:10:46 devstack sudo[89516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-553dbd22-1dba-473d-aef7-c5510ab60c55 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99
Nov 04 12:10:46 devstack sudo[89516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:10:46 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fd389aa5-bd24-46a8-a45b-95045feb189a tempest-ServersNegativeTestJSON-1124031446 None] Acquiring lock "cinder-0c09f021-5d0b-4eb4-9a3c-e77a60dcfc44-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:10:46 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fd389aa5-bd24-46a8-a45b-95045feb189a tempest-ServersNegativeTestJSON-1124031446 None] Lock "cinder-0c09f021-5d0b-4eb4-9a3c-e77a60dcfc44-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:10:46 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fd389aa5-bd24-46a8-a45b-95045feb189a tempest-ServersNegativeTestJSON-1124031446 None] Acquiring lock "cinder-quobyte-0c09f021-5d0b-4eb4-9a3c-e77a60dcfc44" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:10:46 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fd389aa5-bd24-46a8-a45b-95045feb189a tempest-ServersNegativeTestJSON-1124031446 None] Lock "cinder-quobyte-0c09f021-5d0b-4eb4-9a3c-e77a60dcfc44" acquired by "delete_volume" :: waited 0.023s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:10:46 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1e0f3a-d44c-4284-b09c-3daef9f5920c]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:10:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fd389aa5-bd24-46a8-a45b-95045feb189a tempest-ServersNegativeTestJSON-1124031446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0c09f021-5d0b-4eb4-9a3c-e77a60dcfc44 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:10:46 devstack sudo[89516]: pam_unix(sudo:session): session closed for user root
Nov 04 12:10:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4e826dc7-5bd2-409b-b9eb-cbdd2fdd74f1 tempest-SnapshotsActionsTest-1932493596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-553dbd22-1dba-473d-aef7-c5510ab60c55 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99" returned: 0 in 0.349s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:10:46 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-4e826dc7-5bd2-409b-b9eb-cbdd2fdd74f1 tempest-SnapshotsActionsTest-1932493596 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99 is being set with open permissions: ugo+rw
Nov 04 12:10:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4e826dc7-5bd2-409b-b9eb-cbdd2fdd74f1 tempest-SnapshotsActionsTest-1932493596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:10:46 devstack sudo[89523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99
Nov 04 12:10:46 devstack sudo[89523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:10:46 devstack sudo[89522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0c09f021-5d0b-4eb4-9a3c-e77a60dcfc44
Nov 04 12:10:46 devstack sudo[89522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:10:46 devstack sudo[89523]: pam_unix(sudo:session): session closed for user root
Nov 04 12:10:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4e826dc7-5bd2-409b-b9eb-cbdd2fdd74f1 tempest-SnapshotsActionsTest-1932493596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99" returned: 0 in 0.238s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:10:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4e826dc7-5bd2-409b-b9eb-cbdd2fdd74f1 tempest-SnapshotsActionsTest-1932493596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:10:46 devstack sudo[89529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.info
Nov 04 12:10:46 devstack sudo[89529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:10:47 devstack sudo[89522]: pam_unix(sudo:session): session closed for user root
Nov 04 12:10:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fd389aa5-bd24-46a8-a45b-95045feb189a tempest-ServersNegativeTestJSON-1124031446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0c09f021-5d0b-4eb4-9a3c-e77a60dcfc44" returned: 0 in 0.410s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:10:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fd389aa5-bd24-46a8-a45b-95045feb189a tempest-ServersNegativeTestJSON-1124031446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0c09f021-5d0b-4eb4-9a3c-e77a60dcfc44 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:10:47 devstack sudo[89532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0c09f021-5d0b-4eb4-9a3c-e77a60dcfc44
Nov 04 12:10:47 devstack sudo[89532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:10:47 devstack sudo[89529]: pam_unix(sudo:session): session closed for user root
Nov 04 12:10:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4e826dc7-5bd2-409b-b9eb-cbdd2fdd74f1 tempest-SnapshotsActionsTest-1932493596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.info" returned: 0 in 0.275s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:10:47 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-4e826dc7-5bd2-409b-b9eb-cbdd2fdd74f1 tempest-SnapshotsActionsTest-1932493596 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.info is being set with open permissions: ugo+rw
Nov 04 12:10:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4e826dc7-5bd2-409b-b9eb-cbdd2fdd74f1 tempest-SnapshotsActionsTest-1932493596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:10:47 devstack sudo[89535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.info
Nov 04 12:10:47 devstack sudo[89535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:10:47 devstack sudo[89532]: pam_unix(sudo:session): session closed for user root
Nov 04 12:10:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fd389aa5-bd24-46a8-a45b-95045feb189a tempest-ServersNegativeTestJSON-1124031446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0c09f021-5d0b-4eb4-9a3c-e77a60dcfc44" returned: 0 in 0.260s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:10:47 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fd389aa5-bd24-46a8-a45b-95045feb189a tempest-ServersNegativeTestJSON-1124031446 None] Lock "cinder-quobyte-0c09f021-5d0b-4eb4-9a3c-e77a60dcfc44" released by "delete_volume" :: held 0.714s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:10:47 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-fd389aa5-bd24-46a8-a45b-95045feb189a tempest-ServersNegativeTestJSON-1124031446 None] Created reservations ['f745e725-3c69-498e-857c-a356c6106b91', '75b7d014-bc8a-428b-90e9-e7ce98bb1fb3', '2187c054-6855-4639-8f58-ea23f33aad1c', '16e59612-9bb8-4d5e-bdf5-0341a745db44'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:10:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-fd389aa5-bd24-46a8-a45b-95045feb189a tempest-ServersNegativeTestJSON-1124031446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:10:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-fd389aa5-bd24-46a8-a45b-95045feb189a tempest-ServersNegativeTestJSON-1124031446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:10:47 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-fd389aa5-bd24-46a8-a45b-95045feb189a tempest-ServersNegativeTestJSON-1124031446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:10:47 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-fd389aa5-bd24-46a8-a45b-95045feb189a tempest-ServersNegativeTestJSON-1124031446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:10:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-fd389aa5-bd24-46a8-a45b-95045feb189a tempest-ServersNegativeTestJSON-1124031446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:10:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fd389aa5-bd24-46a8-a45b-95045feb189a tempest-ServersNegativeTestJSON-1124031446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:10:47 devstack sudo[89538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:10:47 devstack sudo[89538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:10:47 devstack sudo[89535]: pam_unix(sudo:session): session closed for user root
Nov 04 12:10:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4e826dc7-5bd2-409b-b9eb-cbdd2fdd74f1 tempest-SnapshotsActionsTest-1932493596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.info" returned: 0 in 0.276s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:10:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-4e826dc7-5bd2-409b-b9eb-cbdd2fdd74f1 tempest-SnapshotsActionsTest-1932493596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.036s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:10:47 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-4e826dc7-5bd2-409b-b9eb-cbdd2fdd74f1 tempest-SnapshotsActionsTest-1932493596 None] Create snapshot completed successfully
Nov 04 12:10:47 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3c174575-94d2-49f5-a7f9-f660371cd29c tempest-ServersNegativeTestJSON-1124031446 None] Acquiring lock "cinder-f039147a-ecc0-4520-a32a-a753d34959f1-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:10:47 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3c174575-94d2-49f5-a7f9-f660371cd29c tempest-ServersNegativeTestJSON-1124031446 None] Lock "cinder-f039147a-ecc0-4520-a32a-a753d34959f1-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:10:47 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3c174575-94d2-49f5-a7f9-f660371cd29c tempest-ServersNegativeTestJSON-1124031446 None] Acquiring lock "cinder-quobyte-f039147a-ecc0-4520-a32a-a753d34959f1" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:10:47 devstack sudo[89538]: pam_unix(sudo:session): session closed for user root
Nov 04 12:10:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fd389aa5-bd24-46a8-a45b-95045feb189a tempest-ServersNegativeTestJSON-1124031446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.417s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:10:47 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-fd389aa5-bd24-46a8-a45b-95045feb189a tempest-ServersNegativeTestJSON-1124031446 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:10:47 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-fd389aa5-bd24-46a8-a45b-95045feb189a tempest-ServersNegativeTestJSON-1124031446 None] Deleted volume successfully.
Nov 04 12:10:47 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3c174575-94d2-49f5-a7f9-f660371cd29c tempest-ServersNegativeTestJSON-1124031446 None] Lock "cinder-quobyte-f039147a-ecc0-4520-a32a-a753d34959f1" acquired by "delete_volume" :: waited 0.039s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:10:47 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee8574f-251f-43d2-a795-46f872a7c8aa]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:10:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3c174575-94d2-49f5-a7f9-f660371cd29c tempest-ServersNegativeTestJSON-1124031446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f039147a-ecc0-4520-a32a-a753d34959f1 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:10:47 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fd389aa5-bd24-46a8-a45b-95045feb189a tempest-ServersNegativeTestJSON-1124031446 None] Lock "cinder-0c09f021-5d0b-4eb4-9a3c-e77a60dcfc44-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:10:48 devstack sudo[89544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f039147a-ecc0-4520-a32a-a753d34959f1
Nov 04 12:10:48 devstack sudo[89544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:10:48 devstack sudo[89544]: pam_unix(sudo:session): session closed for user root
Nov 04 12:10:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3c174575-94d2-49f5-a7f9-f660371cd29c tempest-ServersNegativeTestJSON-1124031446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f039147a-ecc0-4520-a32a-a753d34959f1" returned: 0 in 0.520s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:10:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3c174575-94d2-49f5-a7f9-f660371cd29c tempest-ServersNegativeTestJSON-1124031446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f039147a-ecc0-4520-a32a-a753d34959f1 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:10:48 devstack sudo[89549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f039147a-ecc0-4520-a32a-a753d34959f1
Nov 04 12:10:48 devstack sudo[89549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:10:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f4164f5b-dddf-45ee-8741-816d4fb70b01 tempest-SnapshotsActionsTest-1932493596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:10:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f4164f5b-dddf-45ee-8741-816d4fb70b01 tempest-SnapshotsActionsTest-1932493596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:10:48 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-f4164f5b-dddf-45ee-8741-816d4fb70b01 tempest-SnapshotsActionsTest-1932493596 None] Creating offline snapshot c2747415-3ef9-4643-92cf-59031cb98db0 of volume 553dbd22-1dba-473d-aef7-c5510ab60c55 {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:10:48 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e8939b-aa87-461c-9dda-2e040fc820d7]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:10:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f4164f5b-dddf-45ee-8741-816d4fb70b01 tempest-SnapshotsActionsTest-1932493596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:10:48 devstack sudo[89554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99
Nov 04 12:10:48 devstack sudo[89554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:10:48 devstack sudo[89549]: pam_unix(sudo:session): session closed for user root
Nov 04 12:10:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3c174575-94d2-49f5-a7f9-f660371cd29c tempest-ServersNegativeTestJSON-1124031446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f039147a-ecc0-4520-a32a-a753d34959f1" returned: 0 in 0.419s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:10:48 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3c174575-94d2-49f5-a7f9-f660371cd29c tempest-ServersNegativeTestJSON-1124031446 None] Lock "cinder-quobyte-f039147a-ecc0-4520-a32a-a753d34959f1" released by "delete_volume" :: held 1.014s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:10:48 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-3c174575-94d2-49f5-a7f9-f660371cd29c tempest-ServersNegativeTestJSON-1124031446 None] Created reservations ['b26e0817-f93d-4a51-be2a-d7d5a8409b77', '21e8a5f6-03d1-4a80-992f-43b78d16fa23', '0f385138-dffb-4f88-9b4b-01a8f16f6a31', 'ba69f434-2b2f-42e4-9253-596a4e33962b'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:10:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3c174575-94d2-49f5-a7f9-f660371cd29c tempest-ServersNegativeTestJSON-1124031446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:10:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3c174575-94d2-49f5-a7f9-f660371cd29c tempest-ServersNegativeTestJSON-1124031446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:10:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3c174575-94d2-49f5-a7f9-f660371cd29c tempest-ServersNegativeTestJSON-1124031446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:10:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3c174575-94d2-49f5-a7f9-f660371cd29c tempest-ServersNegativeTestJSON-1124031446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:10:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3c174575-94d2-49f5-a7f9-f660371cd29c tempest-ServersNegativeTestJSON-1124031446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:10:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3c174575-94d2-49f5-a7f9-f660371cd29c tempest-ServersNegativeTestJSON-1124031446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:10:49 devstack sudo[89562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:10:49 devstack sudo[89562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:10:49 devstack sudo[89554]: pam_unix(sudo:session): session closed for user root
Nov 04 12:10:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f4164f5b-dddf-45ee-8741-816d4fb70b01 tempest-SnapshotsActionsTest-1932493596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99" returned: 0 in 0.500s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:10:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-f4164f5b-dddf-45ee-8741-816d4fb70b01 tempest-SnapshotsActionsTest-1932493596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-553dbd22-1dba-473d-aef7-c5510ab60c55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:10:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f4164f5b-dddf-45ee-8741-816d4fb70b01 tempest-SnapshotsActionsTest-1932493596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.c2747415-3ef9-4643-92cf-59031cb98db0 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:10:49 devstack sudo[89564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.c2747415-3ef9-4643-92cf-59031cb98db0 1G
Nov 04 12:10:49 devstack sudo[89564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:10:49 devstack sudo[89562]: pam_unix(sudo:session): session closed for user root
Nov 04 12:10:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3c174575-94d2-49f5-a7f9-f660371cd29c tempest-ServersNegativeTestJSON-1124031446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.362s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:10:49 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-3c174575-94d2-49f5-a7f9-f660371cd29c tempest-ServersNegativeTestJSON-1124031446 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:10:49 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-3c174575-94d2-49f5-a7f9-f660371cd29c tempest-ServersNegativeTestJSON-1124031446 None] Deleted volume successfully.
Nov 04 12:10:49 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3c174575-94d2-49f5-a7f9-f660371cd29c tempest-ServersNegativeTestJSON-1124031446 None] Lock "cinder-f039147a-ecc0-4520-a32a-a753d34959f1-delete_volume" released by "delete_volume" :: held 1.693s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:10:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-d1163bf6-7fd5-45c2-be31-65bfb512ccc4 req-905a122a-03cb-4820-aea8-c9c405d28d4b tempest-ServerActionsTestOtherA-305064589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:10:49 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:10:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:10:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:10:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:10:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:10:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:10:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:10:49 devstack sudo[89564]: pam_unix(sudo:session): session closed for user root
Nov 04 12:10:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f4164f5b-dddf-45ee-8741-816d4fb70b01 tempest-SnapshotsActionsTest-1932493596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.c2747415-3ef9-4643-92cf-59031cb98db0 1G" returned: 0 in 0.683s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:10:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f4164f5b-dddf-45ee-8741-816d4fb70b01 tempest-SnapshotsActionsTest-1932493596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.c2747415-3ef9-4643-92cf-59031cb98db0 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:10:49 devstack sudo[89580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:10:49 devstack sudo[89580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:10:49 devstack sudo[89581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.c2747415-3ef9-4643-92cf-59031cb98db0
Nov 04 12:10:49 devstack sudo[89581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:10:50 devstack sudo[89580]: pam_unix(sudo:session): session closed for user root
Nov 04 12:10:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.310s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:10:50 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:10:50 devstack sudo[89581]: pam_unix(sudo:session): session closed for user root
Nov 04 12:10:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f4164f5b-dddf-45ee-8741-816d4fb70b01 tempest-SnapshotsActionsTest-1932493596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.c2747415-3ef9-4643-92cf-59031cb98db0" returned: 0 in 0.367s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:10:50 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-f4164f5b-dddf-45ee-8741-816d4fb70b01 tempest-SnapshotsActionsTest-1932493596 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.c2747415-3ef9-4643-92cf-59031cb98db0 is being set with open permissions: ugo+rw
Nov 04 12:10:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f4164f5b-dddf-45ee-8741-816d4fb70b01 tempest-SnapshotsActionsTest-1932493596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.c2747415-3ef9-4643-92cf-59031cb98db0 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:10:50 devstack sudo[89589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.c2747415-3ef9-4643-92cf-59031cb98db0
Nov 04 12:10:50 devstack sudo[89589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:10:50 devstack sudo[89589]: pam_unix(sudo:session): session closed for user root
Nov 04 12:10:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f4164f5b-dddf-45ee-8741-816d4fb70b01 tempest-SnapshotsActionsTest-1932493596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.c2747415-3ef9-4643-92cf-59031cb98db0" returned: 0 in 0.330s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:10:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f4164f5b-dddf-45ee-8741-816d4fb70b01 tempest-SnapshotsActionsTest-1932493596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.030s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:10:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-d1163bf6-7fd5-45c2-be31-65bfb512ccc4 req-905a122a-03cb-4820-aea8-c9c405d28d4b tempest-ServerActionsTestOtherA-305064589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.796s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:10:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-d1163bf6-7fd5-45c2-be31-65bfb512ccc4 req-905a122a-03cb-4820-aea8-c9c405d28d4b tempest-ServerActionsTestOtherA-305064589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.042s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:10:50 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-f4164f5b-dddf-45ee-8741-816d4fb70b01 tempest-SnapshotsActionsTest-1932493596 None] Create snapshot completed successfully
Nov 04 12:10:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-d1163bf6-7fd5-45c2-be31-65bfb512ccc4 req-905a122a-03cb-4820-aea8-c9c405d28d4b tempest-ServerActionsTestOtherA-305064589 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79', 'name': 'volume-52346bcf-6155-4587-b4d5-5ff349f2a384', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '98f5bbc0-b274-482e-9a3f-fa73aa7b6797', 'enforce_multipath': True} {{(pid=87169) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 04 12:10:50 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-d1163bf6-7fd5-45c2-be31-65bfb512ccc4 req-905a122a-03cb-4820-aea8-c9c405d28d4b tempest-ServerActionsTestOtherA-305064589 None] attachment_update completed successfully.
Nov 04 12:10:52 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-562b8906-1cbc-4cf9-8629-20f5145d13fd tempest-SnapshotsActionsTest-14126953 None] Acquiring lock "cinder-c2747415-3ef9-4643-92cf-59031cb98db0-delete_snapshot" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:10:52 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-562b8906-1cbc-4cf9-8629-20f5145d13fd tempest-SnapshotsActionsTest-14126953 None] Lock "cinder-c2747415-3ef9-4643-92cf-59031cb98db0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:10:52 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-562b8906-1cbc-4cf9-8629-20f5145d13fd tempest-SnapshotsActionsTest-14126953 None] Acquiring lock "cinder-quobyte-553dbd22-1dba-473d-aef7-c5510ab60c55" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:10:52 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-562b8906-1cbc-4cf9-8629-20f5145d13fd tempest-SnapshotsActionsTest-14126953 None] Lock "cinder-quobyte-553dbd22-1dba-473d-aef7-c5510ab60c55" acquired by "delete_snapshot" :: waited 0.059s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:10:52 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-562b8906-1cbc-4cf9-8629-20f5145d13fd tempest-SnapshotsActionsTest-14126953 None] Acquiring lock "cinder-quobyte-c2747415-3ef9-4643-92cf-59031cb98db0" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:10:52 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-562b8906-1cbc-4cf9-8629-20f5145d13fd tempest-SnapshotsActionsTest-14126953 None] Lock "cinder-quobyte-c2747415-3ef9-4643-92cf-59031cb98db0" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:10:52 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-562b8906-1cbc-4cf9-8629-20f5145d13fd tempest-SnapshotsActionsTest-14126953 None] Deleting offline snapshot c2747415-3ef9-4643-92cf-59031cb98db0 of volume 553dbd22-1dba-473d-aef7-c5510ab60c55 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:10:52 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-562b8906-1cbc-4cf9-8629-20f5145d13fd tempest-SnapshotsActionsTest-14126953 None] snapshot_file for this snap is: volume-553dbd22-1dba-473d-aef7-c5510ab60c55.c2747415-3ef9-4643-92cf-59031cb98db0 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:10:52 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[68481bb5-ccb0-41b2-b372-e2bbb016dbbe]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:10:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-562b8906-1cbc-4cf9-8629-20f5145d13fd tempest-SnapshotsActionsTest-14126953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.c2747415-3ef9-4643-92cf-59031cb98db0 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:10:52 devstack sudo[90034]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.c2747415-3ef9-4643-92cf-59031cb98db0
Nov 04 12:10:52 devstack sudo[90034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:10:52 devstack sudo[90034]: pam_unix(sudo:session): session closed for user root
Nov 04 12:10:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-562b8906-1cbc-4cf9-8629-20f5145d13fd tempest-SnapshotsActionsTest-14126953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.c2747415-3ef9-4643-92cf-59031cb98db0" returned: 0 in 0.419s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:10:52 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-562b8906-1cbc-4cf9-8629-20f5145d13fd tempest-SnapshotsActionsTest-14126953 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-553dbd22-1dba-473d-aef7-c5510ab60c55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:10:52 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[826bd83c-e850-4075-b0e2-ca6c927640a7]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:10:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-562b8906-1cbc-4cf9-8629-20f5145d13fd tempest-SnapshotsActionsTest-14126953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:10:53 devstack sudo[90050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99
Nov 04 12:10:53 devstack sudo[90050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:10:53 devstack sudo[90050]: pam_unix(sudo:session): session closed for user root
Nov 04 12:10:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-562b8906-1cbc-4cf9-8629-20f5145d13fd tempest-SnapshotsActionsTest-14126953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99" returned: 0 in 0.472s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:10:53 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-562b8906-1cbc-4cf9-8629-20f5145d13fd tempest-SnapshotsActionsTest-14126953 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-553dbd22-1dba-473d-aef7-c5510ab60c55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:10:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-562b8906-1cbc-4cf9-8629-20f5145d13fd tempest-SnapshotsActionsTest-14126953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.c2747415-3ef9-4643-92cf-59031cb98db0 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:10:53 devstack sudo[90069]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.c2747415-3ef9-4643-92cf-59031cb98db0
Nov 04 12:10:53 devstack sudo[90069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:10:53 devstack sudo[90069]: pam_unix(sudo:session): session closed for user root
Nov 04 12:10:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-562b8906-1cbc-4cf9-8629-20f5145d13fd tempest-SnapshotsActionsTest-14126953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.c2747415-3ef9-4643-92cf-59031cb98db0" returned: 0 in 0.577s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:10:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-562b8906-1cbc-4cf9-8629-20f5145d13fd tempest-SnapshotsActionsTest-14126953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.c2747415-3ef9-4643-92cf-59031cb98db0 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:10:53 devstack sudo[90078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.c2747415-3ef9-4643-92cf-59031cb98db0
Nov 04 12:10:53 devstack sudo[90078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:10:54 devstack sudo[90078]: pam_unix(sudo:session): session closed for user root
Nov 04 12:10:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-562b8906-1cbc-4cf9-8629-20f5145d13fd tempest-SnapshotsActionsTest-14126953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.c2747415-3ef9-4643-92cf-59031cb98db0" returned: 0 in 0.361s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:10:54 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-562b8906-1cbc-4cf9-8629-20f5145d13fd tempest-SnapshotsActionsTest-14126953 None] Lock "cinder-quobyte-c2747415-3ef9-4643-92cf-59031cb98db0" released by "_delete_snapshot" :: held 2.019s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:10:54 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-562b8906-1cbc-4cf9-8629-20f5145d13fd tempest-SnapshotsActionsTest-14126953 None] Lock "cinder-quobyte-553dbd22-1dba-473d-aef7-c5510ab60c55" released by "delete_snapshot" :: held 2.060s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:10:54 devstack cinder-volume[87169]: WARNING cinder.quota [None req-562b8906-1cbc-4cf9-8629-20f5145d13fd tempest-SnapshotsActionsTest-14126953 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Nov 04 12:10:54 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-562b8906-1cbc-4cf9-8629-20f5145d13fd tempest-SnapshotsActionsTest-14126953 None] Created reservations ['80f70600-ea6d-478e-a8e2-7872c207060c', '8e27bc2f-fccf-4d55-b20d-0b88819a154f', 'b007152f-5c47-4ec1-9c94-2dec4009ccbd', '169f45a0-3a45-41df-866d-a07d95b7bc10'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:10:54 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-562b8906-1cbc-4cf9-8629-20f5145d13fd tempest-SnapshotsActionsTest-14126953 None] Delete snapshot completed successfully.
Nov 04 12:10:54 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-562b8906-1cbc-4cf9-8629-20f5145d13fd tempest-SnapshotsActionsTest-14126953 None] Lock "cinder-c2747415-3ef9-4643-92cf-59031cb98db0-delete_snapshot" released by "delete_snapshot" :: held 2.279s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:10:55 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-3a3150e2-f513-4d6f-af73-5511706628db req-bab561d3-375d-4f97-b0e1-89d203ebcf9f tempest-ServerActionsTestOtherA-305064589 None] Terminate volume connection completed successfully.
Nov 04 12:10:55 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-3a3150e2-f513-4d6f-af73-5511706628db req-bab561d3-375d-4f97-b0e1-89d203ebcf9f tempest-ServerActionsTestOtherA-305064589 None] Deleting attachment 98f5bbc0-b274-482e-9a3f-fa73aa7b6797. {{(pid=87169) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 12:10:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-9f5583ac-287f-4ecf-8cb8-ac38ff5aab56 tempest-SnapshotsActionsTest-1932493596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:10:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-9f5583ac-287f-4ecf-8cb8-ac38ff5aab56 tempest-SnapshotsActionsTest-1932493596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:10:55 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-9f5583ac-287f-4ecf-8cb8-ac38ff5aab56 tempest-SnapshotsActionsTest-1932493596 None] Creating offline snapshot 4b0f368d-fceb-4d30-880a-1bef310b52be of volume 553dbd22-1dba-473d-aef7-c5510ab60c55 {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:10:56 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec81215-12d7-4ac6-b52d-280a3b5209f9]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:10:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9f5583ac-287f-4ecf-8cb8-ac38ff5aab56 tempest-SnapshotsActionsTest-1932493596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:10:56 devstack sudo[90152]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99
Nov 04 12:10:56 devstack sudo[90152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:10:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-3a3150e2-f513-4d6f-af73-5511706628db req-98d981dc-91a3-4540-b1ca-9a8857c961e7 tempest-ServerActionsTestOtherA-305064589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:10:56 devstack sudo[90152]: pam_unix(sudo:session): session closed for user root
Nov 04 12:10:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9f5583ac-287f-4ecf-8cb8-ac38ff5aab56 tempest-SnapshotsActionsTest-1932493596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99" returned: 0 in 0.618s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:10:56 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-9f5583ac-287f-4ecf-8cb8-ac38ff5aab56 tempest-SnapshotsActionsTest-1932493596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-553dbd22-1dba-473d-aef7-c5510ab60c55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:10:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9f5583ac-287f-4ecf-8cb8-ac38ff5aab56 tempest-SnapshotsActionsTest-1932493596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.4b0f368d-fceb-4d30-880a-1bef310b52be 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:10:56 devstack sudo[90171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.4b0f368d-fceb-4d30-880a-1bef310b52be 1G
Nov 04 12:10:56 devstack sudo[90171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:10:57 devstack sudo[90171]: pam_unix(sudo:session): session closed for user root
Nov 04 12:10:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9f5583ac-287f-4ecf-8cb8-ac38ff5aab56 tempest-SnapshotsActionsTest-1932493596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.4b0f368d-fceb-4d30-880a-1bef310b52be 1G" returned: 0 in 0.451s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:10:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9f5583ac-287f-4ecf-8cb8-ac38ff5aab56 tempest-SnapshotsActionsTest-1932493596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.4b0f368d-fceb-4d30-880a-1bef310b52be {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:10:57 devstack sudo[90176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.4b0f368d-fceb-4d30-880a-1bef310b52be
Nov 04 12:10:57 devstack sudo[90176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:10:57 devstack sudo[90176]: pam_unix(sudo:session): session closed for user root
Nov 04 12:10:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9f5583ac-287f-4ecf-8cb8-ac38ff5aab56 tempest-SnapshotsActionsTest-1932493596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.4b0f368d-fceb-4d30-880a-1bef310b52be" returned: 0 in 0.282s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:10:57 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-9f5583ac-287f-4ecf-8cb8-ac38ff5aab56 tempest-SnapshotsActionsTest-1932493596 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.4b0f368d-fceb-4d30-880a-1bef310b52be is being set with open permissions: ugo+rw
Nov 04 12:10:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9f5583ac-287f-4ecf-8cb8-ac38ff5aab56 tempest-SnapshotsActionsTest-1932493596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.4b0f368d-fceb-4d30-880a-1bef310b52be {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:10:57 devstack sudo[90182]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.4b0f368d-fceb-4d30-880a-1bef310b52be
Nov 04 12:10:57 devstack sudo[90182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:10:57 devstack sudo[90182]: pam_unix(sudo:session): session closed for user root
Nov 04 12:10:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9f5583ac-287f-4ecf-8cb8-ac38ff5aab56 tempest-SnapshotsActionsTest-1932493596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.4b0f368d-fceb-4d30-880a-1bef310b52be" returned: 0 in 0.262s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:10:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-9f5583ac-287f-4ecf-8cb8-ac38ff5aab56 tempest-SnapshotsActionsTest-1932493596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.818s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:10:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-3a3150e2-f513-4d6f-af73-5511706628db req-98d981dc-91a3-4540-b1ca-9a8857c961e7 tempest-ServerActionsTestOtherA-305064589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.191s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:10:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-3a3150e2-f513-4d6f-af73-5511706628db req-98d981dc-91a3-4540-b1ca-9a8857c961e7 tempest-ServerActionsTestOtherA-305064589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:10:57 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-9f5583ac-287f-4ecf-8cb8-ac38ff5aab56 tempest-SnapshotsActionsTest-1932493596 None] Create snapshot completed successfully
Nov 04 12:10:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-3a3150e2-f513-4d6f-af73-5511706628db req-98d981dc-91a3-4540-b1ca-9a8857c961e7 tempest-ServerActionsTestOtherA-305064589 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79', 'name': 'volume-52346bcf-6155-4587-b4d5-5ff349f2a384', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '41f90f13-1704-4835-96c8-f45a7aac0657', 'enforce_multipath': True} {{(pid=87169) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 04 12:10:57 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-3a3150e2-f513-4d6f-af73-5511706628db req-98d981dc-91a3-4540-b1ca-9a8857c961e7 tempest-ServerActionsTestOtherA-305064589 None] attachment_update completed successfully.
Nov 04 12:10:58 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5ed48187-2c3c-4433-bdf7-989d0c3cbece tempest-SnapshotsActionsTest-14126953 None] Acquiring lock "cinder-4b0f368d-fceb-4d30-880a-1bef310b52be-delete_snapshot" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:10:58 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5ed48187-2c3c-4433-bdf7-989d0c3cbece tempest-SnapshotsActionsTest-14126953 None] Lock "cinder-4b0f368d-fceb-4d30-880a-1bef310b52be-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:10:58 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5ed48187-2c3c-4433-bdf7-989d0c3cbece tempest-SnapshotsActionsTest-14126953 None] Acquiring lock "cinder-quobyte-553dbd22-1dba-473d-aef7-c5510ab60c55" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:10:58 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5ed48187-2c3c-4433-bdf7-989d0c3cbece tempest-SnapshotsActionsTest-14126953 None] Lock "cinder-quobyte-553dbd22-1dba-473d-aef7-c5510ab60c55" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:10:58 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5ed48187-2c3c-4433-bdf7-989d0c3cbece tempest-SnapshotsActionsTest-14126953 None] Acquiring lock "cinder-quobyte-4b0f368d-fceb-4d30-880a-1bef310b52be" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:10:58 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5ed48187-2c3c-4433-bdf7-989d0c3cbece tempest-SnapshotsActionsTest-14126953 None] Lock "cinder-quobyte-4b0f368d-fceb-4d30-880a-1bef310b52be" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:10:58 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-5ed48187-2c3c-4433-bdf7-989d0c3cbece tempest-SnapshotsActionsTest-14126953 None] Deleting offline snapshot 4b0f368d-fceb-4d30-880a-1bef310b52be of volume 553dbd22-1dba-473d-aef7-c5510ab60c55 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:10:58 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-5ed48187-2c3c-4433-bdf7-989d0c3cbece tempest-SnapshotsActionsTest-14126953 None] snapshot_file for this snap is: volume-553dbd22-1dba-473d-aef7-c5510ab60c55.4b0f368d-fceb-4d30-880a-1bef310b52be {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:10:58 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[247fbb83-f7cd-4b9f-9200-48db0781e3f9]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:10:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5ed48187-2c3c-4433-bdf7-989d0c3cbece tempest-SnapshotsActionsTest-14126953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.4b0f368d-fceb-4d30-880a-1bef310b52be {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:10:58 devstack sudo[90186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.4b0f368d-fceb-4d30-880a-1bef310b52be
Nov 04 12:10:58 devstack sudo[90186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:10:58 devstack sudo[90186]: pam_unix(sudo:session): session closed for user root
Nov 04 12:10:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5ed48187-2c3c-4433-bdf7-989d0c3cbece tempest-SnapshotsActionsTest-14126953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.4b0f368d-fceb-4d30-880a-1bef310b52be" returned: 0 in 0.551s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:10:58 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-5ed48187-2c3c-4433-bdf7-989d0c3cbece tempest-SnapshotsActionsTest-14126953 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-553dbd22-1dba-473d-aef7-c5510ab60c55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:10:58 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c636bde-223b-4b10-ab86-3103057debc9]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:10:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5ed48187-2c3c-4433-bdf7-989d0c3cbece tempest-SnapshotsActionsTest-14126953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:10:58 devstack sudo[90208]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99
Nov 04 12:10:58 devstack sudo[90208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:10:59 devstack sudo[90208]: pam_unix(sudo:session): session closed for user root
Nov 04 12:10:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5ed48187-2c3c-4433-bdf7-989d0c3cbece tempest-SnapshotsActionsTest-14126953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99" returned: 0 in 0.458s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:10:59 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-5ed48187-2c3c-4433-bdf7-989d0c3cbece tempest-SnapshotsActionsTest-14126953 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-553dbd22-1dba-473d-aef7-c5510ab60c55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:10:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5ed48187-2c3c-4433-bdf7-989d0c3cbece tempest-SnapshotsActionsTest-14126953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.4b0f368d-fceb-4d30-880a-1bef310b52be {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:10:59 devstack sudo[90319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.4b0f368d-fceb-4d30-880a-1bef310b52be
Nov 04 12:10:59 devstack sudo[90319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:10:59 devstack sudo[90319]: pam_unix(sudo:session): session closed for user root
Nov 04 12:10:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5ed48187-2c3c-4433-bdf7-989d0c3cbece tempest-SnapshotsActionsTest-14126953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.4b0f368d-fceb-4d30-880a-1bef310b52be" returned: 0 in 0.643s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:10:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5ed48187-2c3c-4433-bdf7-989d0c3cbece tempest-SnapshotsActionsTest-14126953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.4b0f368d-fceb-4d30-880a-1bef310b52be {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:10:59 devstack sudo[90665]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.4b0f368d-fceb-4d30-880a-1bef310b52be
Nov 04 12:10:59 devstack sudo[90665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:11:00 devstack sudo[90665]: pam_unix(sudo:session): session closed for user root
Nov 04 12:11:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5ed48187-2c3c-4433-bdf7-989d0c3cbece tempest-SnapshotsActionsTest-14126953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.4b0f368d-fceb-4d30-880a-1bef310b52be" returned: 0 in 0.505s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:11:00 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5ed48187-2c3c-4433-bdf7-989d0c3cbece tempest-SnapshotsActionsTest-14126953 None] Lock "cinder-quobyte-4b0f368d-fceb-4d30-880a-1bef310b52be" released by "_delete_snapshot" :: held 2.304s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:11:00 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5ed48187-2c3c-4433-bdf7-989d0c3cbece tempest-SnapshotsActionsTest-14126953 None] Lock "cinder-quobyte-553dbd22-1dba-473d-aef7-c5510ab60c55" released by "delete_snapshot" :: held 2.329s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:11:00 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-5ed48187-2c3c-4433-bdf7-989d0c3cbece tempest-SnapshotsActionsTest-14126953 None] Created reservations ['69afc7e8-ca84-49fb-a07b-02237befbde5', '22898842-91d9-4c1e-94d4-56a5d59728be', '58b1af14-e4b5-46e8-8d1c-de83f07fe7ac', 'd9505968-bba6-4425-9a92-61f9710b7fed'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:11:00 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-5ed48187-2c3c-4433-bdf7-989d0c3cbece tempest-SnapshotsActionsTest-14126953 None] Delete snapshot completed successfully.
Nov 04 12:11:00 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5ed48187-2c3c-4433-bdf7-989d0c3cbece tempest-SnapshotsActionsTest-14126953 None] Lock "cinder-4b0f368d-fceb-4d30-880a-1bef310b52be-delete_snapshot" released by "delete_snapshot" :: held 2.535s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:11:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8984a440-a2d3-4ce5-a7b3-6ff2ae7fb579 tempest-SnapshotsActionsTest-1932493596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:11:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8984a440-a2d3-4ce5-a7b3-6ff2ae7fb579 tempest-SnapshotsActionsTest-1932493596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:11:01 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-8984a440-a2d3-4ce5-a7b3-6ff2ae7fb579 tempest-SnapshotsActionsTest-1932493596 None] Creating offline snapshot 7c460941-3083-4f93-a29f-d7a8b46a1b59 of volume 553dbd22-1dba-473d-aef7-c5510ab60c55 {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:11:01 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ba4233-537e-42f0-8295-b231425eb6b4]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:11:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8984a440-a2d3-4ce5-a7b3-6ff2ae7fb579 tempest-SnapshotsActionsTest-1932493596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:11:02 devstack sudo[90681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99
Nov 04 12:11:02 devstack sudo[90681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:11:02 devstack sudo[90681]: pam_unix(sudo:session): session closed for user root
Nov 04 12:11:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8984a440-a2d3-4ce5-a7b3-6ff2ae7fb579 tempest-SnapshotsActionsTest-1932493596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99" returned: 0 in 0.464s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:11:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-8984a440-a2d3-4ce5-a7b3-6ff2ae7fb579 tempest-SnapshotsActionsTest-1932493596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-553dbd22-1dba-473d-aef7-c5510ab60c55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:11:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8984a440-a2d3-4ce5-a7b3-6ff2ae7fb579 tempest-SnapshotsActionsTest-1932493596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.7c460941-3083-4f93-a29f-d7a8b46a1b59 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:11:02 devstack sudo[90688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.7c460941-3083-4f93-a29f-d7a8b46a1b59 1G
Nov 04 12:11:02 devstack sudo[90688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:11:03 devstack sudo[90688]: pam_unix(sudo:session): session closed for user root
Nov 04 12:11:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8984a440-a2d3-4ce5-a7b3-6ff2ae7fb579 tempest-SnapshotsActionsTest-1932493596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.7c460941-3083-4f93-a29f-d7a8b46a1b59 1G" returned: 0 in 0.893s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:11:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8984a440-a2d3-4ce5-a7b3-6ff2ae7fb579 tempest-SnapshotsActionsTest-1932493596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.7c460941-3083-4f93-a29f-d7a8b46a1b59 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:11:03 devstack sudo[90696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.7c460941-3083-4f93-a29f-d7a8b46a1b59
Nov 04 12:11:03 devstack sudo[90696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:11:03 devstack sudo[90696]: pam_unix(sudo:session): session closed for user root
Nov 04 12:11:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8984a440-a2d3-4ce5-a7b3-6ff2ae7fb579 tempest-SnapshotsActionsTest-1932493596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.7c460941-3083-4f93-a29f-d7a8b46a1b59" returned: 0 in 0.486s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:11:03 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-8984a440-a2d3-4ce5-a7b3-6ff2ae7fb579 tempest-SnapshotsActionsTest-1932493596 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.7c460941-3083-4f93-a29f-d7a8b46a1b59 is being set with open permissions: ugo+rw
Nov 04 12:11:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8984a440-a2d3-4ce5-a7b3-6ff2ae7fb579 tempest-SnapshotsActionsTest-1932493596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.7c460941-3083-4f93-a29f-d7a8b46a1b59 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:11:03 devstack sudo[90701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.7c460941-3083-4f93-a29f-d7a8b46a1b59
Nov 04 12:11:03 devstack sudo[90701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:11:04 devstack sudo[90701]: pam_unix(sudo:session): session closed for user root
Nov 04 12:11:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8984a440-a2d3-4ce5-a7b3-6ff2ae7fb579 tempest-SnapshotsActionsTest-1932493596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.7c460941-3083-4f93-a29f-d7a8b46a1b59" returned: 0 in 0.358s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:11:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8984a440-a2d3-4ce5-a7b3-6ff2ae7fb579 tempest-SnapshotsActionsTest-1932493596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.334s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:11:04 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-8984a440-a2d3-4ce5-a7b3-6ff2ae7fb579 tempest-SnapshotsActionsTest-1932493596 None] Create snapshot completed successfully
Nov 04 12:11:05 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ad1e0684-2645-4410-bf00-d726ed42850f tempest-SnapshotsActionsTest-14126953 None] Acquiring lock "cinder-7c460941-3083-4f93-a29f-d7a8b46a1b59-delete_snapshot" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:11:05 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ad1e0684-2645-4410-bf00-d726ed42850f tempest-SnapshotsActionsTest-14126953 None] Lock "cinder-7c460941-3083-4f93-a29f-d7a8b46a1b59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:11:05 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ad1e0684-2645-4410-bf00-d726ed42850f tempest-SnapshotsActionsTest-14126953 None] Acquiring lock "cinder-quobyte-553dbd22-1dba-473d-aef7-c5510ab60c55" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:11:05 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ad1e0684-2645-4410-bf00-d726ed42850f tempest-SnapshotsActionsTest-14126953 None] Lock "cinder-quobyte-553dbd22-1dba-473d-aef7-c5510ab60c55" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:11:05 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ad1e0684-2645-4410-bf00-d726ed42850f tempest-SnapshotsActionsTest-14126953 None] Acquiring lock "cinder-quobyte-7c460941-3083-4f93-a29f-d7a8b46a1b59" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:11:05 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ad1e0684-2645-4410-bf00-d726ed42850f tempest-SnapshotsActionsTest-14126953 None] Lock "cinder-quobyte-7c460941-3083-4f93-a29f-d7a8b46a1b59" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:11:05 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-ad1e0684-2645-4410-bf00-d726ed42850f tempest-SnapshotsActionsTest-14126953 None] Deleting offline snapshot 7c460941-3083-4f93-a29f-d7a8b46a1b59 of volume 553dbd22-1dba-473d-aef7-c5510ab60c55 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:11:05 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-ad1e0684-2645-4410-bf00-d726ed42850f tempest-SnapshotsActionsTest-14126953 None] snapshot_file for this snap is: volume-553dbd22-1dba-473d-aef7-c5510ab60c55.7c460941-3083-4f93-a29f-d7a8b46a1b59 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:11:05 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[96888af2-550c-43ee-8b14-462074427983]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:11:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ad1e0684-2645-4410-bf00-d726ed42850f tempest-SnapshotsActionsTest-14126953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.7c460941-3083-4f93-a29f-d7a8b46a1b59 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:11:05 devstack sudo[90704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.7c460941-3083-4f93-a29f-d7a8b46a1b59
Nov 04 12:11:05 devstack sudo[90704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:11:05 devstack sudo[90704]: pam_unix(sudo:session): session closed for user root
Nov 04 12:11:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ad1e0684-2645-4410-bf00-d726ed42850f tempest-SnapshotsActionsTest-14126953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.7c460941-3083-4f93-a29f-d7a8b46a1b59" returned: 0 in 0.504s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:11:05 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-ad1e0684-2645-4410-bf00-d726ed42850f tempest-SnapshotsActionsTest-14126953 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-553dbd22-1dba-473d-aef7-c5510ab60c55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:11:05 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89d1cd3-1cda-4fde-a35f-80b1fbaf4831]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:11:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ad1e0684-2645-4410-bf00-d726ed42850f tempest-SnapshotsActionsTest-14126953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:11:06 devstack sudo[90711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99
Nov 04 12:11:06 devstack sudo[90711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:11:06 devstack sudo[90711]: pam_unix(sudo:session): session closed for user root
Nov 04 12:11:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ad1e0684-2645-4410-bf00-d726ed42850f tempest-SnapshotsActionsTest-14126953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99" returned: 0 in 0.570s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:11:06 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-ad1e0684-2645-4410-bf00-d726ed42850f tempest-SnapshotsActionsTest-14126953 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-553dbd22-1dba-473d-aef7-c5510ab60c55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:11:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ad1e0684-2645-4410-bf00-d726ed42850f tempest-SnapshotsActionsTest-14126953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.7c460941-3083-4f93-a29f-d7a8b46a1b59 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:11:06 devstack sudo[90718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.7c460941-3083-4f93-a29f-d7a8b46a1b59
Nov 04 12:11:06 devstack sudo[90718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:11:07 devstack sudo[90718]: pam_unix(sudo:session): session closed for user root
Nov 04 12:11:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ad1e0684-2645-4410-bf00-d726ed42850f tempest-SnapshotsActionsTest-14126953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.7c460941-3083-4f93-a29f-d7a8b46a1b59" returned: 0 in 0.446s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:11:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ad1e0684-2645-4410-bf00-d726ed42850f tempest-SnapshotsActionsTest-14126953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.7c460941-3083-4f93-a29f-d7a8b46a1b59 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:11:07 devstack sudo[90723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.7c460941-3083-4f93-a29f-d7a8b46a1b59
Nov 04 12:11:07 devstack sudo[90723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:11:07 devstack sudo[90723]: pam_unix(sudo:session): session closed for user root
Nov 04 12:11:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ad1e0684-2645-4410-bf00-d726ed42850f tempest-SnapshotsActionsTest-14126953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.7c460941-3083-4f93-a29f-d7a8b46a1b59" returned: 0 in 0.334s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:11:07 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ad1e0684-2645-4410-bf00-d726ed42850f tempest-SnapshotsActionsTest-14126953 None] Lock "cinder-quobyte-7c460941-3083-4f93-a29f-d7a8b46a1b59" released by "_delete_snapshot" :: held 2.026s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:11:07 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ad1e0684-2645-4410-bf00-d726ed42850f tempest-SnapshotsActionsTest-14126953 None] Lock "cinder-quobyte-553dbd22-1dba-473d-aef7-c5510ab60c55" released by "delete_snapshot" :: held 2.061s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:11:07 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-ad1e0684-2645-4410-bf00-d726ed42850f tempest-SnapshotsActionsTest-14126953 None] Created reservations ['183a0eb4-9272-4b3d-8889-f3e403b8cf65', '1654d17c-cb02-4fd2-ae1d-2b10b5158107', 'bb36f2aa-0342-44cc-9364-94b3cf487f90', '37b590c8-e63d-4ddd-b980-ce9f946e7551'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:11:07 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-ad1e0684-2645-4410-bf00-d726ed42850f tempest-SnapshotsActionsTest-14126953 None] Delete snapshot completed successfully.
Nov 04 12:11:07 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ad1e0684-2645-4410-bf00-d726ed42850f tempest-SnapshotsActionsTest-14126953 None] Lock "cinder-7c460941-3083-4f93-a29f-d7a8b46a1b59-delete_snapshot" released by "delete_snapshot" :: held 2.325s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:11:09 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:UPDATE=59,cinder:SELECT=63,cinder:INSERT=12,cinder:DELETE=7 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:11:09 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=64,cinder:UPDATE=53,cinder:INSERT=14,cinder:DELETE=3 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:11:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-dee092a5-b79a-4d6b-8fd0-bfaeddda322a tempest-SnapshotsActionsTest-1932493596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:11:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-dee092a5-b79a-4d6b-8fd0-bfaeddda322a tempest-SnapshotsActionsTest-1932493596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:11:09 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-dee092a5-b79a-4d6b-8fd0-bfaeddda322a tempest-SnapshotsActionsTest-1932493596 None] Creating offline snapshot 4958d161-bcb0-421f-8210-96e6ce6e2b69 of volume 553dbd22-1dba-473d-aef7-c5510ab60c55 {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:11:09 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[31cdeb6b-df78-47a3-aeb9-93d407eb1037]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:11:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dee092a5-b79a-4d6b-8fd0-bfaeddda322a tempest-SnapshotsActionsTest-1932493596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:11:09 devstack sudo[90777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99
Nov 04 12:11:09 devstack sudo[90777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:11:10 devstack sudo[90777]: pam_unix(sudo:session): session closed for user root
Nov 04 12:11:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dee092a5-b79a-4d6b-8fd0-bfaeddda322a tempest-SnapshotsActionsTest-1932493596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99" returned: 0 in 0.501s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:11:10 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-dee092a5-b79a-4d6b-8fd0-bfaeddda322a tempest-SnapshotsActionsTest-1932493596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-553dbd22-1dba-473d-aef7-c5510ab60c55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:11:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dee092a5-b79a-4d6b-8fd0-bfaeddda322a tempest-SnapshotsActionsTest-1932493596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.4958d161-bcb0-421f-8210-96e6ce6e2b69 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:11:10 devstack sudo[90788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.4958d161-bcb0-421f-8210-96e6ce6e2b69 1G
Nov 04 12:11:10 devstack sudo[90788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:11:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-6f0291a9-92e7-41f3-9379-6c4fd1c71d4a req-b4f17cb3-8205-461b-9223-dcc3f44f09c5 tempest-TaggedAttachmentsTest-1045611021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:11:11 devstack sudo[90788]: pam_unix(sudo:session): session closed for user root
Nov 04 12:11:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dee092a5-b79a-4d6b-8fd0-bfaeddda322a tempest-SnapshotsActionsTest-1932493596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.4958d161-bcb0-421f-8210-96e6ce6e2b69 1G" returned: 0 in 0.859s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:11:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dee092a5-b79a-4d6b-8fd0-bfaeddda322a tempest-SnapshotsActionsTest-1932493596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.4958d161-bcb0-421f-8210-96e6ce6e2b69 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:11:11 devstack sudo[90805]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.4958d161-bcb0-421f-8210-96e6ce6e2b69
Nov 04 12:11:11 devstack sudo[90805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:11:11 devstack sudo[90805]: pam_unix(sudo:session): session closed for user root
Nov 04 12:11:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dee092a5-b79a-4d6b-8fd0-bfaeddda322a tempest-SnapshotsActionsTest-1932493596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.4958d161-bcb0-421f-8210-96e6ce6e2b69" returned: 0 in 0.428s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:11:11 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-dee092a5-b79a-4d6b-8fd0-bfaeddda322a tempest-SnapshotsActionsTest-1932493596 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.4958d161-bcb0-421f-8210-96e6ce6e2b69 is being set with open permissions: ugo+rw
Nov 04 12:11:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dee092a5-b79a-4d6b-8fd0-bfaeddda322a tempest-SnapshotsActionsTest-1932493596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.4958d161-bcb0-421f-8210-96e6ce6e2b69 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:11:11 devstack sudo[90811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.4958d161-bcb0-421f-8210-96e6ce6e2b69
Nov 04 12:11:11 devstack sudo[90811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:11:11 devstack sudo[90811]: pam_unix(sudo:session): session closed for user root
Nov 04 12:11:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dee092a5-b79a-4d6b-8fd0-bfaeddda322a tempest-SnapshotsActionsTest-1932493596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.4958d161-bcb0-421f-8210-96e6ce6e2b69" returned: 0 in 0.341s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:11:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-dee092a5-b79a-4d6b-8fd0-bfaeddda322a tempest-SnapshotsActionsTest-1932493596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.312s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:11:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-6f0291a9-92e7-41f3-9379-6c4fd1c71d4a req-b4f17cb3-8205-461b-9223-dcc3f44f09c5 tempest-TaggedAttachmentsTest-1045611021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.071s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:11:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-6f0291a9-92e7-41f3-9379-6c4fd1c71d4a req-b4f17cb3-8205-461b-9223-dcc3f44f09c5 tempest-TaggedAttachmentsTest-1045611021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:11:11 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-dee092a5-b79a-4d6b-8fd0-bfaeddda322a tempest-SnapshotsActionsTest-1932493596 None] Create snapshot completed successfully
Nov 04 12:11:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-6f0291a9-92e7-41f3-9379-6c4fd1c71d4a req-b4f17cb3-8205-461b-9223-dcc3f44f09c5 tempest-TaggedAttachmentsTest-1045611021 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79', 'name': 'volume-24a09c34-80ce-4097-8b66-49440332af12', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '30cfeb2f-8f8c-4cb3-aa13-3d006be57914', 'enforce_multipath': True} {{(pid=87169) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 04 12:11:12 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-6f0291a9-92e7-41f3-9379-6c4fd1c71d4a req-b4f17cb3-8205-461b-9223-dcc3f44f09c5 tempest-TaggedAttachmentsTest-1045611021 None] attachment_update completed successfully.
Nov 04 12:11:12 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e383887d-bb17-4350-a765-4655091af515 tempest-SnapshotsActionsTest-14126953 None] Acquiring lock "cinder-4958d161-bcb0-421f-8210-96e6ce6e2b69-delete_snapshot" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:11:12 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e383887d-bb17-4350-a765-4655091af515 tempest-SnapshotsActionsTest-14126953 None] Lock "cinder-4958d161-bcb0-421f-8210-96e6ce6e2b69-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:11:12 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e383887d-bb17-4350-a765-4655091af515 tempest-SnapshotsActionsTest-14126953 None] Acquiring lock "cinder-quobyte-553dbd22-1dba-473d-aef7-c5510ab60c55" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:11:12 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e383887d-bb17-4350-a765-4655091af515 tempest-SnapshotsActionsTest-14126953 None] Lock "cinder-quobyte-553dbd22-1dba-473d-aef7-c5510ab60c55" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:11:12 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e383887d-bb17-4350-a765-4655091af515 tempest-SnapshotsActionsTest-14126953 None] Acquiring lock "cinder-quobyte-4958d161-bcb0-421f-8210-96e6ce6e2b69" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:11:13 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e383887d-bb17-4350-a765-4655091af515 tempest-SnapshotsActionsTest-14126953 None] Lock "cinder-quobyte-4958d161-bcb0-421f-8210-96e6ce6e2b69" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:11:13 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-e383887d-bb17-4350-a765-4655091af515 tempest-SnapshotsActionsTest-14126953 None] Deleting offline snapshot 4958d161-bcb0-421f-8210-96e6ce6e2b69 of volume 553dbd22-1dba-473d-aef7-c5510ab60c55 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:11:13 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-e383887d-bb17-4350-a765-4655091af515 tempest-SnapshotsActionsTest-14126953 None] snapshot_file for this snap is: volume-553dbd22-1dba-473d-aef7-c5510ab60c55.4958d161-bcb0-421f-8210-96e6ce6e2b69 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:11:13 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8e8d45-7c33-43c7-a24d-c23c4b950f3b]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:11:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e383887d-bb17-4350-a765-4655091af515 tempest-SnapshotsActionsTest-14126953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.4958d161-bcb0-421f-8210-96e6ce6e2b69 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:11:13 devstack sudo[90816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.4958d161-bcb0-421f-8210-96e6ce6e2b69
Nov 04 12:11:13 devstack sudo[90816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:11:13 devstack sudo[90816]: pam_unix(sudo:session): session closed for user root
Nov 04 12:11:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e383887d-bb17-4350-a765-4655091af515 tempest-SnapshotsActionsTest-14126953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.4958d161-bcb0-421f-8210-96e6ce6e2b69" returned: 0 in 0.408s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:11:13 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-e383887d-bb17-4350-a765-4655091af515 tempest-SnapshotsActionsTest-14126953 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-553dbd22-1dba-473d-aef7-c5510ab60c55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:11:13 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d12a81a-6860-470c-bd36-64d814914250]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:11:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e383887d-bb17-4350-a765-4655091af515 tempest-SnapshotsActionsTest-14126953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:11:13 devstack sudo[90822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99
Nov 04 12:11:13 devstack sudo[90822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:11:14 devstack sudo[90822]: pam_unix(sudo:session): session closed for user root
Nov 04 12:11:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e383887d-bb17-4350-a765-4655091af515 tempest-SnapshotsActionsTest-14126953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99" returned: 0 in 0.518s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:11:14 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-e383887d-bb17-4350-a765-4655091af515 tempest-SnapshotsActionsTest-14126953 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-553dbd22-1dba-473d-aef7-c5510ab60c55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:11:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e383887d-bb17-4350-a765-4655091af515 tempest-SnapshotsActionsTest-14126953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.4958d161-bcb0-421f-8210-96e6ce6e2b69 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:11:14 devstack sudo[90836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.4958d161-bcb0-421f-8210-96e6ce6e2b69
Nov 04 12:11:14 devstack sudo[90836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:11:14 devstack sudo[90836]: pam_unix(sudo:session): session closed for user root
Nov 04 12:11:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e383887d-bb17-4350-a765-4655091af515 tempest-SnapshotsActionsTest-14126953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.4958d161-bcb0-421f-8210-96e6ce6e2b69" returned: 0 in 0.587s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:11:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e383887d-bb17-4350-a765-4655091af515 tempest-SnapshotsActionsTest-14126953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.4958d161-bcb0-421f-8210-96e6ce6e2b69 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:11:14 devstack sudo[90863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.4958d161-bcb0-421f-8210-96e6ce6e2b69
Nov 04 12:11:14 devstack sudo[90863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:11:14 devstack sudo[90863]: pam_unix(sudo:session): session closed for user root
Nov 04 12:11:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e383887d-bb17-4350-a765-4655091af515 tempest-SnapshotsActionsTest-14126953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.4958d161-bcb0-421f-8210-96e6ce6e2b69" returned: 0 in 0.283s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:11:14 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e383887d-bb17-4350-a765-4655091af515 tempest-SnapshotsActionsTest-14126953 None] Lock "cinder-quobyte-4958d161-bcb0-421f-8210-96e6ce6e2b69" released by "_delete_snapshot" :: held 1.930s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:11:14 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e383887d-bb17-4350-a765-4655091af515 tempest-SnapshotsActionsTest-14126953 None] Lock "cinder-quobyte-553dbd22-1dba-473d-aef7-c5510ab60c55" released by "delete_snapshot" :: held 1.965s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:11:15 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-e383887d-bb17-4350-a765-4655091af515 tempest-SnapshotsActionsTest-14126953 None] Created reservations ['cb5d7cf2-0413-4f2f-9244-2ed048fcfaa4', '6fe2bba6-52ef-48e9-bbaf-0cc0fd7fdd43', '8ab4a04e-5a25-4ec2-a920-54e94e006cd3', '377bfbd4-1ef9-4c46-b34e-15f16ed69be5'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:11:15 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-e383887d-bb17-4350-a765-4655091af515 tempest-SnapshotsActionsTest-14126953 None] Delete snapshot completed successfully.
Nov 04 12:11:15 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e383887d-bb17-4350-a765-4655091af515 tempest-SnapshotsActionsTest-14126953 None] Lock "cinder-4958d161-bcb0-421f-8210-96e6ce6e2b69-delete_snapshot" released by "delete_snapshot" :: held 2.176s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:11:15 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-b11a84bd-22d5-483c-8fe5-3b64efe2add0 req-adee2fea-179d-49f5-aee6-f04370ffb76b tempest-TaggedAttachmentsTest-1045611021 None] Terminate volume connection completed successfully.
Nov 04 12:11:15 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-b11a84bd-22d5-483c-8fe5-3b64efe2add0 req-adee2fea-179d-49f5-aee6-f04370ffb76b tempest-TaggedAttachmentsTest-1045611021 None] Deleting attachment 30cfeb2f-8f8c-4cb3-aa13-3d006be57914. {{(pid=87169) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 12:11:15 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-dfa98f28-a27d-495c-8798-ff658f4069f6 tempest-SnapshotsActionsTest-1932493596 None] Acquiring lock "cinder-837ef147-e20a-46b2-885c-e51518a48b99-delete_snapshot" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:11:15 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-dfa98f28-a27d-495c-8798-ff658f4069f6 tempest-SnapshotsActionsTest-1932493596 None] Lock "cinder-837ef147-e20a-46b2-885c-e51518a48b99-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:11:15 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-dfa98f28-a27d-495c-8798-ff658f4069f6 tempest-SnapshotsActionsTest-1932493596 None] Acquiring lock "cinder-quobyte-553dbd22-1dba-473d-aef7-c5510ab60c55" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:11:16 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-dfa98f28-a27d-495c-8798-ff658f4069f6 tempest-SnapshotsActionsTest-1932493596 None] Lock "cinder-quobyte-553dbd22-1dba-473d-aef7-c5510ab60c55" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:11:16 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-dfa98f28-a27d-495c-8798-ff658f4069f6 tempest-SnapshotsActionsTest-1932493596 None] Acquiring lock "cinder-quobyte-837ef147-e20a-46b2-885c-e51518a48b99" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:11:16 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-dfa98f28-a27d-495c-8798-ff658f4069f6 tempest-SnapshotsActionsTest-1932493596 None] Lock "cinder-quobyte-837ef147-e20a-46b2-885c-e51518a48b99" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:11:16 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-dfa98f28-a27d-495c-8798-ff658f4069f6 tempest-SnapshotsActionsTest-1932493596 None] Deleting offline snapshot 837ef147-e20a-46b2-885c-e51518a48b99 of volume 553dbd22-1dba-473d-aef7-c5510ab60c55 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:11:16 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-dfa98f28-a27d-495c-8798-ff658f4069f6 tempest-SnapshotsActionsTest-1932493596 None] snapshot_file for this snap is: volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:11:16 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c30bc1-8de3-4167-9b55-825454fd4c58]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:11:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dfa98f28-a27d-495c-8798-ff658f4069f6 tempest-SnapshotsActionsTest-1932493596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:11:16 devstack sudo[90869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99
Nov 04 12:11:16 devstack sudo[90869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:11:16 devstack sudo[90869]: pam_unix(sudo:session): session closed for user root
Nov 04 12:11:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dfa98f28-a27d-495c-8798-ff658f4069f6 tempest-SnapshotsActionsTest-1932493596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99" returned: 0 in 0.440s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:11:16 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-dfa98f28-a27d-495c-8798-ff658f4069f6 tempest-SnapshotsActionsTest-1932493596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-553dbd22-1dba-473d-aef7-c5510ab60c55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:11:16 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[a531af34-4218-411d-b4db-1a866dc8e4ba]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:11:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dfa98f28-a27d-495c-8798-ff658f4069f6 tempest-SnapshotsActionsTest-1932493596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:11:16 devstack sudo[90876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55
Nov 04 12:11:16 devstack sudo[90876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:11:17 devstack sudo[90876]: pam_unix(sudo:session): session closed for user root
Nov 04 12:11:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dfa98f28-a27d-495c-8798-ff658f4069f6 tempest-SnapshotsActionsTest-1932493596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55" returned: 0 in 0.594s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:11:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dfa98f28-a27d-495c-8798-ff658f4069f6 tempest-SnapshotsActionsTest-1932493596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:11:17 devstack sudo[90899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99
Nov 04 12:11:17 devstack sudo[90899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:11:17 devstack sudo[90899]: pam_unix(sudo:session): session closed for user root
Nov 04 12:11:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dfa98f28-a27d-495c-8798-ff658f4069f6 tempest-SnapshotsActionsTest-1932493596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99" returned: 0 in 0.457s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:11:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dfa98f28-a27d-495c-8798-ff658f4069f6 tempest-SnapshotsActionsTest-1932493596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:11:17 devstack sudo[90906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99
Nov 04 12:11:17 devstack sudo[90906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:11:17 devstack sudo[90906]: pam_unix(sudo:session): session closed for user root
Nov 04 12:11:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dfa98f28-a27d-495c-8798-ff658f4069f6 tempest-SnapshotsActionsTest-1932493596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55.837ef147-e20a-46b2-885c-e51518a48b99" returned: 0 in 0.308s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:11:17 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-dfa98f28-a27d-495c-8798-ff658f4069f6 tempest-SnapshotsActionsTest-1932493596 None] Lock "cinder-quobyte-837ef147-e20a-46b2-885c-e51518a48b99" released by "_delete_snapshot" :: held 1.961s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:11:17 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-dfa98f28-a27d-495c-8798-ff658f4069f6 tempest-SnapshotsActionsTest-1932493596 None] Lock "cinder-quobyte-553dbd22-1dba-473d-aef7-c5510ab60c55" released by "delete_snapshot" :: held 1.989s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:11:18 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-dfa98f28-a27d-495c-8798-ff658f4069f6 tempest-SnapshotsActionsTest-1932493596 None] Created reservations ['db094cd4-fe0e-42b9-82f6-33fc3b9d2281', '65ee97da-7f65-4acc-98e5-dfa90b31a0cf', '368aa83b-fd88-4546-9816-dd26fce45b89', '335e6cf8-1682-4888-bf37-0ccd7c22ff41'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:11:18 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-dfa98f28-a27d-495c-8798-ff658f4069f6 tempest-SnapshotsActionsTest-1932493596 None] Delete snapshot completed successfully.
Nov 04 12:11:18 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-dfa98f28-a27d-495c-8798-ff658f4069f6 tempest-SnapshotsActionsTest-1932493596 None] Lock "cinder-837ef147-e20a-46b2-885c-e51518a48b99-delete_snapshot" released by "delete_snapshot" :: held 2.186s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:11:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-b5810847-1100-4c3e-ab0f-b30f00576d38 tempest-SnapshotsActionsTest-1932493596 None] Acquiring lock "cinder-553dbd22-1dba-473d-aef7-c5510ab60c55-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:11:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-b5810847-1100-4c3e-ab0f-b30f00576d38 tempest-SnapshotsActionsTest-1932493596 None] Lock "cinder-553dbd22-1dba-473d-aef7-c5510ab60c55-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:11:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-b5810847-1100-4c3e-ab0f-b30f00576d38 tempest-SnapshotsActionsTest-1932493596 None] Acquiring lock "cinder-quobyte-553dbd22-1dba-473d-aef7-c5510ab60c55" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:11:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-b5810847-1100-4c3e-ab0f-b30f00576d38 tempest-SnapshotsActionsTest-1932493596 None] Lock "cinder-quobyte-553dbd22-1dba-473d-aef7-c5510ab60c55" acquired by "delete_volume" :: waited 0.022s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:11:19 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ded123a-73f9-48b7-bf3c-a3706192ddcc]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:11:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b5810847-1100-4c3e-ab0f-b30f00576d38 tempest-SnapshotsActionsTest-1932493596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:11:19 devstack sudo[90936]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55
Nov 04 12:11:19 devstack sudo[90936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:11:19 devstack sudo[90936]: pam_unix(sudo:session): session closed for user root
Nov 04 12:11:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b5810847-1100-4c3e-ab0f-b30f00576d38 tempest-SnapshotsActionsTest-1932493596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55" returned: 0 in 0.488s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:11:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b5810847-1100-4c3e-ab0f-b30f00576d38 tempest-SnapshotsActionsTest-1932493596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:11:19 devstack sudo[90947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55
Nov 04 12:11:19 devstack sudo[90947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:11:20 devstack sudo[90947]: pam_unix(sudo:session): session closed for user root
Nov 04 12:11:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b5810847-1100-4c3e-ab0f-b30f00576d38 tempest-SnapshotsActionsTest-1932493596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553dbd22-1dba-473d-aef7-c5510ab60c55" returned: 0 in 0.308s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:11:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-b5810847-1100-4c3e-ab0f-b30f00576d38 tempest-SnapshotsActionsTest-1932493596 None] Lock "cinder-quobyte-553dbd22-1dba-473d-aef7-c5510ab60c55" released by "delete_volume" :: held 0.927s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:11:20 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-b5810847-1100-4c3e-ab0f-b30f00576d38 tempest-SnapshotsActionsTest-1932493596 None] Created reservations ['2e146c94-0c7c-4456-910f-2094b83a6e42', '315b8411-b207-48e7-b17c-ed3a25e32cc1', '02ceaaf0-8dc1-4a53-ba26-d1adb813b7a9', 'eaadef29-c50d-4dfe-b261-a084a14d0fb8'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:11:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b5810847-1100-4c3e-ab0f-b30f00576d38 tempest-SnapshotsActionsTest-1932493596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:11:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b5810847-1100-4c3e-ab0f-b30f00576d38 tempest-SnapshotsActionsTest-1932493596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:11:20 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-b5810847-1100-4c3e-ab0f-b30f00576d38 tempest-SnapshotsActionsTest-1932493596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:11:20 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-b5810847-1100-4c3e-ab0f-b30f00576d38 tempest-SnapshotsActionsTest-1932493596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:11:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b5810847-1100-4c3e-ab0f-b30f00576d38 tempest-SnapshotsActionsTest-1932493596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:11:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b5810847-1100-4c3e-ab0f-b30f00576d38 tempest-SnapshotsActionsTest-1932493596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:11:20 devstack sudo[90972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:11:20 devstack sudo[90972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:11:20 devstack sudo[90972]: pam_unix(sudo:session): session closed for user root
Nov 04 12:11:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b5810847-1100-4c3e-ab0f-b30f00576d38 tempest-SnapshotsActionsTest-1932493596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.295s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:11:20 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-b5810847-1100-4c3e-ab0f-b30f00576d38 tempest-SnapshotsActionsTest-1932493596 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:11:20 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-b5810847-1100-4c3e-ab0f-b30f00576d38 tempest-SnapshotsActionsTest-1932493596 None] Deleted volume successfully.
Nov 04 12:11:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-b5810847-1100-4c3e-ab0f-b30f00576d38 tempest-SnapshotsActionsTest-1932493596 None] Lock "cinder-553dbd22-1dba-473d-aef7-c5510ab60c55-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:11:26 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-168e9218-0dee-476e-8185-404a99372a0c req-939c29fc-1d34-4072-b7c5-669a02977a03 tempest-ServerActionsTestOtherA-305064589 None] Terminate volume connection completed successfully.
Nov 04 12:11:26 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-168e9218-0dee-476e-8185-404a99372a0c req-939c29fc-1d34-4072-b7c5-669a02977a03 tempest-ServerActionsTestOtherA-305064589 None] Deleting attachment 41f90f13-1704-4835-96c8-f45a7aac0657. {{(pid=87169) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 12:11:29 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-70e423b6-b262-4471-b818-4d3a8bda6830 tempest-TaggedAttachmentsTest-1045611021 None] Acquiring lock "cinder-24a09c34-80ce-4097-8b66-49440332af12-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:11:29 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-70e423b6-b262-4471-b818-4d3a8bda6830 tempest-TaggedAttachmentsTest-1045611021 None] Lock "cinder-24a09c34-80ce-4097-8b66-49440332af12-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:11:29 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-70e423b6-b262-4471-b818-4d3a8bda6830 tempest-TaggedAttachmentsTest-1045611021 None] Acquiring lock "cinder-quobyte-24a09c34-80ce-4097-8b66-49440332af12" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:11:29 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-70e423b6-b262-4471-b818-4d3a8bda6830 tempest-TaggedAttachmentsTest-1045611021 None] Lock "cinder-quobyte-24a09c34-80ce-4097-8b66-49440332af12" acquired by "delete_volume" :: waited 0.043s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:11:29 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e6c90f-9beb-49e6-969d-aa2403c85650]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:11:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-70e423b6-b262-4471-b818-4d3a8bda6830 tempest-TaggedAttachmentsTest-1045611021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-24a09c34-80ce-4097-8b66-49440332af12 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:11:29 devstack sudo[91135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-24a09c34-80ce-4097-8b66-49440332af12
Nov 04 12:11:29 devstack sudo[91135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:11:30 devstack sudo[91135]: pam_unix(sudo:session): session closed for user root
Nov 04 12:11:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-70e423b6-b262-4471-b818-4d3a8bda6830 tempest-TaggedAttachmentsTest-1045611021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-24a09c34-80ce-4097-8b66-49440332af12" returned: 0 in 0.597s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:11:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-70e423b6-b262-4471-b818-4d3a8bda6830 tempest-TaggedAttachmentsTest-1045611021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-24a09c34-80ce-4097-8b66-49440332af12 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:11:30 devstack sudo[91142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-24a09c34-80ce-4097-8b66-49440332af12
Nov 04 12:11:30 devstack sudo[91142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:11:30 devstack sudo[91142]: pam_unix(sudo:session): session closed for user root
Nov 04 12:11:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-70e423b6-b262-4471-b818-4d3a8bda6830 tempest-TaggedAttachmentsTest-1045611021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-24a09c34-80ce-4097-8b66-49440332af12" returned: 0 in 0.464s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:11:30 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-70e423b6-b262-4471-b818-4d3a8bda6830 tempest-TaggedAttachmentsTest-1045611021 None] Lock "cinder-quobyte-24a09c34-80ce-4097-8b66-49440332af12" released by "delete_volume" :: held 1.210s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:11:30 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-70e423b6-b262-4471-b818-4d3a8bda6830 tempest-TaggedAttachmentsTest-1045611021 None] Created reservations ['927925f3-fb80-4818-a1b7-d22b945b554b', '3d9b4e6b-8262-421b-a98a-6ec46870469e', '632adc74-af83-492d-81c8-f271c25e7b71', '137ffe1e-a9b1-47fe-acd6-8f6ca3427dae'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:11:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-70e423b6-b262-4471-b818-4d3a8bda6830 tempest-TaggedAttachmentsTest-1045611021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:11:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-70e423b6-b262-4471-b818-4d3a8bda6830 tempest-TaggedAttachmentsTest-1045611021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:11:30 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-70e423b6-b262-4471-b818-4d3a8bda6830 tempest-TaggedAttachmentsTest-1045611021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:11:30 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-70e423b6-b262-4471-b818-4d3a8bda6830 tempest-TaggedAttachmentsTest-1045611021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:11:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-70e423b6-b262-4471-b818-4d3a8bda6830 tempest-TaggedAttachmentsTest-1045611021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:11:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-70e423b6-b262-4471-b818-4d3a8bda6830 tempest-TaggedAttachmentsTest-1045611021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:11:30 devstack sudo[91147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:11:30 devstack sudo[91147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:11:31 devstack sudo[91147]: pam_unix(sudo:session): session closed for user root
Nov 04 12:11:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-70e423b6-b262-4471-b818-4d3a8bda6830 tempest-TaggedAttachmentsTest-1045611021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.707s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:11:31 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-70e423b6-b262-4471-b818-4d3a8bda6830 tempest-TaggedAttachmentsTest-1045611021 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:11:31 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-70e423b6-b262-4471-b818-4d3a8bda6830 tempest-TaggedAttachmentsTest-1045611021 None] Deleted volume successfully.
Nov 04 12:11:31 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-70e423b6-b262-4471-b818-4d3a8bda6830 tempest-TaggedAttachmentsTest-1045611021 None] Lock "cinder-24a09c34-80ce-4097-8b66-49440332af12-delete_volume" released by "delete_volume" :: held 2.321s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:11:37 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:11:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Flow 'volume_create_manager' (692e1846-c9bc-4238-9d4a-4c45a9bdd118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:11:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30964779-5d26-4d66-bc23-342c2b094b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:11:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30964779-5d26-4d66-bc23-342c2b094b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1900209188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78be41c1-7d28-42a5-a634-93f9fe38711a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c85b50ad66324f12b075d197014a3bb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:11:37Z,use_quota=True,user_id='e5083e0eed6a48b49ed0f3e265ab795c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:11:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5172f2af-d737-4cc4-b8cc-2262de5d91a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:11:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5172f2af-d737-4cc4-b8cc-2262de5d91a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:11:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2189d63e-7199-4104-a3fa-a0371ecf9092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:11:37 devstack cinder-volume[87169]: DEBUG cinder.image.glance [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Creating Keystone auth plugin from conf {{(pid=87169) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 04 12:11:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2189d63e-7199-4104-a3fa-a0371ecf9092) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '78be41c1-7d28-42a5-a634-93f9fe38711a', 'volume_name': 'volume-78be41c1-7d28-42a5-a634-93f9fe38711a', 'volume_size': 1, 'image_id': '5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '52d49d1f3a4b47a8a8f060da8e0e2c02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'created_at': datetime.datetime(2026, 11, 4, 11, 3, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 3, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fd6a6ac-1614-4aa5-aedb-17a31996018d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cc063872cf0>}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:11:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e748dca8-7996-4bbe-bfd3-98d33f870f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:11:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e748dca8-7996-4bbe-bfd3-98d33f870f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:11:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14ad5ed7-c08d-468f-b472-7183f80b2f77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:11:37 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Volume 78be41c1-7d28-42a5-a634-93f9fe38711a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-78be41c1-7d28-42a5-a634-93f9fe38711a', 'volume_size': 1, 'image_id': '5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '52d49d1f3a4b47a8a8f060da8e0e2c02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'created_at': datetime.datetime(2026, 11, 4, 11, 3, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 3, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fd6a6ac-1614-4aa5-aedb-17a31996018d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cc063872cf0>}
Nov 04 12:11:37 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Trying to clone 78be41c1-7d28-42a5-a634-93f9fe38711a from image 5fd6a6ac-1614-4aa5-aedb-17a31996018d at location (None, [{'url': 'file:///opt/stack/data/glance/images/5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'metadata': {}}]). {{(pid=87169) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 04 12:11:38 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_o2lqk2gidevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87169) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 04 12:11:38 devstack cinder-volume[87169]: INFO cinder.image.image_utils [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Image download 20.69 MB at 20.69 MB/s
Nov 04 12:11:38 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06984e7-b7cd-4211-820e-61c81687562d]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:11:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_o2lqk2gidevstack@QuobyteHD {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:11:38 devstack sudo[91185]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_o2lqk2gidevstack@QuobyteHD
Nov 04 12:11:38 devstack sudo[91185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:11:38 devstack sudo[91185]: pam_unix(sudo:session): session closed for user root
Nov 04 12:11:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_o2lqk2gidevstack@QuobyteHD" returned: 0 in 0.478s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:11:38 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Temporary image 5fd6a6ac-1614-4aa5-aedb-17a31996018d is fetched for user e5083e0eed6a48b49ed0f3e265ab795c. {{(pid=87169) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 04 12:11:38 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f245a8a-d068-4669-8304-342970562b01]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:11:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_o2lqk2gidevstack@QuobyteHD {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:11:39 devstack sudo[91191]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_o2lqk2gidevstack@QuobyteHD
Nov 04 12:11:39 devstack sudo[91191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:11:39 devstack sudo[91191]: pam_unix(sudo:session): session closed for user root
Nov 04 12:11:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_o2lqk2gidevstack@QuobyteHD" returned: 0 in 0.443s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:11:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:11:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:11:39 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:11:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1900209188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78be41c1-7d28-42a5-a634-93f9fe38711a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c85b50ad66324f12b075d197014a3bb3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:11:37Z,use_quota=True,user_id='e5083e0eed6a48b49ed0f3e265ab795c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:11:39 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Creating volume 78be41c1-7d28-42a5-a634-93f9fe38711a {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:11:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:11:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:11:39 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:11:39 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:11:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:11:39 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:11:39 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:11:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-78be41c1-7d28-42a5-a634-93f9fe38711a 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:11:39 devstack sudo[91197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-78be41c1-7d28-42a5-a634-93f9fe38711a 1073741824
Nov 04 12:11:39 devstack sudo[91197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:11:40 devstack sudo[91197]: pam_unix(sudo:session): session closed for user root
Nov 04 12:11:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-78be41c1-7d28-42a5-a634-93f9fe38711a 1073741824" returned: 0 in 0.638s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:11:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-78be41c1-7d28-42a5-a634-93f9fe38711a {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:11:40 devstack sudo[91203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-78be41c1-7d28-42a5-a634-93f9fe38711a
Nov 04 12:11:40 devstack sudo[91203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:11:40 devstack sudo[91203]: pam_unix(sudo:session): session closed for user root
Nov 04 12:11:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-78be41c1-7d28-42a5-a634-93f9fe38711a" returned: 0 in 0.378s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:11:40 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:11:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:11:40 devstack cinder-volume[87169]: DEBUG cinder.volume.volume_utils [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Attempting download of 5fd6a6ac-1614-4aa5-aedb-17a31996018d ((None, [{'url': 'file:///opt/stack/data/glance/images/5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'metadata': {}}])) to volume 78be41c1-7d28-42a5-a634-93f9fe38711a. {{(pid=87169) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 04 12:11:40 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e51283a-8316-433a-b8b7-edd1f8425714]: (4, 'raw') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:11:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fd6a6ac-1614-4aa5-aedb-17a31996018d_rddi_uto {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:11:40 devstack sudo[91230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fd6a6ac-1614-4aa5-aedb-17a31996018d_rddi_uto
Nov 04 12:11:40 devstack sudo[91230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:11:40 devstack sudo[91230]: pam_unix(sudo:session): session closed for user root
Nov 04 12:11:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fd6a6ac-1614-4aa5-aedb-17a31996018d_rddi_uto" returned: 0 in 0.397s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:11:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fd6a6ac-1614-4aa5-aedb-17a31996018d_rddi_uto {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:11:41 devstack sudo[91234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fd6a6ac-1614-4aa5-aedb-17a31996018d_rddi_uto
Nov 04 12:11:41 devstack sudo[91234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:11:41 devstack sudo[91234]: pam_unix(sudo:session): session closed for user root
Nov 04 12:11:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fd6a6ac-1614-4aa5-aedb-17a31996018d_rddi_uto" returned: 1 in 0.377s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:11:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fd6a6ac-1614-4aa5-aedb-17a31996018d_rddi_uto' failed. Not Retrying. {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 12:11:41 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[f452fa1e-914e-4f50-83c2-6f5b93ff3b97]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:11:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_o2lqk2gidevstack@QuobyteHD {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:11:41 devstack sudo[91239]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_o2lqk2gidevstack@QuobyteHD
Nov 04 12:11:41 devstack sudo[91239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:11:41 devstack sudo[91239]: pam_unix(sudo:session): session closed for user root
Nov 04 12:11:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_o2lqk2gidevstack@QuobyteHD" returned: 0 in 0.376s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:11:41 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] 5fd6a6ac-1614-4aa5-aedb-17a31996018d was qcow2, converting to qcow2 {{(pid=87169) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 04 12:11:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_o2lqk2gidevstack@QuobyteHD /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-78be41c1-7d28-42a5-a634-93f9fe38711a {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:11:41 devstack sudo[91244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_o2lqk2gidevstack@QuobyteHD /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-78be41c1-7d28-42a5-a634-93f9fe38711a
Nov 04 12:11:41 devstack sudo[91244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:11:44 devstack sudo[91244]: pam_unix(sudo:session): session closed for user root
Nov 04 12:11:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_o2lqk2gidevstack@QuobyteHD /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-78be41c1-7d28-42a5-a634-93f9fe38711a" returned: 0 in 2.290s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:11:44 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_o2lqk2gidevstack@QuobyteHD, size 112.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-78be41c1-7d28-42a5-a634-93f9fe38711a {{(pid=87169) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 12:11:44 devstack cinder-volume[87169]: INFO cinder.image.image_utils [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Converted 112.00 MB image at 48.88 MB/s
Nov 04 12:11:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-78be41c1-7d28-42a5-a634-93f9fe38711a 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:11:44 devstack sudo[91253]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-78be41c1-7d28-42a5-a634-93f9fe38711a 1G
Nov 04 12:11:44 devstack sudo[91253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:11:44 devstack sudo[91253]: pam_unix(sudo:session): session closed for user root
Nov 04 12:11:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-78be41c1-7d28-42a5-a634-93f9fe38711a 1G" returned: 0 in 0.400s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:11:44 devstack cinder-volume[87169]: DEBUG cinder.volume.volume_utils [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Downloaded image 5fd6a6ac-1614-4aa5-aedb-17a31996018d ((None, [{'url': 'file:///opt/stack/data/glance/images/5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'metadata': {}}])) to volume 78be41c1-7d28-42a5-a634-93f9fe38711a successfully. {{(pid=87169) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 04 12:11:44 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Temporary image 5fd6a6ac-1614-4aa5-aedb-17a31996018d for user e5083e0eed6a48b49ed0f3e265ab795c is deleted. {{(pid=87169) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 04 12:11:44 devstack cinder-volume[87169]: DEBUG cinder.volume.volume_utils [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Marking volume 78be41c1-7d28-42a5-a634-93f9fe38711a as bootable. {{(pid=87169) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 04 12:11:44 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Copying metadata from image 5fd6a6ac-1614-4aa5-aedb-17a31996018d to 78be41c1-7d28-42a5-a634-93f9fe38711a. {{(pid=87169) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 04 12:11:44 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Creating volume glance metadata for volume 78be41c1-7d28-42a5-a634-93f9fe38711a backed by image 5fd6a6ac-1614-4aa5-aedb-17a31996018d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87169) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 04 12:11:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14ad5ed7-c08d-468f-b472-7183f80b2f77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78be41c1-7d28-42a5-a634-93f9fe38711a', 'volume_size': 1, 'image_id': '5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '52d49d1f3a4b47a8a8f060da8e0e2c02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'created_at': datetime.datetime(2026, 11, 4, 11, 3, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 3, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fd6a6ac-1614-4aa5-aedb-17a31996018d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cc063872cf0>}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:11:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82140e69-50aa-463d-ac6f-521d41971fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:11:44 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Volume volume-78be41c1-7d28-42a5-a634-93f9fe38711a (78be41c1-7d28-42a5-a634-93f9fe38711a): created successfully
Nov 04 12:11:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82140e69-50aa-463d-ac6f-521d41971fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:11:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Flow 'volume_create_manager' (692e1846-c9bc-4238-9d4a-4c45a9bdd118) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:11:44 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-2ee12242-b373-441c-b19e-15effc7c046a tempest-ServerActionsTestOtherA-305064589 None] Created volume successfully.
Nov 04 12:11:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-a34b5747-8998-48e2-a458-e7bcb390cd90 req-6518b15c-469b-44c8-a1cd-d9ec6d3c3044 tempest-ServerActionsTestOtherA-305064589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:11:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-a34b5747-8998-48e2-a458-e7bcb390cd90 req-6518b15c-469b-44c8-a1cd-d9ec6d3c3044 tempest-ServerActionsTestOtherA-305064589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:11:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-a34b5747-8998-48e2-a458-e7bcb390cd90 req-6518b15c-469b-44c8-a1cd-d9ec6d3c3044 tempest-ServerActionsTestOtherA-305064589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.042s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:11:48 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-a34b5747-8998-48e2-a458-e7bcb390cd90 req-6518b15c-469b-44c8-a1cd-d9ec6d3c3044 tempest-ServerActionsTestOtherA-305064589 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79', 'name': 'volume-78be41c1-7d28-42a5-a634-93f9fe38711a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a9b7a0fc-4935-40ed-be96-be1e47df2bf9', 'enforce_multipath': True} {{(pid=87169) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 04 12:11:49 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-a34b5747-8998-48e2-a458-e7bcb390cd90 req-6518b15c-469b-44c8-a1cd-d9ec6d3c3044 tempest-ServerActionsTestOtherA-305064589 None] attachment_update completed successfully.
Nov 04 12:11:49 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:11:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:11:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:11:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:11:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:11:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:11:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:11:49 devstack sudo[91273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:11:49 devstack sudo[91273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:11:50 devstack sudo[91273]: pam_unix(sudo:session): session closed for user root
Nov 04 12:11:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.387s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:11:50 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:11:50 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager._thread_info {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:11:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread count: 28 {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 12:11:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread info: [<_MainThread(MainThread, started 137165867425920)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137165754678912)>, <Thread(Thread-3 (stat_writer), started daemon 137165754130752)>, <Thread(Rabbit-heartbeat, started daemon 137165752997504)>, <Thread(Thread-5 (_runner), started daemon 137165753227712)>, <Thread(Thread-7 (_runner), started daemon 137165751273856)>, <Thread(fd_logger, started daemon 137165755322048)>, <Thread(privsep_reader, started daemon 137165748896704)>, <Thread(tpool_thread_0, started daemon 137165742520000)>, <Thread(tpool_thread_1, started daemon 137165734127296)>, <Thread(tpool_thread_2, started daemon 137165725734592)>, <Thread(tpool_thread_3, started daemon 137165717341888)>, <Thread(tpool_thread_4, started daemon 137165708949184)>, <Thread(tpool_thread_5, started daemon 137165700556480)>, <Thread(tpool_thread_6, started daemon 137165692163776)>, <Thread(tpool_thread_7, started daemon 137165683771072)>, <Thread(tpool_thread_8, started daemon 137165675378368)>, <Thread(tpool_thread_9, started daemon 137165666985664)>, <Thread(tpool_thread_10, started daemon 137165658592960)>, <Thread(tpool_thread_11, started daemon 137165650183872)>, <Thread(tpool_thread_12, started daemon 137165641774784)>, <Thread(tpool_thread_13, started daemon 137165633365696)>, <Thread(tpool_thread_14, started daemon 137165624956608)>, <Thread(tpool_thread_15, started daemon 137165616547520)>, <Thread(tpool_thread_16, started daemon 137165608138432)>, <Thread(tpool_thread_17, started daemon 137165599729344)>, <Thread(tpool_thread_18, started daemon 137165591320256)>, <Thread(tpool_thread_19, started daemon 137165582911168)>] {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 12:11:51 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-cd51411e-5bef-4908-955f-2c8a16bb9676 tempest-GroupSnapshotsTest-581803404 None] Group tempest-GroupSnapshotsTest-Group-775317482: creating
Nov 04 12:11:51 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-cd51411e-5bef-4908-955f-2c8a16bb9676 tempest-GroupSnapshotsTest-581803404 None] Group tempest-GroupSnapshotsTest-Group-775317482: created successfully
Nov 04 12:11:51 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-cd51411e-5bef-4908-955f-2c8a16bb9676 tempest-GroupSnapshotsTest-581803404 None] Create group completed successfully.
Nov 04 12:11:53 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d0d0e69-626b-4eab-a05c-36544999d200 tempest-GroupSnapshotsTest-581803404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:11:53 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8d0d0e69-626b-4eab-a05c-36544999d200 tempest-GroupSnapshotsTest-581803404 None] Flow 'volume_create_manager' (ab5e6e51-2b3d-4b97-adfd-1c6ce8ca7aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:11:53 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8d0d0e69-626b-4eab-a05c-36544999d200 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c3e2215-9f92-4da3-9701-49742c615d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:11:53 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8d0d0e69-626b-4eab-a05c-36544999d200 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c3e2215-9f92-4da3-9701-49742c615d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-296199412',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=27ab0d1a-57cc-46b4-b47b-38550eabc6ad,host='devstack@QuobyteHD#QuobyteHD',id=3931cba2-3a94-4dbb-9e6c-aafe279e300c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18239611c6334bd99f08b0d276e50538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:11:53Z,use_quota=True,user_id='b56985e97bbe4ea7a2a67e3e9becd36e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0da3d0eb-5d20-43ee-9ae6-4a6011ba47cb),volume_type_id=0da3d0eb-5d20-43ee-9ae6-4a6011ba47cb)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:11:53 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8d0d0e69-626b-4eab-a05c-36544999d200 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2142fbd-0a06-48f4-9d25-c1875232c7c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:11:53 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8d0d0e69-626b-4eab-a05c-36544999d200 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2142fbd-0a06-48f4-9d25-c1875232c7c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:11:53 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8d0d0e69-626b-4eab-a05c-36544999d200 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45142116-bda9-49cb-a2ae-fca49e693a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:11:53 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8d0d0e69-626b-4eab-a05c-36544999d200 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45142116-bda9-49cb-a2ae-fca49e693a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3931cba2-3a94-4dbb-9e6c-aafe279e300c', 'volume_name': 'volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:11:53 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8d0d0e69-626b-4eab-a05c-36544999d200 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (830a9d71-8995-4bc4-8c00-bb2e8725b171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:11:53 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8d0d0e69-626b-4eab-a05c-36544999d200 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (830a9d71-8995-4bc4-8c00-bb2e8725b171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:11:53 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8d0d0e69-626b-4eab-a05c-36544999d200 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e8726f3-4ba3-4eb6-b69d-091e1fc5e7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:11:53 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-8d0d0e69-626b-4eab-a05c-36544999d200 tempest-GroupSnapshotsTest-581803404 None] Volume 3931cba2-3a94-4dbb-9e6c-aafe279e300c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c', 'volume_size': 1}
Nov 04 12:11:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8d0d0e69-626b-4eab-a05c-36544999d200 tempest-GroupSnapshotsTest-581803404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:11:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8d0d0e69-626b-4eab-a05c-36544999d200 tempest-GroupSnapshotsTest-581803404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:11:53 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-8d0d0e69-626b-4eab-a05c-36544999d200 tempest-GroupSnapshotsTest-581803404 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=27ab0d1a-57cc-46b4-b47b-38550eabc6ad,created_at=2026-11-04T11:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-296199412',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=27ab0d1a-57cc-46b4-b47b-38550eabc6ad,host='devstack@QuobyteHD#QuobyteHD',id=3931cba2-3a94-4dbb-9e6c-aafe279e300c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18239611c6334bd99f08b0d276e50538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:11:53Z,use_quota=True,user_id='b56985e97bbe4ea7a2a67e3e9becd36e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0da3d0eb-5d20-43ee-9ae6-4a6011ba47cb),volume_type_id=0da3d0eb-5d20-43ee-9ae6-4a6011ba47cb)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:11:53 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-8d0d0e69-626b-4eab-a05c-36544999d200 tempest-GroupSnapshotsTest-581803404 None] Creating volume 3931cba2-3a94-4dbb-9e6c-aafe279e300c {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:11:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8d0d0e69-626b-4eab-a05c-36544999d200 tempest-GroupSnapshotsTest-581803404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:11:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8d0d0e69-626b-4eab-a05c-36544999d200 tempest-GroupSnapshotsTest-581803404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:11:53 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-8d0d0e69-626b-4eab-a05c-36544999d200 tempest-GroupSnapshotsTest-581803404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:11:53 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-8d0d0e69-626b-4eab-a05c-36544999d200 tempest-GroupSnapshotsTest-581803404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:11:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8d0d0e69-626b-4eab-a05c-36544999d200 tempest-GroupSnapshotsTest-581803404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:11:53 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-8d0d0e69-626b-4eab-a05c-36544999d200 tempest-GroupSnapshotsTest-581803404 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:11:53 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-8d0d0e69-626b-4eab-a05c-36544999d200 tempest-GroupSnapshotsTest-581803404 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:11:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8d0d0e69-626b-4eab-a05c-36544999d200 tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:11:53 devstack sudo[91735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c 1073741824
Nov 04 12:11:53 devstack sudo[91735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:11:53 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-15292372-5d96-420a-8ef6-439fba16be25 tempest-AttachVolumeShelveTestJSON-907729002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:11:53 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-15292372-5d96-420a-8ef6-439fba16be25 tempest-AttachVolumeShelveTestJSON-907729002 None] Flow 'volume_create_manager' (634e4a52-4650-4628-9385-db918fbfcc98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:11:53 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-15292372-5d96-420a-8ef6-439fba16be25 tempest-AttachVolumeShelveTestJSON-907729002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99d0a893-a3e9-4b61-9919-72a5e44cb1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:11:53 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-15292372-5d96-420a-8ef6-439fba16be25 tempest-AttachVolumeShelveTestJSON-907729002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99d0a893-a3e9-4b61-9919-72a5e44cb1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1916391824',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9bc7f83-0fc7-410e-bfda-2d0cc5d4054b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86bd54d656db4cf6b9f5ca3cbf6e13e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:11:54Z,use_quota=True,user_id='c64920545eed4aac8bccf4949d095a2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:11:53 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-15292372-5d96-420a-8ef6-439fba16be25 tempest-AttachVolumeShelveTestJSON-907729002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27780527-a918-4ffb-bd62-a59c8ccd8560) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:11:53 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-15292372-5d96-420a-8ef6-439fba16be25 tempest-AttachVolumeShelveTestJSON-907729002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27780527-a918-4ffb-bd62-a59c8ccd8560) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:11:53 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-15292372-5d96-420a-8ef6-439fba16be25 tempest-AttachVolumeShelveTestJSON-907729002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c04281e-4813-49da-b2db-5470d9f2ef78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:11:53 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-15292372-5d96-420a-8ef6-439fba16be25 tempest-AttachVolumeShelveTestJSON-907729002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c04281e-4813-49da-b2db-5470d9f2ef78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9bc7f83-0fc7-410e-bfda-2d0cc5d4054b', 'volume_name': 'volume-a9bc7f83-0fc7-410e-bfda-2d0cc5d4054b', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:11:53 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-15292372-5d96-420a-8ef6-439fba16be25 tempest-AttachVolumeShelveTestJSON-907729002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99e5105f-b5d5-4386-9364-63f4a6fb18a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:11:53 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-15292372-5d96-420a-8ef6-439fba16be25 tempest-AttachVolumeShelveTestJSON-907729002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99e5105f-b5d5-4386-9364-63f4a6fb18a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:11:53 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-15292372-5d96-420a-8ef6-439fba16be25 tempest-AttachVolumeShelveTestJSON-907729002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (364410b6-36c7-4d42-8533-8262e01d6d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:11:53 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-15292372-5d96-420a-8ef6-439fba16be25 tempest-AttachVolumeShelveTestJSON-907729002 None] Volume a9bc7f83-0fc7-410e-bfda-2d0cc5d4054b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9bc7f83-0fc7-410e-bfda-2d0cc5d4054b', 'volume_size': 1}
Nov 04 12:11:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-15292372-5d96-420a-8ef6-439fba16be25 tempest-AttachVolumeShelveTestJSON-907729002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:11:54 devstack sudo[91735]: pam_unix(sudo:session): session closed for user root
Nov 04 12:11:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8d0d0e69-626b-4eab-a05c-36544999d200 tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c 1073741824" returned: 0 in 0.905s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:11:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8d0d0e69-626b-4eab-a05c-36544999d200 tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:11:54 devstack sudo[91757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c
Nov 04 12:11:54 devstack sudo[91757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:11:54 devstack sudo[91757]: pam_unix(sudo:session): session closed for user root
Nov 04 12:11:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8d0d0e69-626b-4eab-a05c-36544999d200 tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c" returned: 0 in 0.407s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:11:54 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-8d0d0e69-626b-4eab-a05c-36544999d200 tempest-GroupSnapshotsTest-581803404 None] <== create_volume: return (1431ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:11:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8d0d0e69-626b-4eab-a05c-36544999d200 tempest-GroupSnapshotsTest-581803404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.435s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:11:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-15292372-5d96-420a-8ef6-439fba16be25 tempest-AttachVolumeShelveTestJSON-907729002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.155s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:11:54 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-15292372-5d96-420a-8ef6-439fba16be25 tempest-AttachVolumeShelveTestJSON-907729002 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1916391824',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9bc7f83-0fc7-410e-bfda-2d0cc5d4054b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86bd54d656db4cf6b9f5ca3cbf6e13e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:11:54Z,use_quota=True,user_id='c64920545eed4aac8bccf4949d095a2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:11:54 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-15292372-5d96-420a-8ef6-439fba16be25 tempest-AttachVolumeShelveTestJSON-907729002 None] Creating volume a9bc7f83-0fc7-410e-bfda-2d0cc5d4054b {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:11:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-15292372-5d96-420a-8ef6-439fba16be25 tempest-AttachVolumeShelveTestJSON-907729002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:11:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-15292372-5d96-420a-8ef6-439fba16be25 tempest-AttachVolumeShelveTestJSON-907729002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:11:54 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-15292372-5d96-420a-8ef6-439fba16be25 tempest-AttachVolumeShelveTestJSON-907729002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:11:54 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-15292372-5d96-420a-8ef6-439fba16be25 tempest-AttachVolumeShelveTestJSON-907729002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:11:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-15292372-5d96-420a-8ef6-439fba16be25 tempest-AttachVolumeShelveTestJSON-907729002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:11:54 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-15292372-5d96-420a-8ef6-439fba16be25 tempest-AttachVolumeShelveTestJSON-907729002 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:11:54 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-15292372-5d96-420a-8ef6-439fba16be25 tempest-AttachVolumeShelveTestJSON-907729002 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:11:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-15292372-5d96-420a-8ef6-439fba16be25 tempest-AttachVolumeShelveTestJSON-907729002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a9bc7f83-0fc7-410e-bfda-2d0cc5d4054b 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:11:55 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8d0d0e69-626b-4eab-a05c-36544999d200 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e8726f3-4ba3-4eb6-b69d-091e1fc5e7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:11:55 devstack sudo[91762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a9bc7f83-0fc7-410e-bfda-2d0cc5d4054b 1073741824
Nov 04 12:11:55 devstack sudo[91762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:11:55 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8d0d0e69-626b-4eab-a05c-36544999d200 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d05bf890-e0f6-4ded-8515-e227ef072705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:11:55 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-8d0d0e69-626b-4eab-a05c-36544999d200 tempest-GroupSnapshotsTest-581803404 None] Volume volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c (3931cba2-3a94-4dbb-9e6c-aafe279e300c): created successfully
Nov 04 12:11:55 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8d0d0e69-626b-4eab-a05c-36544999d200 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d05bf890-e0f6-4ded-8515-e227ef072705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:11:55 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8d0d0e69-626b-4eab-a05c-36544999d200 tempest-GroupSnapshotsTest-581803404 None] Flow 'volume_create_manager' (ab5e6e51-2b3d-4b97-adfd-1c6ce8ca7aba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:11:55 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-8d0d0e69-626b-4eab-a05c-36544999d200 tempest-GroupSnapshotsTest-581803404 None] Created volume successfully.
Nov 04 12:11:55 devstack sudo[91762]: pam_unix(sudo:session): session closed for user root
Nov 04 12:11:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-15292372-5d96-420a-8ef6-439fba16be25 tempest-AttachVolumeShelveTestJSON-907729002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a9bc7f83-0fc7-410e-bfda-2d0cc5d4054b 1073741824" returned: 0 in 0.742s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:11:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-15292372-5d96-420a-8ef6-439fba16be25 tempest-AttachVolumeShelveTestJSON-907729002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a9bc7f83-0fc7-410e-bfda-2d0cc5d4054b {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:11:55 devstack sudo[91770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a9bc7f83-0fc7-410e-bfda-2d0cc5d4054b
Nov 04 12:11:55 devstack sudo[91770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:11:56 devstack sudo[91770]: pam_unix(sudo:session): session closed for user root
Nov 04 12:11:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-15292372-5d96-420a-8ef6-439fba16be25 tempest-AttachVolumeShelveTestJSON-907729002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a9bc7f83-0fc7-410e-bfda-2d0cc5d4054b" returned: 0 in 0.460s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:11:56 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-15292372-5d96-420a-8ef6-439fba16be25 tempest-AttachVolumeShelveTestJSON-907729002 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:11:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-15292372-5d96-420a-8ef6-439fba16be25 tempest-AttachVolumeShelveTestJSON-907729002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.273s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:11:56 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-15292372-5d96-420a-8ef6-439fba16be25 tempest-AttachVolumeShelveTestJSON-907729002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (364410b6-36c7-4d42-8533-8262e01d6d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9bc7f83-0fc7-410e-bfda-2d0cc5d4054b', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:11:56 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-15292372-5d96-420a-8ef6-439fba16be25 tempest-AttachVolumeShelveTestJSON-907729002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (942f003e-65bf-4c42-a988-3c0a96e4984f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:11:56 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-15292372-5d96-420a-8ef6-439fba16be25 tempest-AttachVolumeShelveTestJSON-907729002 None] Volume volume-a9bc7f83-0fc7-410e-bfda-2d0cc5d4054b (a9bc7f83-0fc7-410e-bfda-2d0cc5d4054b): created successfully
Nov 04 12:11:56 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-15292372-5d96-420a-8ef6-439fba16be25 tempest-AttachVolumeShelveTestJSON-907729002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (942f003e-65bf-4c42-a988-3c0a96e4984f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:11:56 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-15292372-5d96-420a-8ef6-439fba16be25 tempest-AttachVolumeShelveTestJSON-907729002 None] Flow 'volume_create_manager' (634e4a52-4650-4628-9385-db918fbfcc98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:11:56 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-15292372-5d96-420a-8ef6-439fba16be25 tempest-AttachVolumeShelveTestJSON-907729002 None] Created volume successfully.
Nov 04 12:11:56 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-0e39c734-b9d5-4979-aa39-57caee241726 tempest-GroupSnapshotsTest-581803404 None] GroupSnapshot 1fee728a-cd61-4da2-b4a6-2f3c98e6b24f: creating.
Nov 04 12:11:56 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-0e39c734-b9d5-4979-aa39-57caee241726 tempest-GroupSnapshotsTest-581803404 None] Group snapshot 1fee728a-cd61-4da2-b4a6-2f3c98e6b24f: creating. {{(pid=87169) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 04 12:11:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-0e39c734-b9d5-4979-aa39-57caee241726 tempest-GroupSnapshotsTest-581803404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:11:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-0e39c734-b9d5-4979-aa39-57caee241726 tempest-GroupSnapshotsTest-581803404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:11:56 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-0e39c734-b9d5-4979-aa39-57caee241726 tempest-GroupSnapshotsTest-581803404 None] Creating offline snapshot 20f2c5df-ed74-4066-b8e5-0c4f62416d32 of volume 3931cba2-3a94-4dbb-9e6c-aafe279e300c {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:11:56 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a1dafa9-2cfb-47d1-8e88-21543dfaede4]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:11:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0e39c734-b9d5-4979-aa39-57caee241726 tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:11:56 devstack sudo[91773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c
Nov 04 12:11:56 devstack sudo[91773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:11:57 devstack sudo[91773]: pam_unix(sudo:session): session closed for user root
Nov 04 12:11:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0e39c734-b9d5-4979-aa39-57caee241726 tempest-GroupSnapshotsTest-581803404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c" returned: 0 in 0.670s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:11:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0e39c734-b9d5-4979-aa39-57caee241726 tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c.20f2c5df-ed74-4066-b8e5-0c4f62416d32 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:11:57 devstack sudo[91783]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c.20f2c5df-ed74-4066-b8e5-0c4f62416d32 1G
Nov 04 12:11:57 devstack sudo[91783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:11:58 devstack sudo[91783]: pam_unix(sudo:session): session closed for user root
Nov 04 12:11:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0e39c734-b9d5-4979-aa39-57caee241726 tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c.20f2c5df-ed74-4066-b8e5-0c4f62416d32 1G" returned: 0 in 0.807s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:11:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0e39c734-b9d5-4979-aa39-57caee241726 tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c.20f2c5df-ed74-4066-b8e5-0c4f62416d32 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:11:58 devstack sudo[91792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c.20f2c5df-ed74-4066-b8e5-0c4f62416d32
Nov 04 12:11:58 devstack sudo[91792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:11:58 devstack sudo[91792]: pam_unix(sudo:session): session closed for user root
Nov 04 12:11:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0e39c734-b9d5-4979-aa39-57caee241726 tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c.20f2c5df-ed74-4066-b8e5-0c4f62416d32" returned: 0 in 0.612s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:11:58 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-0e39c734-b9d5-4979-aa39-57caee241726 tempest-GroupSnapshotsTest-581803404 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c.20f2c5df-ed74-4066-b8e5-0c4f62416d32 is being set with open permissions: ugo+rw: NotImplementedError
Nov 04 12:11:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0e39c734-b9d5-4979-aa39-57caee241726 tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c.20f2c5df-ed74-4066-b8e5-0c4f62416d32 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:11:58 devstack sudo[91800]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c.20f2c5df-ed74-4066-b8e5-0c4f62416d32
Nov 04 12:11:58 devstack sudo[91800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:11:59 devstack sudo[91800]: pam_unix(sudo:session): session closed for user root
Nov 04 12:11:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0e39c734-b9d5-4979-aa39-57caee241726 tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c.20f2c5df-ed74-4066-b8e5-0c4f62416d32" returned: 0 in 0.507s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:11:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0e39c734-b9d5-4979-aa39-57caee241726 tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:11:59 devstack sudo[91807]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c.info
Nov 04 12:11:59 devstack sudo[91807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:11:59 devstack sudo[91807]: pam_unix(sudo:session): session closed for user root
Nov 04 12:11:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0e39c734-b9d5-4979-aa39-57caee241726 tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c.info" returned: 0 in 0.629s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:11:59 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-0e39c734-b9d5-4979-aa39-57caee241726 tempest-GroupSnapshotsTest-581803404 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 04 12:11:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0e39c734-b9d5-4979-aa39-57caee241726 tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:00 devstack sudo[91813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c.info
Nov 04 12:12:00 devstack sudo[91813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:00 devstack sudo[91813]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0e39c734-b9d5-4979-aa39-57caee241726 tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c.info" returned: 0 in 0.587s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-0e39c734-b9d5-4979-aa39-57caee241726 tempest-GroupSnapshotsTest-581803404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.011s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:12:00 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-0e39c734-b9d5-4979-aa39-57caee241726 tempest-GroupSnapshotsTest-581803404 None] group_snapshot 1fee728a-cd61-4da2-b4a6-2f3c98e6b24f: created successfully
Nov 04 12:12:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e772b46f-c9d3-4455-ab62-464db413bfd1 tempest-GroupSnapshotsTest-581803404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:12:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e772b46f-c9d3-4455-ab62-464db413bfd1 tempest-GroupSnapshotsTest-581803404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:12:02 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e772b46f-c9d3-4455-ab62-464db413bfd1 tempest-GroupSnapshotsTest-581803404 None] Acquiring lock "cinder-quobyte-20f2c5df-ed74-4066-b8e5-0c4f62416d32-719886b2-378c-4e0a-916f-299c9966cbf8" by "_create_volume_from_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:12:02 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e772b46f-c9d3-4455-ab62-464db413bfd1 tempest-GroupSnapshotsTest-581803404 None] Lock "cinder-quobyte-20f2c5df-ed74-4066-b8e5-0c4f62416d32-719886b2-378c-4e0a-916f-299c9966cbf8" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:12:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e772b46f-c9d3-4455-ab62-464db413bfd1 tempest-GroupSnapshotsTest-581803404 None] Creating volume 719886b2-378c-4e0a-916f-299c9966cbf8 from snapshot 20f2c5df-ed74-4066-b8e5-0c4f62416d32 {{(pid=87169) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 04 12:12:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e772b46f-c9d3-4455-ab62-464db413bfd1 tempest-GroupSnapshotsTest-581803404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:12:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e772b46f-c9d3-4455-ab62-464db413bfd1 tempest-GroupSnapshotsTest-581803404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:12:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e772b46f-c9d3-4455-ab62-464db413bfd1 tempest-GroupSnapshotsTest-581803404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:12:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e772b46f-c9d3-4455-ab62-464db413bfd1 tempest-GroupSnapshotsTest-581803404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:12:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e772b46f-c9d3-4455-ab62-464db413bfd1 tempest-GroupSnapshotsTest-581803404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:12:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e772b46f-c9d3-4455-ab62-464db413bfd1 tempest-GroupSnapshotsTest-581803404 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:12:02 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e772b46f-c9d3-4455-ab62-464db413bfd1 tempest-GroupSnapshotsTest-581803404 None] Acquiring lock "cinder-quobyte-719886b2-378c-4e0a-916f-299c9966cbf8" by "_copy_volume_from_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:12:02 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e772b46f-c9d3-4455-ab62-464db413bfd1 tempest-GroupSnapshotsTest-581803404 None] Lock "cinder-quobyte-719886b2-378c-4e0a-916f-299c9966cbf8" acquired by "_copy_volume_from_snapshot" :: waited 0.061s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:12:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e772b46f-c9d3-4455-ab62-464db413bfd1 tempest-GroupSnapshotsTest-581803404 None] snapshot: 20f2c5df-ed74-4066-b8e5-0c4f62416d32, volume: 719886b2-378c-4e0a-916f-299c9966cbf8,  {{(pid=87169) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 04 12:12:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e772b46f-c9d3-4455-ab62-464db413bfd1 tempest-GroupSnapshotsTest-581803404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:12:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e772b46f-c9d3-4455-ab62-464db413bfd1 tempest-GroupSnapshotsTest-581803404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:12:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e772b46f-c9d3-4455-ab62-464db413bfd1 tempest-GroupSnapshotsTest-581803404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:12:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e772b46f-c9d3-4455-ab62-464db413bfd1 tempest-GroupSnapshotsTest-581803404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:12:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e772b46f-c9d3-4455-ab62-464db413bfd1 tempest-GroupSnapshotsTest-581803404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:12:02 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[215f533e-ced8-45d6-81e8-c899454bfbbd]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:12:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e772b46f-c9d3-4455-ab62-464db413bfd1 tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c.20f2c5df-ed74-4066-b8e5-0c4f62416d32 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:03 devstack sudo[91828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c.20f2c5df-ed74-4066-b8e5-0c4f62416d32
Nov 04 12:12:03 devstack sudo[91828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:03 devstack sudo[91828]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e772b46f-c9d3-4455-ab62-464db413bfd1 tempest-GroupSnapshotsTest-581803404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c.20f2c5df-ed74-4066-b8e5-0c4f62416d32" returned: 0 in 0.649s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:03 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-e772b46f-c9d3-4455-ab62-464db413bfd1 tempest-GroupSnapshotsTest-581803404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:12:03 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[75601922-666b-469e-ad1b-cc6d7c6723f1]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:12:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e772b46f-c9d3-4455-ab62-464db413bfd1 tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:03 devstack sudo[91833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c
Nov 04 12:12:03 devstack sudo[91833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:04 devstack sudo[91833]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e772b46f-c9d3-4455-ab62-464db413bfd1 tempest-GroupSnapshotsTest-581803404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c" returned: 0 in 0.508s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:04 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e772b46f-c9d3-4455-ab62-464db413bfd1 tempest-GroupSnapshotsTest-581803404 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c {{(pid=87169) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 04 12:12:04 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e772b46f-c9d3-4455-ab62-464db413bfd1 tempest-GroupSnapshotsTest-581803404 None] Creating direct copy from snapshot {{(pid=87169) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 04 12:12:04 devstack cinder-volume[87169]: DEBUG cinder.utils [None req-e772b46f-c9d3-4455-ab62-464db413bfd1 tempest-GroupSnapshotsTest-581803404 None] Path /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-719886b2-378c-4e0a-916f-299c9966cbf8 not found in is_blk_device check {{(pid=87169) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 04 12:12:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e772b46f-c9d3-4455-ab62-464db413bfd1 tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-719886b2-378c-4e0a-916f-299c9966cbf8 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:04 devstack sudo[91838]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-719886b2-378c-4e0a-916f-299c9966cbf8
Nov 04 12:12:04 devstack sudo[91838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:11 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=64,cinder:UPDATE=43,cinder:DELETE=2,cinder:INSERT=18 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:12:11 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=59,cinder:UPDATE=47,cinder:INSERT=15,cinder:DELETE=4 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:12:11 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-97efa6db-f98f-4f09-ad1c-dc15892cf428 tempest-VolumeTypesAccessTest-1780471556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:12:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-97efa6db-f98f-4f09-ad1c-dc15892cf428 tempest-VolumeTypesAccessTest-1780471556 None] Flow 'volume_create_manager' (c5a9a86b-743b-4514-92cf-11665489a93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:12:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-97efa6db-f98f-4f09-ad1c-dc15892cf428 tempest-VolumeTypesAccessTest-1780471556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2724c206-aa33-4ff0-a689-0fbb57b48952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:12:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-97efa6db-f98f-4f09-ad1c-dc15892cf428 tempest-VolumeTypesAccessTest-1780471556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2724c206-aa33-4ff0-a689-0fbb57b48952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1974294089',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=711a07e1-e0be-4385-8f3c-eacb2efc4382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='142b95eca88a4b3eabce1c74f180e860',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:12:11Z,use_quota=True,user_id='2e813d509fbe4f358c1d722111ffeecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fbcf9aa9-f42f-4f5c-bd00-63c8090305dd),volume_type_id=fbcf9aa9-f42f-4f5c-bd00-63c8090305dd)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:12:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-97efa6db-f98f-4f09-ad1c-dc15892cf428 tempest-VolumeTypesAccessTest-1780471556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97a72ea5-bba3-45a6-9d0d-27db8beea749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:12:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-97efa6db-f98f-4f09-ad1c-dc15892cf428 tempest-VolumeTypesAccessTest-1780471556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97a72ea5-bba3-45a6-9d0d-27db8beea749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:12:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-97efa6db-f98f-4f09-ad1c-dc15892cf428 tempest-VolumeTypesAccessTest-1780471556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8601e61-42ee-4d4e-a3d5-e56217e7e322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:12:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-97efa6db-f98f-4f09-ad1c-dc15892cf428 tempest-VolumeTypesAccessTest-1780471556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8601e61-42ee-4d4e-a3d5-e56217e7e322) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '711a07e1-e0be-4385-8f3c-eacb2efc4382', 'volume_name': 'volume-711a07e1-e0be-4385-8f3c-eacb2efc4382', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:12:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-97efa6db-f98f-4f09-ad1c-dc15892cf428 tempest-VolumeTypesAccessTest-1780471556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bae1376-3acf-4932-a312-d2fbcf19129b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:12:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-97efa6db-f98f-4f09-ad1c-dc15892cf428 tempest-VolumeTypesAccessTest-1780471556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bae1376-3acf-4932-a312-d2fbcf19129b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:12:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-97efa6db-f98f-4f09-ad1c-dc15892cf428 tempest-VolumeTypesAccessTest-1780471556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56a8b18a-53c8-4432-a772-fb22f69725ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:12:11 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-97efa6db-f98f-4f09-ad1c-dc15892cf428 tempest-VolumeTypesAccessTest-1780471556 None] Volume 711a07e1-e0be-4385-8f3c-eacb2efc4382: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-711a07e1-e0be-4385-8f3c-eacb2efc4382', 'volume_size': 1}
Nov 04 12:12:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-97efa6db-f98f-4f09-ad1c-dc15892cf428 tempest-VolumeTypesAccessTest-1780471556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:12:11 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-0b3edf52-2504-4494-8fe6-e856a3e234e4 req-558bf2e1-4f62-4d2a-a6c9-9a48f43adc3e tempest-ServerActionsTestOtherA-305064589 None] Terminate volume connection completed successfully.
Nov 04 12:12:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-0b3edf52-2504-4494-8fe6-e856a3e234e4 req-558bf2e1-4f62-4d2a-a6c9-9a48f43adc3e tempest-ServerActionsTestOtherA-305064589 None] Deleting attachment a9b7a0fc-4935-40ed-be96-be1e47df2bf9. {{(pid=87169) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 12:12:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-0b3edf52-2504-4494-8fe6-e856a3e234e4 req-8441ce98-6b4a-45d6-aaca-a895b46aca81 tempest-ServerActionsTestOtherA-305064589 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:12:15 devstack sudo[91838]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e772b46f-c9d3-4455-ab62-464db413bfd1 tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-719886b2-378c-4e0a-916f-299c9966cbf8" returned: 0 in 11.856s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:15 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-e772b46f-c9d3-4455-ab62-464db413bfd1 tempest-GroupSnapshotsTest-581803404 None] Image conversion details: src /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c, size 1024.00 MB, duration 11.86 sec, destination /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-719886b2-378c-4e0a-916f-299c9966cbf8 {{(pid=87169) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 12:12:15 devstack cinder-volume[87169]: INFO cinder.image.image_utils [None req-e772b46f-c9d3-4455-ab62-464db413bfd1 tempest-GroupSnapshotsTest-581803404 None] Converted 1024.00 MB image at 86.36 MB/s
Nov 04 12:12:15 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-e772b46f-c9d3-4455-ab62-464db413bfd1 tempest-GroupSnapshotsTest-581803404 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-719886b2-378c-4e0a-916f-299c9966cbf8 is being set with open permissions: ugo+rw: NotImplementedError
Nov 04 12:12:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e772b46f-c9d3-4455-ab62-464db413bfd1 tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-719886b2-378c-4e0a-916f-299c9966cbf8 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:15 devstack sudo[91947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-719886b2-378c-4e0a-916f-299c9966cbf8
Nov 04 12:12:15 devstack sudo[91947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:16 devstack sudo[91947]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e772b46f-c9d3-4455-ab62-464db413bfd1 tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-719886b2-378c-4e0a-916f-299c9966cbf8" returned: 0 in 0.248s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:16 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e772b46f-c9d3-4455-ab62-464db413bfd1 tempest-GroupSnapshotsTest-581803404 None] Lock "cinder-quobyte-719886b2-378c-4e0a-916f-299c9966cbf8" released by "_copy_volume_from_snapshot" :: held 13.418s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:12:16 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e772b46f-c9d3-4455-ab62-464db413bfd1 tempest-GroupSnapshotsTest-581803404 None] Lock "cinder-quobyte-20f2c5df-ed74-4066-b8e5-0c4f62416d32-719886b2-378c-4e0a-916f-299c9966cbf8" released by "_create_volume_from_snapshot" :: held 13.557s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:12:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e772b46f-c9d3-4455-ab62-464db413bfd1 tempest-GroupSnapshotsTest-581803404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.594s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:12:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-97efa6db-f98f-4f09-ad1c-dc15892cf428 tempest-VolumeTypesAccessTest-1780471556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.925s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:12:16 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-97efa6db-f98f-4f09-ad1c-dc15892cf428 tempest-VolumeTypesAccessTest-1780471556 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:12:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1974294089',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=711a07e1-e0be-4385-8f3c-eacb2efc4382,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='142b95eca88a4b3eabce1c74f180e860',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:12:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:12:11Z,use_quota=True,user_id='2e813d509fbe4f358c1d722111ffeecc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fbcf9aa9-f42f-4f5c-bd00-63c8090305dd),volume_type_id=fbcf9aa9-f42f-4f5c-bd00-63c8090305dd)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:12:16 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-97efa6db-f98f-4f09-ad1c-dc15892cf428 tempest-VolumeTypesAccessTest-1780471556 None] Creating volume 711a07e1-e0be-4385-8f3c-eacb2efc4382 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:12:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-97efa6db-f98f-4f09-ad1c-dc15892cf428 tempest-VolumeTypesAccessTest-1780471556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:12:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-97efa6db-f98f-4f09-ad1c-dc15892cf428 tempest-VolumeTypesAccessTest-1780471556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:12:16 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-97efa6db-f98f-4f09-ad1c-dc15892cf428 tempest-VolumeTypesAccessTest-1780471556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:12:16 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-97efa6db-f98f-4f09-ad1c-dc15892cf428 tempest-VolumeTypesAccessTest-1780471556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:12:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-97efa6db-f98f-4f09-ad1c-dc15892cf428 tempest-VolumeTypesAccessTest-1780471556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:12:16 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-97efa6db-f98f-4f09-ad1c-dc15892cf428 tempest-VolumeTypesAccessTest-1780471556 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:12:16 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-97efa6db-f98f-4f09-ad1c-dc15892cf428 tempest-VolumeTypesAccessTest-1780471556 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:12:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-97efa6db-f98f-4f09-ad1c-dc15892cf428 tempest-VolumeTypesAccessTest-1780471556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-711a07e1-e0be-4385-8f3c-eacb2efc4382 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:16 devstack sudo[91950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-711a07e1-e0be-4385-8f3c-eacb2efc4382 1073741824
Nov 04 12:12:16 devstack sudo[91950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:16 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-e772b46f-c9d3-4455-ab62-464db413bfd1 tempest-GroupSnapshotsTest-581803404 None] Create group from source-snapshot-1fee728a-cd61-4da2-b4a6-2f3c98e6b24f completed successfully.
Nov 04 12:12:16 devstack sudo[91950]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-97efa6db-f98f-4f09-ad1c-dc15892cf428 tempest-VolumeTypesAccessTest-1780471556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-711a07e1-e0be-4385-8f3c-eacb2efc4382 1073741824" returned: 0 in 0.484s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-97efa6db-f98f-4f09-ad1c-dc15892cf428 tempest-VolumeTypesAccessTest-1780471556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-711a07e1-e0be-4385-8f3c-eacb2efc4382 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:16 devstack sudo[91956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-711a07e1-e0be-4385-8f3c-eacb2efc4382
Nov 04 12:12:16 devstack sudo[91956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:17 devstack sudo[91956]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-97efa6db-f98f-4f09-ad1c-dc15892cf428 tempest-VolumeTypesAccessTest-1780471556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-711a07e1-e0be-4385-8f3c-eacb2efc4382" returned: 0 in 0.256s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:17 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-97efa6db-f98f-4f09-ad1c-dc15892cf428 tempest-VolumeTypesAccessTest-1780471556 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:12:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-97efa6db-f98f-4f09-ad1c-dc15892cf428 tempest-VolumeTypesAccessTest-1780471556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:12:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-0b3edf52-2504-4494-8fe6-e856a3e234e4 req-8441ce98-6b4a-45d6-aaca-a895b46aca81 tempest-ServerActionsTestOtherA-305064589 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.989s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:12:17 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-97efa6db-f98f-4f09-ad1c-dc15892cf428 tempest-VolumeTypesAccessTest-1780471556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56a8b18a-53c8-4432-a772-fb22f69725ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-711a07e1-e0be-4385-8f3c-eacb2efc4382', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:12:17 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-97efa6db-f98f-4f09-ad1c-dc15892cf428 tempest-VolumeTypesAccessTest-1780471556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8f01fb8-71de-42e2-af85-f4d2b64f4200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:12:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-0b3edf52-2504-4494-8fe6-e856a3e234e4 req-8441ce98-6b4a-45d6-aaca-a895b46aca81 tempest-ServerActionsTestOtherA-305064589 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:12:17 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-97efa6db-f98f-4f09-ad1c-dc15892cf428 tempest-VolumeTypesAccessTest-1780471556 None] Volume volume-711a07e1-e0be-4385-8f3c-eacb2efc4382 (711a07e1-e0be-4385-8f3c-eacb2efc4382): created successfully
Nov 04 12:12:17 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-97efa6db-f98f-4f09-ad1c-dc15892cf428 tempest-VolumeTypesAccessTest-1780471556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8f01fb8-71de-42e2-af85-f4d2b64f4200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:12:17 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-97efa6db-f98f-4f09-ad1c-dc15892cf428 tempest-VolumeTypesAccessTest-1780471556 None] Flow 'volume_create_manager' (c5a9a86b-743b-4514-92cf-11665489a93a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:12:17 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-97efa6db-f98f-4f09-ad1c-dc15892cf428 tempest-VolumeTypesAccessTest-1780471556 None] Created volume successfully.
Nov 04 12:12:17 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-0b3edf52-2504-4494-8fe6-e856a3e234e4 req-8441ce98-6b4a-45d6-aaca-a895b46aca81 tempest-ServerActionsTestOtherA-305064589 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79', 'name': 'volume-78be41c1-7d28-42a5-a634-93f9fe38711a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e4389567-c69d-408f-9abc-d889cf740573', 'enforce_multipath': True} {{(pid=87169) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 04 12:12:17 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-0b3edf52-2504-4494-8fe6-e856a3e234e4 req-8441ce98-6b4a-45d6-aaca-a895b46aca81 tempest-ServerActionsTestOtherA-305064589 None] attachment_update completed successfully.
Nov 04 12:12:17 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5cfb984b-5b9a-4276-bfe1-5bf7e2f3045b tempest-GroupSnapshotsTest-581803404 None] Acquiring lock "cinder-quobyte-719886b2-378c-4e0a-916f-299c9966cbf8" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:12:17 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5cfb984b-5b9a-4276-bfe1-5bf7e2f3045b tempest-GroupSnapshotsTest-581803404 None] Lock "cinder-quobyte-719886b2-378c-4e0a-916f-299c9966cbf8" acquired by "delete_volume" :: waited 0.023s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:12:17 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-340342a0-e1d6-4c5d-8a67-812c0c748c44 tempest-VolumeTypesAccessTest-1780471556 None] Acquiring lock "cinder-711a07e1-e0be-4385-8f3c-eacb2efc4382-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:12:17 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-340342a0-e1d6-4c5d-8a67-812c0c748c44 tempest-VolumeTypesAccessTest-1780471556 None] Lock "cinder-711a07e1-e0be-4385-8f3c-eacb2efc4382-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:12:17 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7bceb1-0cbe-4668-8ef5-a6228deb51e6]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:12:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5cfb984b-5b9a-4276-bfe1-5bf7e2f3045b tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-719886b2-378c-4e0a-916f-299c9966cbf8 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:17 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-340342a0-e1d6-4c5d-8a67-812c0c748c44 tempest-VolumeTypesAccessTest-1780471556 None] Acquiring lock "cinder-quobyte-711a07e1-e0be-4385-8f3c-eacb2efc4382" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:12:17 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-340342a0-e1d6-4c5d-8a67-812c0c748c44 tempest-VolumeTypesAccessTest-1780471556 None] Lock "cinder-quobyte-711a07e1-e0be-4385-8f3c-eacb2efc4382" acquired by "delete_volume" :: waited 0.044s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:12:17 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-2c04df5e-2744-46e9-b6d4-ae4eb2d41836 req-ec468eb4-035a-454c-8cce-18af2a0ebaa2 tempest-AttachVolumeShelveTestJSON-907729002 None] No connector for attachment fe2b8460-349d-406c-85d4-4346b6ba2549; skipping storage backend terminate_connection call. {{(pid=87169) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}}
Nov 04 12:12:17 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-2c04df5e-2744-46e9-b6d4-ae4eb2d41836 req-ec468eb4-035a-454c-8cce-18af2a0ebaa2 tempest-AttachVolumeShelveTestJSON-907729002 None] Deleting attachment fe2b8460-349d-406c-85d4-4346b6ba2549. {{(pid=87169) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 12:12:17 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0f95c6b-45b2-487b-9442-549378d648ec]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:12:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-340342a0-e1d6-4c5d-8a67-812c0c748c44 tempest-VolumeTypesAccessTest-1780471556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-711a07e1-e0be-4385-8f3c-eacb2efc4382 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:17 devstack sudo[91960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-719886b2-378c-4e0a-916f-299c9966cbf8
Nov 04 12:12:17 devstack sudo[91960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:17 devstack sudo[92018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-711a07e1-e0be-4385-8f3c-eacb2efc4382
Nov 04 12:12:17 devstack sudo[92018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:18 devstack sudo[91960]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5cfb984b-5b9a-4276-bfe1-5bf7e2f3045b tempest-GroupSnapshotsTest-581803404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-719886b2-378c-4e0a-916f-299c9966cbf8" returned: 0 in 0.727s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5cfb984b-5b9a-4276-bfe1-5bf7e2f3045b tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-719886b2-378c-4e0a-916f-299c9966cbf8 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:18 devstack sudo[92302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-719886b2-378c-4e0a-916f-299c9966cbf8
Nov 04 12:12:18 devstack sudo[92302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:18 devstack sudo[92018]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-340342a0-e1d6-4c5d-8a67-812c0c748c44 tempest-VolumeTypesAccessTest-1780471556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-711a07e1-e0be-4385-8f3c-eacb2efc4382" returned: 0 in 0.681s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-340342a0-e1d6-4c5d-8a67-812c0c748c44 tempest-VolumeTypesAccessTest-1780471556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-711a07e1-e0be-4385-8f3c-eacb2efc4382 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:18 devstack sudo[92408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-711a07e1-e0be-4385-8f3c-eacb2efc4382
Nov 04 12:12:18 devstack sudo[92408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:18 devstack sudo[92302]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5cfb984b-5b9a-4276-bfe1-5bf7e2f3045b tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-719886b2-378c-4e0a-916f-299c9966cbf8" returned: 0 in 0.491s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:18 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5cfb984b-5b9a-4276-bfe1-5bf7e2f3045b tempest-GroupSnapshotsTest-581803404 None] Lock "cinder-quobyte-719886b2-378c-4e0a-916f-299c9966cbf8" released by "delete_volume" :: held 1.347s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:12:18 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-5cfb984b-5b9a-4276-bfe1-5bf7e2f3045b tempest-GroupSnapshotsTest-581803404 None] Created reservations ['3ac72955-9c02-4866-ad63-c9c11100b4d3'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:12:19 devstack sudo[92408]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-340342a0-e1d6-4c5d-8a67-812c0c748c44 tempest-VolumeTypesAccessTest-1780471556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-711a07e1-e0be-4385-8f3c-eacb2efc4382" returned: 0 in 0.649s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-340342a0-e1d6-4c5d-8a67-812c0c748c44 tempest-VolumeTypesAccessTest-1780471556 None] Lock "cinder-quobyte-711a07e1-e0be-4385-8f3c-eacb2efc4382" released by "delete_volume" :: held 1.425s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:12:19 devstack cinder-volume[87169]: WARNING cinder.quota [None req-5cfb984b-5b9a-4276-bfe1-5bf7e2f3045b tempest-GroupSnapshotsTest-581803404 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1783727192 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1783727192, it is now deprecated. Please use the default quota class for default quota.
Nov 04 12:12:19 devstack cinder-volume[87169]: WARNING cinder.quota [None req-5cfb984b-5b9a-4276-bfe1-5bf7e2f3045b tempest-GroupSnapshotsTest-581803404 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1783727192 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1783727192, it is now deprecated. Please use the default quota class for default quota.
Nov 04 12:12:19 devstack cinder-volume[87169]: WARNING cinder.quota [None req-340342a0-e1d6-4c5d-8a67-812c0c748c44 tempest-VolumeTypesAccessTest-1780471556 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-697438498 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-697438498, it is now deprecated. Please use the default quota class for default quota.
Nov 04 12:12:19 devstack cinder-volume[87169]: WARNING cinder.quota [None req-340342a0-e1d6-4c5d-8a67-812c0c748c44 tempest-VolumeTypesAccessTest-1780471556 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-697438498 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-697438498, it is now deprecated. Please use the default quota class for default quota.
Nov 04 12:12:19 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-5cfb984b-5b9a-4276-bfe1-5bf7e2f3045b tempest-GroupSnapshotsTest-581803404 None] Created reservations ['20a33dec-023b-4633-a8c4-138b21e721d5', '66176780-0fbd-4d27-a981-1a90dc978257', '4329fd1f-9896-4f2f-bc68-d40b7cf55ebc', 'ca85f9fa-911e-4932-9711-25cae9c73c85'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:12:19 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-340342a0-e1d6-4c5d-8a67-812c0c748c44 tempest-VolumeTypesAccessTest-1780471556 None] Created reservations ['1d0e3b59-fb27-46b6-8ec1-e86f7e374b5b', '644583f2-ef7d-457c-8986-7f407fd2748a', '5aa998ed-3e4e-44e8-acee-ed1a82bdb8c7', 'ce1cba41-a151-4273-a52d-eb6723dcf646'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:12:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-340342a0-e1d6-4c5d-8a67-812c0c748c44 tempest-VolumeTypesAccessTest-1780471556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:12:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-340342a0-e1d6-4c5d-8a67-812c0c748c44 tempest-VolumeTypesAccessTest-1780471556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:12:19 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-340342a0-e1d6-4c5d-8a67-812c0c748c44 tempest-VolumeTypesAccessTest-1780471556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:12:19 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-340342a0-e1d6-4c5d-8a67-812c0c748c44 tempest-VolumeTypesAccessTest-1780471556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:12:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-340342a0-e1d6-4c5d-8a67-812c0c748c44 tempest-VolumeTypesAccessTest-1780471556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:12:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-340342a0-e1d6-4c5d-8a67-812c0c748c44 tempest-VolumeTypesAccessTest-1780471556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:19 devstack sudo[92429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:12:19 devstack sudo[92429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5cfb984b-5b9a-4276-bfe1-5bf7e2f3045b tempest-GroupSnapshotsTest-581803404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:12:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5cfb984b-5b9a-4276-bfe1-5bf7e2f3045b tempest-GroupSnapshotsTest-581803404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:12:19 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5cfb984b-5b9a-4276-bfe1-5bf7e2f3045b tempest-GroupSnapshotsTest-581803404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:12:19 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5cfb984b-5b9a-4276-bfe1-5bf7e2f3045b tempest-GroupSnapshotsTest-581803404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:12:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5cfb984b-5b9a-4276-bfe1-5bf7e2f3045b tempest-GroupSnapshotsTest-581803404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:12:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5cfb984b-5b9a-4276-bfe1-5bf7e2f3045b tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:19 devstack sudo[92431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:12:19 devstack sudo[92431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:19 devstack sudo[92429]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-340342a0-e1d6-4c5d-8a67-812c0c748c44 tempest-VolumeTypesAccessTest-1780471556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.378s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:19 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-340342a0-e1d6-4c5d-8a67-812c0c748c44 tempest-VolumeTypesAccessTest-1780471556 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:12:19 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-340342a0-e1d6-4c5d-8a67-812c0c748c44 tempest-VolumeTypesAccessTest-1780471556 None] Deleted volume successfully.
Nov 04 12:12:19 devstack sudo[92431]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5cfb984b-5b9a-4276-bfe1-5bf7e2f3045b tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.320s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:19 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-5cfb984b-5b9a-4276-bfe1-5bf7e2f3045b tempest-GroupSnapshotsTest-581803404 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:12:19 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-5cfb984b-5b9a-4276-bfe1-5bf7e2f3045b tempest-GroupSnapshotsTest-581803404 None] Delete group completed successfully.
Nov 04 12:12:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-340342a0-e1d6-4c5d-8a67-812c0c748c44 tempest-VolumeTypesAccessTest-1780471556 None] Lock "cinder-711a07e1-e0be-4385-8f3c-eacb2efc4382-delete_volume" released by "delete_volume" :: held 2.252s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:12:20 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-9515be9b-704d-4c3d-ac7a-2650810262b3 tempest-GroupSnapshotsTest-581803404 None] group_snapshot 1fee728a-cd61-4da2-b4a6-2f3c98e6b24f: deleting
Nov 04 12:12:20 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-9515be9b-704d-4c3d-ac7a-2650810262b3 tempest-GroupSnapshotsTest-581803404 None] group_snapshot 1fee728a-cd61-4da2-b4a6-2f3c98e6b24f: deleting {{(pid=87169) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 04 12:12:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9515be9b-704d-4c3d-ac7a-2650810262b3 tempest-GroupSnapshotsTest-581803404 None] Acquiring lock "cinder-quobyte-3931cba2-3a94-4dbb-9e6c-aafe279e300c" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:12:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9515be9b-704d-4c3d-ac7a-2650810262b3 tempest-GroupSnapshotsTest-581803404 None] Lock "cinder-quobyte-3931cba2-3a94-4dbb-9e6c-aafe279e300c" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:12:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9515be9b-704d-4c3d-ac7a-2650810262b3 tempest-GroupSnapshotsTest-581803404 None] Acquiring lock "cinder-quobyte-20f2c5df-ed74-4066-b8e5-0c4f62416d32" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:12:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9515be9b-704d-4c3d-ac7a-2650810262b3 tempest-GroupSnapshotsTest-581803404 None] Lock "cinder-quobyte-20f2c5df-ed74-4066-b8e5-0c4f62416d32" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:12:20 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-9515be9b-704d-4c3d-ac7a-2650810262b3 tempest-GroupSnapshotsTest-581803404 None] Deleting offline snapshot 20f2c5df-ed74-4066-b8e5-0c4f62416d32 of volume 3931cba2-3a94-4dbb-9e6c-aafe279e300c {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:12:20 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-9515be9b-704d-4c3d-ac7a-2650810262b3 tempest-GroupSnapshotsTest-581803404 None] snapshot_file for this snap is: volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c.20f2c5df-ed74-4066-b8e5-0c4f62416d32 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:12:20 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f36eb3-4404-41e3-b605-e51bd7f93036]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:12:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9515be9b-704d-4c3d-ac7a-2650810262b3 tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c.20f2c5df-ed74-4066-b8e5-0c4f62416d32 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:20 devstack sudo[92440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c.20f2c5df-ed74-4066-b8e5-0c4f62416d32
Nov 04 12:12:20 devstack sudo[92440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:21 devstack sudo[92440]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9515be9b-704d-4c3d-ac7a-2650810262b3 tempest-GroupSnapshotsTest-581803404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c.20f2c5df-ed74-4066-b8e5-0c4f62416d32" returned: 0 in 0.635s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:21 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-9515be9b-704d-4c3d-ac7a-2650810262b3 tempest-GroupSnapshotsTest-581803404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:12:21 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c2f6f5-3767-44f7-8f36-be86410ea46b]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:12:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9515be9b-704d-4c3d-ac7a-2650810262b3 tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:21 devstack sudo[92448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c
Nov 04 12:12:21 devstack sudo[92448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:22 devstack sudo[92448]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9515be9b-704d-4c3d-ac7a-2650810262b3 tempest-GroupSnapshotsTest-581803404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c" returned: 0 in 0.736s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9515be9b-704d-4c3d-ac7a-2650810262b3 tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c.20f2c5df-ed74-4066-b8e5-0c4f62416d32 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:22 devstack sudo[92453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c.20f2c5df-ed74-4066-b8e5-0c4f62416d32
Nov 04 12:12:22 devstack sudo[92453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:22 devstack sudo[92453]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9515be9b-704d-4c3d-ac7a-2650810262b3 tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c.20f2c5df-ed74-4066-b8e5-0c4f62416d32" returned: 0 in 0.578s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9515be9b-704d-4c3d-ac7a-2650810262b3 tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c.20f2c5df-ed74-4066-b8e5-0c4f62416d32 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:22 devstack sudo[92458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c.20f2c5df-ed74-4066-b8e5-0c4f62416d32
Nov 04 12:12:22 devstack sudo[92458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:23 devstack sudo[92458]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9515be9b-704d-4c3d-ac7a-2650810262b3 tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c.20f2c5df-ed74-4066-b8e5-0c4f62416d32" returned: 0 in 0.487s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:23 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9515be9b-704d-4c3d-ac7a-2650810262b3 tempest-GroupSnapshotsTest-581803404 None] Lock "cinder-quobyte-20f2c5df-ed74-4066-b8e5-0c4f62416d32" released by "_delete_snapshot" :: held 2.685s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:12:23 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9515be9b-704d-4c3d-ac7a-2650810262b3 tempest-GroupSnapshotsTest-581803404 None] Lock "cinder-quobyte-3931cba2-3a94-4dbb-9e6c-aafe279e300c" released by "delete_snapshot" :: held 2.743s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:12:23 devstack cinder-volume[87169]: WARNING cinder.quota [None req-9515be9b-704d-4c3d-ac7a-2650810262b3 tempest-GroupSnapshotsTest-581803404 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1783727192 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1783727192, it is now deprecated. Please use the default quota class for default quota.
Nov 04 12:12:23 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-9515be9b-704d-4c3d-ac7a-2650810262b3 tempest-GroupSnapshotsTest-581803404 None] Created reservations ['da9ebc3c-396e-44b1-a07f-2f99e28a0ef6', 'f9da0e0c-512d-4745-8ebd-49f805e1f649', '2dfd3dac-5c8e-4998-bd22-58f514432eb3', '2d6bbd3c-4cea-46ce-8dc0-fbc5203f802e'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:12:23 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-9515be9b-704d-4c3d-ac7a-2650810262b3 tempest-GroupSnapshotsTest-581803404 None] group_snapshot 1fee728a-cd61-4da2-b4a6-2f3c98e6b24f: deleted successfully
Nov 04 12:12:24 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-623affbd-0435-4669-bd4c-42aff437c1f2 tempest-GroupSnapshotsTest-581803404 None] Acquiring lock "cinder-quobyte-3931cba2-3a94-4dbb-9e6c-aafe279e300c" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:12:24 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-623affbd-0435-4669-bd4c-42aff437c1f2 tempest-GroupSnapshotsTest-581803404 None] Lock "cinder-quobyte-3931cba2-3a94-4dbb-9e6c-aafe279e300c" acquired by "delete_volume" :: waited 0.034s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:12:24 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d789f4-5c36-4ca9-aa5f-0551fba68ee5]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:12:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-623affbd-0435-4669-bd4c-42aff437c1f2 tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:25 devstack sudo[92500]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c
Nov 04 12:12:25 devstack sudo[92500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:25 devstack sudo[92500]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-623affbd-0435-4669-bd4c-42aff437c1f2 tempest-GroupSnapshotsTest-581803404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c" returned: 0 in 0.787s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-623affbd-0435-4669-bd4c-42aff437c1f2 tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:25 devstack sudo[92505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c
Nov 04 12:12:25 devstack sudo[92505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:26 devstack sudo[92505]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-623affbd-0435-4669-bd4c-42aff437c1f2 tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3931cba2-3a94-4dbb-9e6c-aafe279e300c" returned: 0 in 0.605s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:26 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-623affbd-0435-4669-bd4c-42aff437c1f2 tempest-GroupSnapshotsTest-581803404 None] Lock "cinder-quobyte-3931cba2-3a94-4dbb-9e6c-aafe279e300c" released by "delete_volume" :: held 1.566s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:12:26 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-623affbd-0435-4669-bd4c-42aff437c1f2 tempest-GroupSnapshotsTest-581803404 None] Created reservations ['b76a8ee1-c295-4183-b691-cdd271b5b683'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:12:26 devstack cinder-volume[87169]: WARNING cinder.db.api [None req-623affbd-0435-4669-bd4c-42aff437c1f2 tempest-GroupSnapshotsTest-581803404 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1783727192']
Nov 04 12:12:26 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-623affbd-0435-4669-bd4c-42aff437c1f2 tempest-GroupSnapshotsTest-581803404 None] Created reservations ['650a2730-cec2-4aae-b396-856f84fbc446', '6a966393-b083-4155-85af-294a64156cca', 'ba06c815-e00d-4d8d-84f5-ebd188a44d6f', 'd050a673-5a5c-46e9-ae06-5dca021d3066'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:12:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-623affbd-0435-4669-bd4c-42aff437c1f2 tempest-GroupSnapshotsTest-581803404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:12:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-623affbd-0435-4669-bd4c-42aff437c1f2 tempest-GroupSnapshotsTest-581803404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:12:26 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-623affbd-0435-4669-bd4c-42aff437c1f2 tempest-GroupSnapshotsTest-581803404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:12:26 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-623affbd-0435-4669-bd4c-42aff437c1f2 tempest-GroupSnapshotsTest-581803404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:12:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-623affbd-0435-4669-bd4c-42aff437c1f2 tempest-GroupSnapshotsTest-581803404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:12:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-623affbd-0435-4669-bd4c-42aff437c1f2 tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:27 devstack sudo[92508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:12:27 devstack sudo[92508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:27 devstack sudo[92508]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:27 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-623affbd-0435-4669-bd4c-42aff437c1f2 tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.413s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:27 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-623affbd-0435-4669-bd4c-42aff437c1f2 tempest-GroupSnapshotsTest-581803404 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:12:27 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-623affbd-0435-4669-bd4c-42aff437c1f2 tempest-GroupSnapshotsTest-581803404 None] Delete group completed successfully.
Nov 04 12:12:28 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-797dae0e-ce5b-40dc-a1de-40d123662dbc tempest-GroupSnapshotsTest-581803404 None] Group tempest-GroupSnapshotsTest-Group-1590352056: creating
Nov 04 12:12:28 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-797dae0e-ce5b-40dc-a1de-40d123662dbc tempest-GroupSnapshotsTest-581803404 None] Group tempest-GroupSnapshotsTest-Group-1590352056: created successfully
Nov 04 12:12:28 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-797dae0e-ce5b-40dc-a1de-40d123662dbc tempest-GroupSnapshotsTest-581803404 None] Create group completed successfully.
Nov 04 12:12:30 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-f73c4041-e05f-4ebc-97e7-74d290175006 tempest-GroupSnapshotsTest-581803404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:12:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f73c4041-e05f-4ebc-97e7-74d290175006 tempest-GroupSnapshotsTest-581803404 None] Flow 'volume_create_manager' (90815d51-4310-4966-8c59-a50f40fc08bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:12:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f73c4041-e05f-4ebc-97e7-74d290175006 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c0b6926-8d21-461d-bc2e-68cd39215156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:12:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f73c4041-e05f-4ebc-97e7-74d290175006 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c0b6926-8d21-461d-bc2e-68cd39215156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1244969348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8e5cca65-e862-48dc-b851-67025d4814aa,host='devstack@QuobyteHD#QuobyteHD',id=62ccabde-f291-49f6-a761-9d6732346c02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18239611c6334bd99f08b0d276e50538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:12:30Z,use_quota=True,user_id='b56985e97bbe4ea7a2a67e3e9becd36e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75151196-f6ec-4232-b640-a26e9cf45287),volume_type_id=75151196-f6ec-4232-b640-a26e9cf45287)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:12:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f73c4041-e05f-4ebc-97e7-74d290175006 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5fe3a99-3f47-492d-8cfe-1ac8ea9a1c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:12:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f73c4041-e05f-4ebc-97e7-74d290175006 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5fe3a99-3f47-492d-8cfe-1ac8ea9a1c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:12:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f73c4041-e05f-4ebc-97e7-74d290175006 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0269dd12-3b0b-4cef-838b-f37ac13373a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:12:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f73c4041-e05f-4ebc-97e7-74d290175006 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0269dd12-3b0b-4cef-838b-f37ac13373a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62ccabde-f291-49f6-a761-9d6732346c02', 'volume_name': 'volume-62ccabde-f291-49f6-a761-9d6732346c02', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:12:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f73c4041-e05f-4ebc-97e7-74d290175006 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e14512a8-c68f-4502-a09c-b77a46b48b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:12:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f73c4041-e05f-4ebc-97e7-74d290175006 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e14512a8-c68f-4502-a09c-b77a46b48b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:12:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f73c4041-e05f-4ebc-97e7-74d290175006 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (549cd369-cf66-472c-933c-4a4de779d794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:12:30 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-f73c4041-e05f-4ebc-97e7-74d290175006 tempest-GroupSnapshotsTest-581803404 None] Volume 62ccabde-f291-49f6-a761-9d6732346c02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62ccabde-f291-49f6-a761-9d6732346c02', 'volume_size': 1}
Nov 04 12:12:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f73c4041-e05f-4ebc-97e7-74d290175006 tempest-GroupSnapshotsTest-581803404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:12:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f73c4041-e05f-4ebc-97e7-74d290175006 tempest-GroupSnapshotsTest-581803404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:12:30 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f73c4041-e05f-4ebc-97e7-74d290175006 tempest-GroupSnapshotsTest-581803404 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8e5cca65-e862-48dc-b851-67025d4814aa,created_at=2026-11-04T11:12:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1244969348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8e5cca65-e862-48dc-b851-67025d4814aa,host='devstack@QuobyteHD#QuobyteHD',id=62ccabde-f291-49f6-a761-9d6732346c02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18239611c6334bd99f08b0d276e50538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:12:30Z,use_quota=True,user_id='b56985e97bbe4ea7a2a67e3e9becd36e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75151196-f6ec-4232-b640-a26e9cf45287),volume_type_id=75151196-f6ec-4232-b640-a26e9cf45287)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:12:30 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-f73c4041-e05f-4ebc-97e7-74d290175006 tempest-GroupSnapshotsTest-581803404 None] Creating volume 62ccabde-f291-49f6-a761-9d6732346c02 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:12:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f73c4041-e05f-4ebc-97e7-74d290175006 tempest-GroupSnapshotsTest-581803404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:12:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f73c4041-e05f-4ebc-97e7-74d290175006 tempest-GroupSnapshotsTest-581803404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:12:30 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f73c4041-e05f-4ebc-97e7-74d290175006 tempest-GroupSnapshotsTest-581803404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:12:30 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f73c4041-e05f-4ebc-97e7-74d290175006 tempest-GroupSnapshotsTest-581803404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:12:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f73c4041-e05f-4ebc-97e7-74d290175006 tempest-GroupSnapshotsTest-581803404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:12:30 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f73c4041-e05f-4ebc-97e7-74d290175006 tempest-GroupSnapshotsTest-581803404 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:12:30 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-f73c4041-e05f-4ebc-97e7-74d290175006 tempest-GroupSnapshotsTest-581803404 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:12:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f73c4041-e05f-4ebc-97e7-74d290175006 tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:30 devstack sudo[92536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02 1073741824
Nov 04 12:12:30 devstack sudo[92536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:31 devstack sudo[92536]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f73c4041-e05f-4ebc-97e7-74d290175006 tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02 1073741824" returned: 0 in 0.552s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f73c4041-e05f-4ebc-97e7-74d290175006 tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:31 devstack sudo[92556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02
Nov 04 12:12:31 devstack sudo[92556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:31 devstack sudo[92556]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f73c4041-e05f-4ebc-97e7-74d290175006 tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02" returned: 0 in 0.377s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:31 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f73c4041-e05f-4ebc-97e7-74d290175006 tempest-GroupSnapshotsTest-581803404 None] <== create_volume: return (1009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:12:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f73c4041-e05f-4ebc-97e7-74d290175006 tempest-GroupSnapshotsTest-581803404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.012s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:12:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f73c4041-e05f-4ebc-97e7-74d290175006 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (549cd369-cf66-472c-933c-4a4de779d794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62ccabde-f291-49f6-a761-9d6732346c02', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:12:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f73c4041-e05f-4ebc-97e7-74d290175006 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1871a568-cf97-4636-9326-89f8a1055876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:12:31 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-f73c4041-e05f-4ebc-97e7-74d290175006 tempest-GroupSnapshotsTest-581803404 None] Volume volume-62ccabde-f291-49f6-a761-9d6732346c02 (62ccabde-f291-49f6-a761-9d6732346c02): created successfully
Nov 04 12:12:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f73c4041-e05f-4ebc-97e7-74d290175006 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1871a568-cf97-4636-9326-89f8a1055876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:12:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f73c4041-e05f-4ebc-97e7-74d290175006 tempest-GroupSnapshotsTest-581803404 None] Flow 'volume_create_manager' (90815d51-4310-4966-8c59-a50f40fc08bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:12:31 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-f73c4041-e05f-4ebc-97e7-74d290175006 tempest-GroupSnapshotsTest-581803404 None] Created volume successfully.
Nov 04 12:12:34 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc54b1db-48e1-415e-bfa2-0a0e5d6cb0e4 tempest-GroupSnapshotsTest-581803404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:12:34 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bc54b1db-48e1-415e-bfa2-0a0e5d6cb0e4 tempest-GroupSnapshotsTest-581803404 None] Flow 'volume_create_manager' (de6b9eac-d51c-4651-84ff-87ab95bfb334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:12:34 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bc54b1db-48e1-415e-bfa2-0a0e5d6cb0e4 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a6561f4-393e-4e2f-b76d-680c2d6a0264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:12:34 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bc54b1db-48e1-415e-bfa2-0a0e5d6cb0e4 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a6561f4-393e-4e2f-b76d-680c2d6a0264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:12:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-597431045',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8e5cca65-e862-48dc-b851-67025d4814aa,host='devstack@QuobyteHD#QuobyteHD',id=f1236e4a-8b89-4f16-8ef9-2f1297396461,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18239611c6334bd99f08b0d276e50538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:12:34Z,use_quota=True,user_id='b56985e97bbe4ea7a2a67e3e9becd36e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75151196-f6ec-4232-b640-a26e9cf45287),volume_type_id=75151196-f6ec-4232-b640-a26e9cf45287)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:12:34 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bc54b1db-48e1-415e-bfa2-0a0e5d6cb0e4 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fe74aae-b5d3-4953-b5e9-db4aefbf21ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:12:34 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bc54b1db-48e1-415e-bfa2-0a0e5d6cb0e4 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fe74aae-b5d3-4953-b5e9-db4aefbf21ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:12:34 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bc54b1db-48e1-415e-bfa2-0a0e5d6cb0e4 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ea49e88-7d57-45d3-81ae-f84dfe8ef93b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:12:34 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bc54b1db-48e1-415e-bfa2-0a0e5d6cb0e4 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ea49e88-7d57-45d3-81ae-f84dfe8ef93b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1236e4a-8b89-4f16-8ef9-2f1297396461', 'volume_name': 'volume-f1236e4a-8b89-4f16-8ef9-2f1297396461', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:12:34 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bc54b1db-48e1-415e-bfa2-0a0e5d6cb0e4 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c4d64a9-8948-43ca-ac3e-ad7ed7cda708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:12:34 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bc54b1db-48e1-415e-bfa2-0a0e5d6cb0e4 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c4d64a9-8948-43ca-ac3e-ad7ed7cda708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:12:34 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bc54b1db-48e1-415e-bfa2-0a0e5d6cb0e4 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3adc8c5a-973f-41d5-b8ff-fcfafbfcc540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:12:34 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-bc54b1db-48e1-415e-bfa2-0a0e5d6cb0e4 tempest-GroupSnapshotsTest-581803404 None] Volume f1236e4a-8b89-4f16-8ef9-2f1297396461: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1236e4a-8b89-4f16-8ef9-2f1297396461', 'volume_size': 1}
Nov 04 12:12:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-bc54b1db-48e1-415e-bfa2-0a0e5d6cb0e4 tempest-GroupSnapshotsTest-581803404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:12:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-bc54b1db-48e1-415e-bfa2-0a0e5d6cb0e4 tempest-GroupSnapshotsTest-581803404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:12:34 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-bc54b1db-48e1-415e-bfa2-0a0e5d6cb0e4 tempest-GroupSnapshotsTest-581803404 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=8e5cca65-e862-48dc-b851-67025d4814aa,created_at=2026-11-04T11:12:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-597431045',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=8e5cca65-e862-48dc-b851-67025d4814aa,host='devstack@QuobyteHD#QuobyteHD',id=f1236e4a-8b89-4f16-8ef9-2f1297396461,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18239611c6334bd99f08b0d276e50538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:12:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:12:34Z,use_quota=True,user_id='b56985e97bbe4ea7a2a67e3e9becd36e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(75151196-f6ec-4232-b640-a26e9cf45287),volume_type_id=75151196-f6ec-4232-b640-a26e9cf45287)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:12:34 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-bc54b1db-48e1-415e-bfa2-0a0e5d6cb0e4 tempest-GroupSnapshotsTest-581803404 None] Creating volume f1236e4a-8b89-4f16-8ef9-2f1297396461 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:12:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-bc54b1db-48e1-415e-bfa2-0a0e5d6cb0e4 tempest-GroupSnapshotsTest-581803404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:12:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-bc54b1db-48e1-415e-bfa2-0a0e5d6cb0e4 tempest-GroupSnapshotsTest-581803404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:12:34 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-bc54b1db-48e1-415e-bfa2-0a0e5d6cb0e4 tempest-GroupSnapshotsTest-581803404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:12:34 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-bc54b1db-48e1-415e-bfa2-0a0e5d6cb0e4 tempest-GroupSnapshotsTest-581803404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:12:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-bc54b1db-48e1-415e-bfa2-0a0e5d6cb0e4 tempest-GroupSnapshotsTest-581803404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:12:34 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-bc54b1db-48e1-415e-bfa2-0a0e5d6cb0e4 tempest-GroupSnapshotsTest-581803404 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:12:34 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-bc54b1db-48e1-415e-bfa2-0a0e5d6cb0e4 tempest-GroupSnapshotsTest-581803404 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:12:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bc54b1db-48e1-415e-bfa2-0a0e5d6cb0e4 tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:34 devstack sudo[92625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461 1073741824
Nov 04 12:12:34 devstack sudo[92625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:35 devstack sudo[92625]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bc54b1db-48e1-415e-bfa2-0a0e5d6cb0e4 tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461 1073741824" returned: 0 in 1.030s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bc54b1db-48e1-415e-bfa2-0a0e5d6cb0e4 tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:35 devstack sudo[92643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461
Nov 04 12:12:35 devstack sudo[92643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:35 devstack sudo[92643]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bc54b1db-48e1-415e-bfa2-0a0e5d6cb0e4 tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461" returned: 0 in 0.360s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:35 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-bc54b1db-48e1-415e-bfa2-0a0e5d6cb0e4 tempest-GroupSnapshotsTest-581803404 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:12:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-bc54b1db-48e1-415e-bfa2-0a0e5d6cb0e4 tempest-GroupSnapshotsTest-581803404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:12:35 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bc54b1db-48e1-415e-bfa2-0a0e5d6cb0e4 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3adc8c5a-973f-41d5-b8ff-fcfafbfcc540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1236e4a-8b89-4f16-8ef9-2f1297396461', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:12:36 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bc54b1db-48e1-415e-bfa2-0a0e5d6cb0e4 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec1d19f-fdda-4f97-a508-15f34069071d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:12:36 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-bc54b1db-48e1-415e-bfa2-0a0e5d6cb0e4 tempest-GroupSnapshotsTest-581803404 None] Volume volume-f1236e4a-8b89-4f16-8ef9-2f1297396461 (f1236e4a-8b89-4f16-8ef9-2f1297396461): created successfully
Nov 04 12:12:36 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bc54b1db-48e1-415e-bfa2-0a0e5d6cb0e4 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec1d19f-fdda-4f97-a508-15f34069071d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:12:36 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bc54b1db-48e1-415e-bfa2-0a0e5d6cb0e4 tempest-GroupSnapshotsTest-581803404 None] Flow 'volume_create_manager' (de6b9eac-d51c-4651-84ff-87ab95bfb334) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:12:36 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-bc54b1db-48e1-415e-bfa2-0a0e5d6cb0e4 tempest-GroupSnapshotsTest-581803404 None] Created volume successfully.
Nov 04 12:12:37 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-08f4fd73-2cb0-4eec-b463-4fddb2697af1 tempest-GroupSnapshotsTest-581803404 None] Update group completed successfully.
Nov 04 12:12:38 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-49b4cfff-849f-4106-9f27-d596cf3265c9 tempest-GroupSnapshotsTest-581803404 None] Update group completed successfully.
Nov 04 12:12:39 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-e110342e-ca26-4262-ab60-82d52ca50f15 tempest-GroupSnapshotsTest-581803404 None] Update group completed successfully.
Nov 04 12:12:40 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-31c00507-da52-4e09-abd9-001cf1226eac tempest-GroupSnapshotsTest-581803404 None] Update group completed successfully.
Nov 04 12:12:42 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-8676de16-d0f2-476c-9097-8db89e99292b tempest-GroupSnapshotsTest-581803404 None] GroupSnapshot c9acd012-9e76-48b0-90ba-bdf2e1e0b5c3: creating.
Nov 04 12:12:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8676de16-d0f2-476c-9097-8db89e99292b tempest-GroupSnapshotsTest-581803404 None] Group snapshot c9acd012-9e76-48b0-90ba-bdf2e1e0b5c3: creating. {{(pid=87169) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 04 12:12:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8676de16-d0f2-476c-9097-8db89e99292b tempest-GroupSnapshotsTest-581803404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:12:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8676de16-d0f2-476c-9097-8db89e99292b tempest-GroupSnapshotsTest-581803404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:12:42 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-8676de16-d0f2-476c-9097-8db89e99292b tempest-GroupSnapshotsTest-581803404 None] Creating offline snapshot 310a5a0c-67aa-481f-abde-880323312066 of volume f1236e4a-8b89-4f16-8ef9-2f1297396461 {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:12:42 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66ebeae-e528-484a-a65a-07574963bbb2]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:12:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8676de16-d0f2-476c-9097-8db89e99292b tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:42 devstack sudo[92691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461
Nov 04 12:12:42 devstack sudo[92691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:42 devstack sudo[92691]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8676de16-d0f2-476c-9097-8db89e99292b tempest-GroupSnapshotsTest-581803404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461" returned: 0 in 0.397s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8676de16-d0f2-476c-9097-8db89e99292b tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461.310a5a0c-67aa-481f-abde-880323312066 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:42 devstack sudo[92696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461.310a5a0c-67aa-481f-abde-880323312066 1G
Nov 04 12:12:42 devstack sudo[92696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:43 devstack sudo[92696]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8676de16-d0f2-476c-9097-8db89e99292b tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461.310a5a0c-67aa-481f-abde-880323312066 1G" returned: 0 in 0.438s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8676de16-d0f2-476c-9097-8db89e99292b tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1236e4a-8b89-4f16-8ef9-2f1297396461 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461.310a5a0c-67aa-481f-abde-880323312066 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:43 devstack sudo[92702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1236e4a-8b89-4f16-8ef9-2f1297396461 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461.310a5a0c-67aa-481f-abde-880323312066
Nov 04 12:12:43 devstack sudo[92702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:43 devstack sudo[92702]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8676de16-d0f2-476c-9097-8db89e99292b tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f1236e4a-8b89-4f16-8ef9-2f1297396461 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461.310a5a0c-67aa-481f-abde-880323312066" returned: 0 in 0.329s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:43 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-8676de16-d0f2-476c-9097-8db89e99292b tempest-GroupSnapshotsTest-581803404 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461.310a5a0c-67aa-481f-abde-880323312066 is being set with open permissions: ugo+rw: NotImplementedError
Nov 04 12:12:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8676de16-d0f2-476c-9097-8db89e99292b tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461.310a5a0c-67aa-481f-abde-880323312066 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:43 devstack sudo[92708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461.310a5a0c-67aa-481f-abde-880323312066
Nov 04 12:12:43 devstack sudo[92708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:43 devstack sudo[92708]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8676de16-d0f2-476c-9097-8db89e99292b tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461.310a5a0c-67aa-481f-abde-880323312066" returned: 0 in 0.295s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8676de16-d0f2-476c-9097-8db89e99292b tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:43 devstack sudo[92711]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461.info
Nov 04 12:12:43 devstack sudo[92711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:44 devstack sudo[92711]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8676de16-d0f2-476c-9097-8db89e99292b tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461.info" returned: 0 in 0.306s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:44 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-8676de16-d0f2-476c-9097-8db89e99292b tempest-GroupSnapshotsTest-581803404 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 04 12:12:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8676de16-d0f2-476c-9097-8db89e99292b tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:44 devstack sudo[92714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461.info
Nov 04 12:12:44 devstack sudo[92714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:44 devstack sudo[92714]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8676de16-d0f2-476c-9097-8db89e99292b tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461.info" returned: 0 in 0.293s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8676de16-d0f2-476c-9097-8db89e99292b tempest-GroupSnapshotsTest-581803404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.179s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:12:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8676de16-d0f2-476c-9097-8db89e99292b tempest-GroupSnapshotsTest-581803404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:12:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8676de16-d0f2-476c-9097-8db89e99292b tempest-GroupSnapshotsTest-581803404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:12:44 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-8676de16-d0f2-476c-9097-8db89e99292b tempest-GroupSnapshotsTest-581803404 None] Creating offline snapshot 3da0a242-61c1-47d6-b833-7509845ba856 of volume 62ccabde-f291-49f6-a761-9d6732346c02 {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:12:44 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[5231f272-6a85-4bbd-b754-13fde5b342e2]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:12:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8676de16-d0f2-476c-9097-8db89e99292b tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:44 devstack sudo[92717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02
Nov 04 12:12:44 devstack sudo[92717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:45 devstack sudo[92717]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8676de16-d0f2-476c-9097-8db89e99292b tempest-GroupSnapshotsTest-581803404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02" returned: 0 in 0.422s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8676de16-d0f2-476c-9097-8db89e99292b tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02.3da0a242-61c1-47d6-b833-7509845ba856 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:45 devstack sudo[92722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02.3da0a242-61c1-47d6-b833-7509845ba856 1G
Nov 04 12:12:45 devstack sudo[92722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:45 devstack sudo[92722]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8676de16-d0f2-476c-9097-8db89e99292b tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02.3da0a242-61c1-47d6-b833-7509845ba856 1G" returned: 0 in 0.560s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8676de16-d0f2-476c-9097-8db89e99292b tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62ccabde-f291-49f6-a761-9d6732346c02 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02.3da0a242-61c1-47d6-b833-7509845ba856 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:45 devstack sudo[92728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62ccabde-f291-49f6-a761-9d6732346c02 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02.3da0a242-61c1-47d6-b833-7509845ba856
Nov 04 12:12:45 devstack sudo[92728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:46 devstack sudo[92728]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8676de16-d0f2-476c-9097-8db89e99292b tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-62ccabde-f291-49f6-a761-9d6732346c02 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02.3da0a242-61c1-47d6-b833-7509845ba856" returned: 0 in 0.421s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:46 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-8676de16-d0f2-476c-9097-8db89e99292b tempest-GroupSnapshotsTest-581803404 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02.3da0a242-61c1-47d6-b833-7509845ba856 is being set with open permissions: ugo+rw: NotImplementedError
Nov 04 12:12:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8676de16-d0f2-476c-9097-8db89e99292b tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02.3da0a242-61c1-47d6-b833-7509845ba856 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:46 devstack sudo[92733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02.3da0a242-61c1-47d6-b833-7509845ba856
Nov 04 12:12:46 devstack sudo[92733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:46 devstack sudo[92733]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8676de16-d0f2-476c-9097-8db89e99292b tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02.3da0a242-61c1-47d6-b833-7509845ba856" returned: 0 in 0.296s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8676de16-d0f2-476c-9097-8db89e99292b tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:46 devstack sudo[92736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02.info
Nov 04 12:12:46 devstack sudo[92736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:46 devstack sudo[92736]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8676de16-d0f2-476c-9097-8db89e99292b tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02.info" returned: 0 in 0.297s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:46 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-8676de16-d0f2-476c-9097-8db89e99292b tempest-GroupSnapshotsTest-581803404 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 04 12:12:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8676de16-d0f2-476c-9097-8db89e99292b tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:46 devstack sudo[92739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02.info
Nov 04 12:12:46 devstack sudo[92739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:46 devstack sudo[92739]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8676de16-d0f2-476c-9097-8db89e99292b tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02.info" returned: 0 in 0.279s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8676de16-d0f2-476c-9097-8db89e99292b tempest-GroupSnapshotsTest-581803404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.407s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:12:47 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-8676de16-d0f2-476c-9097-8db89e99292b tempest-GroupSnapshotsTest-581803404 None] group_snapshot c9acd012-9e76-48b0-90ba-bdf2e1e0b5c3: created successfully
Nov 04 12:12:47 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-44dbb3ee-ba26-40bd-9350-32d56960dfe4 tempest-GroupSnapshotsTest-581803404 None] group_snapshot c9acd012-9e76-48b0-90ba-bdf2e1e0b5c3: deleting
Nov 04 12:12:47 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-44dbb3ee-ba26-40bd-9350-32d56960dfe4 tempest-GroupSnapshotsTest-581803404 None] group_snapshot c9acd012-9e76-48b0-90ba-bdf2e1e0b5c3: deleting {{(pid=87169) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 04 12:12:47 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-44dbb3ee-ba26-40bd-9350-32d56960dfe4 tempest-GroupSnapshotsTest-581803404 None] Acquiring lock "cinder-quobyte-f1236e4a-8b89-4f16-8ef9-2f1297396461" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:12:48 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-44dbb3ee-ba26-40bd-9350-32d56960dfe4 tempest-GroupSnapshotsTest-581803404 None] Lock "cinder-quobyte-f1236e4a-8b89-4f16-8ef9-2f1297396461" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:12:48 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-44dbb3ee-ba26-40bd-9350-32d56960dfe4 tempest-GroupSnapshotsTest-581803404 None] Acquiring lock "cinder-quobyte-310a5a0c-67aa-481f-abde-880323312066" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:12:48 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-44dbb3ee-ba26-40bd-9350-32d56960dfe4 tempest-GroupSnapshotsTest-581803404 None] Lock "cinder-quobyte-310a5a0c-67aa-481f-abde-880323312066" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:12:48 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-44dbb3ee-ba26-40bd-9350-32d56960dfe4 tempest-GroupSnapshotsTest-581803404 None] Deleting offline snapshot 310a5a0c-67aa-481f-abde-880323312066 of volume f1236e4a-8b89-4f16-8ef9-2f1297396461 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:12:48 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-44dbb3ee-ba26-40bd-9350-32d56960dfe4 tempest-GroupSnapshotsTest-581803404 None] snapshot_file for this snap is: volume-f1236e4a-8b89-4f16-8ef9-2f1297396461.310a5a0c-67aa-481f-abde-880323312066 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:12:48 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[36630237-13d8-4597-a821-001f5ac9401f]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:12:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-44dbb3ee-ba26-40bd-9350-32d56960dfe4 tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461.310a5a0c-67aa-481f-abde-880323312066 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:48 devstack sudo[92748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461.310a5a0c-67aa-481f-abde-880323312066
Nov 04 12:12:48 devstack sudo[92748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:48 devstack sudo[92748]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-44dbb3ee-ba26-40bd-9350-32d56960dfe4 tempest-GroupSnapshotsTest-581803404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461.310a5a0c-67aa-481f-abde-880323312066" returned: 0 in 0.523s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:48 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-44dbb3ee-ba26-40bd-9350-32d56960dfe4 tempest-GroupSnapshotsTest-581803404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f1236e4a-8b89-4f16-8ef9-2f1297396461(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:12:48 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9b852c-1b75-4be2-84f2-92260807e717]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:12:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-44dbb3ee-ba26-40bd-9350-32d56960dfe4 tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:48 devstack sudo[92755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461
Nov 04 12:12:48 devstack sudo[92755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:49 devstack sudo[92755]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-44dbb3ee-ba26-40bd-9350-32d56960dfe4 tempest-GroupSnapshotsTest-581803404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461" returned: 0 in 0.598s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-44dbb3ee-ba26-40bd-9350-32d56960dfe4 tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461.310a5a0c-67aa-481f-abde-880323312066 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:49 devstack sudo[92763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461.310a5a0c-67aa-481f-abde-880323312066
Nov 04 12:12:49 devstack sudo[92763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:49 devstack sudo[92763]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-44dbb3ee-ba26-40bd-9350-32d56960dfe4 tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461.310a5a0c-67aa-481f-abde-880323312066" returned: 0 in 0.441s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-44dbb3ee-ba26-40bd-9350-32d56960dfe4 tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461.310a5a0c-67aa-481f-abde-880323312066 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:49 devstack sudo[92772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461.310a5a0c-67aa-481f-abde-880323312066
Nov 04 12:12:49 devstack sudo[92772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:49 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:12:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:12:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:12:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:12:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:12:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:12:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:49 devstack sudo[92776]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:12:49 devstack sudo[92776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:50 devstack sudo[92772]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-44dbb3ee-ba26-40bd-9350-32d56960dfe4 tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461.310a5a0c-67aa-481f-abde-880323312066" returned: 0 in 0.449s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:50 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-44dbb3ee-ba26-40bd-9350-32d56960dfe4 tempest-GroupSnapshotsTest-581803404 None] Lock "cinder-quobyte-310a5a0c-67aa-481f-abde-880323312066" released by "_delete_snapshot" :: held 2.172s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:12:50 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-44dbb3ee-ba26-40bd-9350-32d56960dfe4 tempest-GroupSnapshotsTest-581803404 None] Lock "cinder-quobyte-f1236e4a-8b89-4f16-8ef9-2f1297396461" released by "delete_snapshot" :: held 2.230s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:12:50 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-44dbb3ee-ba26-40bd-9350-32d56960dfe4 tempest-GroupSnapshotsTest-581803404 None] Acquiring lock "cinder-quobyte-62ccabde-f291-49f6-a761-9d6732346c02" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:12:50 devstack sudo[92776]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:50 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-44dbb3ee-ba26-40bd-9350-32d56960dfe4 tempest-GroupSnapshotsTest-581803404 None] Lock "cinder-quobyte-62ccabde-f291-49f6-a761-9d6732346c02" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:12:50 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-44dbb3ee-ba26-40bd-9350-32d56960dfe4 tempest-GroupSnapshotsTest-581803404 None] Acquiring lock "cinder-quobyte-3da0a242-61c1-47d6-b833-7509845ba856" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:12:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.456s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:50 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:12:50 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager._thread_info {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:12:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread count: 28 {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 12:12:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread info: [<_MainThread(MainThread, started 137165867425920)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137165754678912)>, <Thread(Thread-3 (stat_writer), started daemon 137165754130752)>, <Thread(Rabbit-heartbeat, started daemon 137165752997504)>, <Thread(Thread-5 (_runner), started daemon 137165753227712)>, <Thread(Thread-7 (_runner), started daemon 137165751273856)>, <Thread(fd_logger, started daemon 137165755322048)>, <Thread(privsep_reader, started daemon 137165748896704)>, <Thread(tpool_thread_0, started daemon 137165742520000)>, <Thread(tpool_thread_1, started daemon 137165734127296)>, <Thread(tpool_thread_2, started daemon 137165725734592)>, <Thread(tpool_thread_3, started daemon 137165717341888)>, <Thread(tpool_thread_4, started daemon 137165708949184)>, <Thread(tpool_thread_5, started daemon 137165700556480)>, <Thread(tpool_thread_6, started daemon 137165692163776)>, <Thread(tpool_thread_7, started daemon 137165683771072)>, <Thread(tpool_thread_8, started daemon 137165675378368)>, <Thread(tpool_thread_9, started daemon 137165666985664)>, <Thread(tpool_thread_10, started daemon 137165658592960)>, <Thread(tpool_thread_11, started daemon 137165650183872)>, <Thread(tpool_thread_12, started daemon 137165641774784)>, <Thread(tpool_thread_13, started daemon 137165633365696)>, <Thread(tpool_thread_14, started daemon 137165624956608)>, <Thread(tpool_thread_15, started daemon 137165616547520)>, <Thread(tpool_thread_16, started daemon 137165608138432)>, <Thread(tpool_thread_17, started daemon 137165599729344)>, <Thread(tpool_thread_18, started daemon 137165591320256)>, <Thread(tpool_thread_19, started daemon 137165582911168)>] {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 12:12:50 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-44dbb3ee-ba26-40bd-9350-32d56960dfe4 tempest-GroupSnapshotsTest-581803404 None] Lock "cinder-quobyte-3da0a242-61c1-47d6-b833-7509845ba856" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:12:50 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-44dbb3ee-ba26-40bd-9350-32d56960dfe4 tempest-GroupSnapshotsTest-581803404 None] Deleting offline snapshot 3da0a242-61c1-47d6-b833-7509845ba856 of volume 62ccabde-f291-49f6-a761-9d6732346c02 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:12:50 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-44dbb3ee-ba26-40bd-9350-32d56960dfe4 tempest-GroupSnapshotsTest-581803404 None] snapshot_file for this snap is: volume-62ccabde-f291-49f6-a761-9d6732346c02.3da0a242-61c1-47d6-b833-7509845ba856 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:12:50 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece39729-aa2b-453d-8a47-eae37ee97378]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:12:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-44dbb3ee-ba26-40bd-9350-32d56960dfe4 tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02.3da0a242-61c1-47d6-b833-7509845ba856 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:50 devstack sudo[92802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02.3da0a242-61c1-47d6-b833-7509845ba856
Nov 04 12:12:50 devstack sudo[92802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:50 devstack sudo[92802]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-44dbb3ee-ba26-40bd-9350-32d56960dfe4 tempest-GroupSnapshotsTest-581803404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02.3da0a242-61c1-47d6-b833-7509845ba856" returned: 0 in 0.464s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:50 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-44dbb3ee-ba26-40bd-9350-32d56960dfe4 tempest-GroupSnapshotsTest-581803404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-62ccabde-f291-49f6-a761-9d6732346c02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:12:50 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[270823d4-c168-43ef-a723-221eb71b5f7c]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:12:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-44dbb3ee-ba26-40bd-9350-32d56960dfe4 tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:51 devstack sudo[92809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02
Nov 04 12:12:51 devstack sudo[92809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:51 devstack sudo[92809]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-44dbb3ee-ba26-40bd-9350-32d56960dfe4 tempest-GroupSnapshotsTest-581803404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02" returned: 0 in 0.503s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-44dbb3ee-ba26-40bd-9350-32d56960dfe4 tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02.3da0a242-61c1-47d6-b833-7509845ba856 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:51 devstack sudo[92816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02.3da0a242-61c1-47d6-b833-7509845ba856
Nov 04 12:12:51 devstack sudo[92816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:51 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-9b57e013-9377-4f64-a0a1-c6d3d30453ce req-6c31ba29-9b5e-4dc3-b8e5-88edfcbe2127 tempest-ServerActionsTestOtherA-305064589 None] Terminate volume connection completed successfully.
Nov 04 12:12:51 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-9b57e013-9377-4f64-a0a1-c6d3d30453ce req-6c31ba29-9b5e-4dc3-b8e5-88edfcbe2127 tempest-ServerActionsTestOtherA-305064589 None] Deleting attachment e4389567-c69d-408f-9abc-d889cf740573. {{(pid=87169) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 12:12:51 devstack cinder-volume[87169]: DEBUG cinder.coordination [req-9b57e013-9377-4f64-a0a1-c6d3d30453ce req-4796b570-13e5-4fe5-ab25-d5cac8ecf6ec tempest-ServerActionsTestOtherA-305064589 None] Acquiring lock "cinder-78be41c1-7d28-42a5-a634-93f9fe38711a-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:12:51 devstack cinder-volume[87169]: DEBUG cinder.coordination [req-9b57e013-9377-4f64-a0a1-c6d3d30453ce req-4796b570-13e5-4fe5-ab25-d5cac8ecf6ec tempest-ServerActionsTestOtherA-305064589 None] Lock "cinder-78be41c1-7d28-42a5-a634-93f9fe38711a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:12:51 devstack cinder-volume[87169]: DEBUG cinder.coordination [req-9b57e013-9377-4f64-a0a1-c6d3d30453ce req-4796b570-13e5-4fe5-ab25-d5cac8ecf6ec tempest-ServerActionsTestOtherA-305064589 None] Acquiring lock "cinder-quobyte-78be41c1-7d28-42a5-a634-93f9fe38711a" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:12:51 devstack cinder-volume[87169]: DEBUG cinder.coordination [req-9b57e013-9377-4f64-a0a1-c6d3d30453ce req-4796b570-13e5-4fe5-ab25-d5cac8ecf6ec tempest-ServerActionsTestOtherA-305064589 None] Lock "cinder-quobyte-78be41c1-7d28-42a5-a634-93f9fe38711a" acquired by "delete_volume" :: waited 0.019s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:12:51 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89e97f6-ee59-497c-b851-0f7df7895a42]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:12:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-9b57e013-9377-4f64-a0a1-c6d3d30453ce req-4796b570-13e5-4fe5-ab25-d5cac8ecf6ec tempest-ServerActionsTestOtherA-305064589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-78be41c1-7d28-42a5-a634-93f9fe38711a {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:51 devstack sudo[92816]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-44dbb3ee-ba26-40bd-9350-32d56960dfe4 tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02.3da0a242-61c1-47d6-b833-7509845ba856" returned: 0 in 0.476s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-44dbb3ee-ba26-40bd-9350-32d56960dfe4 tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02.3da0a242-61c1-47d6-b833-7509845ba856 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:51 devstack sudo[92823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02.3da0a242-61c1-47d6-b833-7509845ba856
Nov 04 12:12:51 devstack sudo[92823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:52 devstack sudo[92822]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-78be41c1-7d28-42a5-a634-93f9fe38711a
Nov 04 12:12:52 devstack sudo[92822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:52 devstack sudo[92823]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-44dbb3ee-ba26-40bd-9350-32d56960dfe4 tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02.3da0a242-61c1-47d6-b833-7509845ba856" returned: 0 in 0.306s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:52 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-44dbb3ee-ba26-40bd-9350-32d56960dfe4 tempest-GroupSnapshotsTest-581803404 None] Lock "cinder-quobyte-3da0a242-61c1-47d6-b833-7509845ba856" released by "_delete_snapshot" :: held 1.947s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:12:52 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-44dbb3ee-ba26-40bd-9350-32d56960dfe4 tempest-GroupSnapshotsTest-581803404 None] Lock "cinder-quobyte-62ccabde-f291-49f6-a761-9d6732346c02" released by "delete_snapshot" :: held 1.997s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:12:52 devstack sudo[92822]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-9b57e013-9377-4f64-a0a1-c6d3d30453ce req-4796b570-13e5-4fe5-ab25-d5cac8ecf6ec tempest-ServerActionsTestOtherA-305064589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-78be41c1-7d28-42a5-a634-93f9fe38711a" returned: 0 in 0.490s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-9b57e013-9377-4f64-a0a1-c6d3d30453ce req-4796b570-13e5-4fe5-ab25-d5cac8ecf6ec tempest-ServerActionsTestOtherA-305064589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-78be41c1-7d28-42a5-a634-93f9fe38711a {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:52 devstack cinder-volume[87169]: WARNING cinder.quota [None req-44dbb3ee-ba26-40bd-9350-32d56960dfe4 tempest-GroupSnapshotsTest-581803404 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-591290458 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-591290458, it is now deprecated. Please use the default quota class for default quota.
Nov 04 12:12:52 devstack cinder-volume[87169]: WARNING cinder.quota [None req-44dbb3ee-ba26-40bd-9350-32d56960dfe4 tempest-GroupSnapshotsTest-581803404 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-591290458 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-591290458, it is now deprecated. Please use the default quota class for default quota.
Nov 04 12:12:52 devstack sudo[92831]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-78be41c1-7d28-42a5-a634-93f9fe38711a
Nov 04 12:12:52 devstack sudo[92831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:52 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-44dbb3ee-ba26-40bd-9350-32d56960dfe4 tempest-GroupSnapshotsTest-581803404 None] Created reservations ['3abc8b77-2e54-43e7-b3a8-52c2e2ec3e2b', '6b4879b8-2475-4e6b-876d-8d5d99df5aa5', 'a461a65d-9fca-4eb4-a01c-794098bcb47b', 'e93086c0-5ccf-410e-8e1c-bacdc3b83141'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:12:52 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-faa5562f-34d4-4954-9191-f4629de98359 tempest-ServerActionsTestOtherA-305064589 None] Acquiring lock "cinder-52346bcf-6155-4587-b4d5-5ff349f2a384-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:12:52 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-faa5562f-34d4-4954-9191-f4629de98359 tempest-ServerActionsTestOtherA-305064589 None] Lock "cinder-52346bcf-6155-4587-b4d5-5ff349f2a384-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:12:52 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-faa5562f-34d4-4954-9191-f4629de98359 tempest-ServerActionsTestOtherA-305064589 None] Acquiring lock "cinder-quobyte-52346bcf-6155-4587-b4d5-5ff349f2a384" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:12:52 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-44dbb3ee-ba26-40bd-9350-32d56960dfe4 tempest-GroupSnapshotsTest-581803404 None] Created reservations ['2d6e580f-3104-4d65-81c9-01830719ee1f', 'd5f67c5d-fc2a-4d81-ae28-ac193c653941', 'db9f8c5a-db67-445d-953a-98df0fb3c041', '029cbf78-c8f8-4784-bc9a-95c51ff64cfe'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:12:52 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-faa5562f-34d4-4954-9191-f4629de98359 tempest-ServerActionsTestOtherA-305064589 None] Lock "cinder-quobyte-52346bcf-6155-4587-b4d5-5ff349f2a384" acquired by "delete_volume" :: waited 0.033s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:12:52 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a81042-04cb-4e4f-8129-b6075da09e22]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:12:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-faa5562f-34d4-4954-9191-f4629de98359 tempest-ServerActionsTestOtherA-305064589 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-52346bcf-6155-4587-b4d5-5ff349f2a384 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:52 devstack sudo[92831]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-9b57e013-9377-4f64-a0a1-c6d3d30453ce req-4796b570-13e5-4fe5-ab25-d5cac8ecf6ec tempest-ServerActionsTestOtherA-305064589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-78be41c1-7d28-42a5-a634-93f9fe38711a" returned: 0 in 0.459s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:52 devstack cinder-volume[87169]: DEBUG cinder.coordination [req-9b57e013-9377-4f64-a0a1-c6d3d30453ce req-4796b570-13e5-4fe5-ab25-d5cac8ecf6ec tempest-ServerActionsTestOtherA-305064589 None] Lock "cinder-quobyte-78be41c1-7d28-42a5-a634-93f9fe38711a" released by "delete_volume" :: held 1.021s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:12:52 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-44dbb3ee-ba26-40bd-9350-32d56960dfe4 tempest-GroupSnapshotsTest-581803404 None] group_snapshot c9acd012-9e76-48b0-90ba-bdf2e1e0b5c3: deleted successfully
Nov 04 12:12:52 devstack cinder-volume[87169]: DEBUG cinder.quota [req-9b57e013-9377-4f64-a0a1-c6d3d30453ce req-4796b570-13e5-4fe5-ab25-d5cac8ecf6ec tempest-ServerActionsTestOtherA-305064589 None] Created reservations ['aadb8689-f0b9-4dfb-8846-937d6fbb9d0b', 'ce84407e-3d47-4763-bb7b-ad35b3f61252', 'e5ffe0d2-d2bd-4c93-a0d2-bb718b98fe70', '32acfc76-9d71-453a-920b-f260af80538b'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:12:52 devstack sudo[92835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-52346bcf-6155-4587-b4d5-5ff349f2a384
Nov 04 12:12:52 devstack sudo[92835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-9b57e013-9377-4f64-a0a1-c6d3d30453ce req-4796b570-13e5-4fe5-ab25-d5cac8ecf6ec tempest-ServerActionsTestOtherA-305064589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:12:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-9b57e013-9377-4f64-a0a1-c6d3d30453ce req-4796b570-13e5-4fe5-ab25-d5cac8ecf6ec tempest-ServerActionsTestOtherA-305064589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:12:52 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [req-9b57e013-9377-4f64-a0a1-c6d3d30453ce req-4796b570-13e5-4fe5-ab25-d5cac8ecf6ec tempest-ServerActionsTestOtherA-305064589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:12:52 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [req-9b57e013-9377-4f64-a0a1-c6d3d30453ce req-4796b570-13e5-4fe5-ab25-d5cac8ecf6ec tempest-ServerActionsTestOtherA-305064589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:12:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-9b57e013-9377-4f64-a0a1-c6d3d30453ce req-4796b570-13e5-4fe5-ab25-d5cac8ecf6ec tempest-ServerActionsTestOtherA-305064589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:12:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-9b57e013-9377-4f64-a0a1-c6d3d30453ce req-4796b570-13e5-4fe5-ab25-d5cac8ecf6ec tempest-ServerActionsTestOtherA-305064589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:53 devstack sudo[92837]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:12:53 devstack sudo[92837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:53 devstack sudo[92835]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-faa5562f-34d4-4954-9191-f4629de98359 tempest-ServerActionsTestOtherA-305064589 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-52346bcf-6155-4587-b4d5-5ff349f2a384" returned: 0 in 0.411s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-faa5562f-34d4-4954-9191-f4629de98359 tempest-ServerActionsTestOtherA-305064589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-52346bcf-6155-4587-b4d5-5ff349f2a384 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:53 devstack sudo[92845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-52346bcf-6155-4587-b4d5-5ff349f2a384
Nov 04 12:12:53 devstack sudo[92845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:53 devstack sudo[92837]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-9b57e013-9377-4f64-a0a1-c6d3d30453ce req-4796b570-13e5-4fe5-ab25-d5cac8ecf6ec tempest-ServerActionsTestOtherA-305064589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.266s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:53 devstack cinder-volume[87169]: DEBUG cinder.manager [req-9b57e013-9377-4f64-a0a1-c6d3d30453ce req-4796b570-13e5-4fe5-ab25-d5cac8ecf6ec tempest-ServerActionsTestOtherA-305064589 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:12:53 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-9b57e013-9377-4f64-a0a1-c6d3d30453ce req-4796b570-13e5-4fe5-ab25-d5cac8ecf6ec tempest-ServerActionsTestOtherA-305064589 None] Deleted volume successfully.
Nov 04 12:12:53 devstack cinder-volume[87169]: DEBUG cinder.coordination [req-9b57e013-9377-4f64-a0a1-c6d3d30453ce req-4796b570-13e5-4fe5-ab25-d5cac8ecf6ec tempest-ServerActionsTestOtherA-305064589 None] Lock "cinder-78be41c1-7d28-42a5-a634-93f9fe38711a-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:12:53 devstack sudo[92845]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-faa5562f-34d4-4954-9191-f4629de98359 tempest-ServerActionsTestOtherA-305064589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-52346bcf-6155-4587-b4d5-5ff349f2a384" returned: 0 in 0.282s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:53 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-faa5562f-34d4-4954-9191-f4629de98359 tempest-ServerActionsTestOtherA-305064589 None] Lock "cinder-quobyte-52346bcf-6155-4587-b4d5-5ff349f2a384" released by "delete_volume" :: held 0.752s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:12:53 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-faa5562f-34d4-4954-9191-f4629de98359 tempest-ServerActionsTestOtherA-305064589 None] Created reservations ['89d908c2-9f50-41db-9202-786d0932afd6', 'f59c0f4a-67d1-4472-b4ba-180178d4757a', 'c71f1e0b-1a18-4f27-88cc-3bec8a5e5ee3', '2e1bbdb3-3d60-4c5f-bb9c-936350622176'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:12:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-faa5562f-34d4-4954-9191-f4629de98359 tempest-ServerActionsTestOtherA-305064589 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:12:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-faa5562f-34d4-4954-9191-f4629de98359 tempest-ServerActionsTestOtherA-305064589 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:12:53 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-faa5562f-34d4-4954-9191-f4629de98359 tempest-ServerActionsTestOtherA-305064589 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:12:53 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-faa5562f-34d4-4954-9191-f4629de98359 tempest-ServerActionsTestOtherA-305064589 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:12:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-faa5562f-34d4-4954-9191-f4629de98359 tempest-ServerActionsTestOtherA-305064589 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:12:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-faa5562f-34d4-4954-9191-f4629de98359 tempest-ServerActionsTestOtherA-305064589 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:53 devstack sudo[92848]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:12:53 devstack sudo[92848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:53 devstack sudo[92848]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-faa5562f-34d4-4954-9191-f4629de98359 tempest-ServerActionsTestOtherA-305064589 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.271s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:53 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-faa5562f-34d4-4954-9191-f4629de98359 tempest-ServerActionsTestOtherA-305064589 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:12:53 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-faa5562f-34d4-4954-9191-f4629de98359 tempest-ServerActionsTestOtherA-305064589 None] Deleted volume successfully.
Nov 04 12:12:53 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-faa5562f-34d4-4954-9191-f4629de98359 tempest-ServerActionsTestOtherA-305064589 None] Lock "cinder-52346bcf-6155-4587-b4d5-5ff349f2a384-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:12:54 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ee02be05-afa4-49e3-a0b5-af8bc2e2f885 tempest-GroupSnapshotsTest-581803404 None] Acquiring lock "cinder-quobyte-62ccabde-f291-49f6-a761-9d6732346c02" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:12:54 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ee02be05-afa4-49e3-a0b5-af8bc2e2f885 tempest-GroupSnapshotsTest-581803404 None] Lock "cinder-quobyte-62ccabde-f291-49f6-a761-9d6732346c02" acquired by "delete_volume" :: waited 0.027s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:12:54 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[f679ecd3-0d30-4327-8538-614f9a1a61e5]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:12:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ee02be05-afa4-49e3-a0b5-af8bc2e2f885 tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:54 devstack sudo[92853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02
Nov 04 12:12:54 devstack sudo[92853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:54 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-25980b58-a6a8-45d7-b888-f8b11d9f6655 tempest-VolumesTransfersTest-838195915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:12:54 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-25980b58-a6a8-45d7-b888-f8b11d9f6655 tempest-VolumesTransfersTest-838195915 None] Flow 'volume_create_manager' (e14fa688-1cb2-4817-a697-3e4374882f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:12:54 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-25980b58-a6a8-45d7-b888-f8b11d9f6655 tempest-VolumesTransfersTest-838195915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (626fa95c-132b-49b4-8a84-0151f30f9e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:12:54 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-25980b58-a6a8-45d7-b888-f8b11d9f6655 tempest-VolumesTransfersTest-838195915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (626fa95c-132b-49b4-8a84-0151f30f9e0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:12:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-195238979',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d8c3848-4b48-4aa2-824d-cb71d76a310d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f3441bcbd294a8bb416807f31a5a49c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:12:55Z,use_quota=True,user_id='7bd940da17464d5aa44832ad740dba9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:12:54 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-25980b58-a6a8-45d7-b888-f8b11d9f6655 tempest-VolumesTransfersTest-838195915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3882a1f1-5ed0-4331-8a90-a550762e3915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:12:54 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-25980b58-a6a8-45d7-b888-f8b11d9f6655 tempest-VolumesTransfersTest-838195915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3882a1f1-5ed0-4331-8a90-a550762e3915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:12:54 devstack sudo[92853]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:54 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-25980b58-a6a8-45d7-b888-f8b11d9f6655 tempest-VolumesTransfersTest-838195915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23d29164-0ddb-470a-913b-3450907a2193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:12:54 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-25980b58-a6a8-45d7-b888-f8b11d9f6655 tempest-VolumesTransfersTest-838195915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23d29164-0ddb-470a-913b-3450907a2193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d8c3848-4b48-4aa2-824d-cb71d76a310d', 'volume_name': 'volume-8d8c3848-4b48-4aa2-824d-cb71d76a310d', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:12:54 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-25980b58-a6a8-45d7-b888-f8b11d9f6655 tempest-VolumesTransfersTest-838195915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c196172-ddaf-48c0-a208-eff8eed1c669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:12:54 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-25980b58-a6a8-45d7-b888-f8b11d9f6655 tempest-VolumesTransfersTest-838195915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c196172-ddaf-48c0-a208-eff8eed1c669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:12:54 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-25980b58-a6a8-45d7-b888-f8b11d9f6655 tempest-VolumesTransfersTest-838195915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eddb3e6b-fc96-4158-a084-defdeedd9e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:12:54 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-25980b58-a6a8-45d7-b888-f8b11d9f6655 tempest-VolumesTransfersTest-838195915 None] Volume 8d8c3848-4b48-4aa2-824d-cb71d76a310d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d8c3848-4b48-4aa2-824d-cb71d76a310d', 'volume_size': 1}
Nov 04 12:12:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-25980b58-a6a8-45d7-b888-f8b11d9f6655 tempest-VolumesTransfersTest-838195915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:12:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-25980b58-a6a8-45d7-b888-f8b11d9f6655 tempest-VolumesTransfersTest-838195915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:12:54 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-25980b58-a6a8-45d7-b888-f8b11d9f6655 tempest-VolumesTransfersTest-838195915 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:12:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-195238979',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d8c3848-4b48-4aa2-824d-cb71d76a310d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f3441bcbd294a8bb416807f31a5a49c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:12:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:12:55Z,use_quota=True,user_id='7bd940da17464d5aa44832ad740dba9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:12:54 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-25980b58-a6a8-45d7-b888-f8b11d9f6655 tempest-VolumesTransfersTest-838195915 None] Creating volume 8d8c3848-4b48-4aa2-824d-cb71d76a310d {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:12:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-25980b58-a6a8-45d7-b888-f8b11d9f6655 tempest-VolumesTransfersTest-838195915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:12:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-25980b58-a6a8-45d7-b888-f8b11d9f6655 tempest-VolumesTransfersTest-838195915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:12:54 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-25980b58-a6a8-45d7-b888-f8b11d9f6655 tempest-VolumesTransfersTest-838195915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:12:54 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-25980b58-a6a8-45d7-b888-f8b11d9f6655 tempest-VolumesTransfersTest-838195915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:12:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-25980b58-a6a8-45d7-b888-f8b11d9f6655 tempest-VolumesTransfersTest-838195915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:12:54 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-25980b58-a6a8-45d7-b888-f8b11d9f6655 tempest-VolumesTransfersTest-838195915 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:12:54 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-25980b58-a6a8-45d7-b888-f8b11d9f6655 tempest-VolumesTransfersTest-838195915 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:12:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-25980b58-a6a8-45d7-b888-f8b11d9f6655 tempest-VolumesTransfersTest-838195915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8d8c3848-4b48-4aa2-824d-cb71d76a310d 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ee02be05-afa4-49e3-a0b5-af8bc2e2f885 tempest-GroupSnapshotsTest-581803404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02" returned: 0 in 0.633s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ee02be05-afa4-49e3-a0b5-af8bc2e2f885 tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:54 devstack sudo[92879]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8d8c3848-4b48-4aa2-824d-cb71d76a310d 1073741824
Nov 04 12:12:54 devstack sudo[92879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:54 devstack sudo[92880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02
Nov 04 12:12:54 devstack sudo[92880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:55 devstack sudo[92880]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ee02be05-afa4-49e3-a0b5-af8bc2e2f885 tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-62ccabde-f291-49f6-a761-9d6732346c02" returned: 0 in 0.279s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:55 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ee02be05-afa4-49e3-a0b5-af8bc2e2f885 tempest-GroupSnapshotsTest-581803404 None] Lock "cinder-quobyte-62ccabde-f291-49f6-a761-9d6732346c02" released by "delete_volume" :: held 1.034s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:12:55 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ee02be05-afa4-49e3-a0b5-af8bc2e2f885 tempest-GroupSnapshotsTest-581803404 None] Acquiring lock "cinder-quobyte-f1236e4a-8b89-4f16-8ef9-2f1297396461" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:12:55 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ee02be05-afa4-49e3-a0b5-af8bc2e2f885 tempest-GroupSnapshotsTest-581803404 None] Lock "cinder-quobyte-f1236e4a-8b89-4f16-8ef9-2f1297396461" acquired by "delete_volume" :: waited 0.016s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:12:55 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[99969d04-1e55-433f-9adb-2841a0b7be02]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:12:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ee02be05-afa4-49e3-a0b5-af8bc2e2f885 tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:55 devstack sudo[92887]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461
Nov 04 12:12:55 devstack sudo[92887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:55 devstack sudo[92879]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-25980b58-a6a8-45d7-b888-f8b11d9f6655 tempest-VolumesTransfersTest-838195915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8d8c3848-4b48-4aa2-824d-cb71d76a310d 1073741824" returned: 0 in 0.788s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-25980b58-a6a8-45d7-b888-f8b11d9f6655 tempest-VolumesTransfersTest-838195915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8d8c3848-4b48-4aa2-824d-cb71d76a310d {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:55 devstack sudo[92893]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8d8c3848-4b48-4aa2-824d-cb71d76a310d
Nov 04 12:12:55 devstack sudo[92893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:55 devstack sudo[92887]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ee02be05-afa4-49e3-a0b5-af8bc2e2f885 tempest-GroupSnapshotsTest-581803404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461" returned: 0 in 0.700s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ee02be05-afa4-49e3-a0b5-af8bc2e2f885 tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:55 devstack sudo[92899]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461
Nov 04 12:12:55 devstack sudo[92899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:56 devstack sudo[92893]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-25980b58-a6a8-45d7-b888-f8b11d9f6655 tempest-VolumesTransfersTest-838195915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8d8c3848-4b48-4aa2-824d-cb71d76a310d" returned: 0 in 0.383s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:56 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-25980b58-a6a8-45d7-b888-f8b11d9f6655 tempest-VolumesTransfersTest-838195915 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:12:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-25980b58-a6a8-45d7-b888-f8b11d9f6655 tempest-VolumesTransfersTest-838195915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:12:56 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-25980b58-a6a8-45d7-b888-f8b11d9f6655 tempest-VolumesTransfersTest-838195915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eddb3e6b-fc96-4158-a084-defdeedd9e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d8c3848-4b48-4aa2-824d-cb71d76a310d', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:12:56 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-25980b58-a6a8-45d7-b888-f8b11d9f6655 tempest-VolumesTransfersTest-838195915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccc35190-c2a1-4077-8988-1ceeec1806fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:12:56 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-25980b58-a6a8-45d7-b888-f8b11d9f6655 tempest-VolumesTransfersTest-838195915 None] Volume volume-8d8c3848-4b48-4aa2-824d-cb71d76a310d (8d8c3848-4b48-4aa2-824d-cb71d76a310d): created successfully
Nov 04 12:12:56 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-25980b58-a6a8-45d7-b888-f8b11d9f6655 tempest-VolumesTransfersTest-838195915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccc35190-c2a1-4077-8988-1ceeec1806fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:12:56 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-25980b58-a6a8-45d7-b888-f8b11d9f6655 tempest-VolumesTransfersTest-838195915 None] Flow 'volume_create_manager' (e14fa688-1cb2-4817-a697-3e4374882f68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:12:56 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-25980b58-a6a8-45d7-b888-f8b11d9f6655 tempest-VolumesTransfersTest-838195915 None] Created volume successfully.
Nov 04 12:12:56 devstack sudo[92899]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ee02be05-afa4-49e3-a0b5-af8bc2e2f885 tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f1236e4a-8b89-4f16-8ef9-2f1297396461" returned: 0 in 0.395s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:56 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ee02be05-afa4-49e3-a0b5-af8bc2e2f885 tempest-GroupSnapshotsTest-581803404 None] Lock "cinder-quobyte-f1236e4a-8b89-4f16-8ef9-2f1297396461" released by "delete_volume" :: held 1.183s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:12:56 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-ee02be05-afa4-49e3-a0b5-af8bc2e2f885 tempest-GroupSnapshotsTest-581803404 None] Created reservations ['f512e79f-01f1-411d-bb71-41a90439e66c'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:12:56 devstack cinder-volume[87169]: WARNING cinder.quota [None req-ee02be05-afa4-49e3-a0b5-af8bc2e2f885 tempest-GroupSnapshotsTest-581803404 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-591290458 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-591290458, it is now deprecated. Please use the default quota class for default quota.
Nov 04 12:12:56 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-ee02be05-afa4-49e3-a0b5-af8bc2e2f885 tempest-GroupSnapshotsTest-581803404 None] Created reservations ['1e80356e-13f0-4754-8961-25cbdbe3938f', '7790df94-020a-4df7-9b7c-b72d4ca1abd2', 'ee1bb746-49ae-485f-b70e-d2f85234a0be', 'fa0f2d39-ed25-4d4c-a8dd-ff6fdaf0431b'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:12:56 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-ee02be05-afa4-49e3-a0b5-af8bc2e2f885 tempest-GroupSnapshotsTest-581803404 None] Created reservations ['ccc1dcfe-95a9-44fb-9b8d-92cfe27ed28f', '971af877-f18a-4403-a26c-20c1386ef5db', '25901bfa-756d-496e-9baf-2bee8dfd4299', '9efcc103-06e7-4009-b8dc-f82b894e7d83'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:12:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ee02be05-afa4-49e3-a0b5-af8bc2e2f885 tempest-GroupSnapshotsTest-581803404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:12:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ee02be05-afa4-49e3-a0b5-af8bc2e2f885 tempest-GroupSnapshotsTest-581803404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:12:57 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ee02be05-afa4-49e3-a0b5-af8bc2e2f885 tempest-GroupSnapshotsTest-581803404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:12:57 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ee02be05-afa4-49e3-a0b5-af8bc2e2f885 tempest-GroupSnapshotsTest-581803404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:12:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ee02be05-afa4-49e3-a0b5-af8bc2e2f885 tempest-GroupSnapshotsTest-581803404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:12:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ee02be05-afa4-49e3-a0b5-af8bc2e2f885 tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:57 devstack sudo[92914]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:12:57 devstack sudo[92914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:57 devstack sudo[92914]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ee02be05-afa4-49e3-a0b5-af8bc2e2f885 tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.318s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:57 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-ee02be05-afa4-49e3-a0b5-af8bc2e2f885 tempest-GroupSnapshotsTest-581803404 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:12:57 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-ee02be05-afa4-49e3-a0b5-af8bc2e2f885 tempest-GroupSnapshotsTest-581803404 None] Delete group completed successfully.
Nov 04 12:12:57 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-996c5766-e581-4d3b-95a5-5c1921e110b3 tempest-VolumesTransfersTest-76962452 None] Transfer volume completed successfully.
Nov 04 12:12:58 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-91f0ae8d-6800-4e2d-bc6a-f6cd47fee6d1 tempest-VolumesTransfersTest-1766046199 None] Acquiring lock "cinder-8d8c3848-4b48-4aa2-824d-cb71d76a310d-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:12:58 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-91f0ae8d-6800-4e2d-bc6a-f6cd47fee6d1 tempest-VolumesTransfersTest-1766046199 None] Lock "cinder-8d8c3848-4b48-4aa2-824d-cb71d76a310d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:12:58 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-91f0ae8d-6800-4e2d-bc6a-f6cd47fee6d1 tempest-VolumesTransfersTest-1766046199 None] Acquiring lock "cinder-quobyte-8d8c3848-4b48-4aa2-824d-cb71d76a310d" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:12:58 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-91f0ae8d-6800-4e2d-bc6a-f6cd47fee6d1 tempest-VolumesTransfersTest-1766046199 None] Lock "cinder-quobyte-8d8c3848-4b48-4aa2-824d-cb71d76a310d" acquired by "delete_volume" :: waited 0.018s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:12:58 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[280305b7-604e-4710-ad98-29aa27a4f44f]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:12:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-91f0ae8d-6800-4e2d-bc6a-f6cd47fee6d1 tempest-VolumesTransfersTest-1766046199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8d8c3848-4b48-4aa2-824d-cb71d76a310d {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:58 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-061c0a9f-98b8-4a83-a28a-ab702c878aac tempest-GroupSnapshotsTest-581803404 None] Group tempest-GroupSnapshotsTest-Group-116968967: creating
Nov 04 12:12:58 devstack sudo[92917]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8d8c3848-4b48-4aa2-824d-cb71d76a310d
Nov 04 12:12:58 devstack sudo[92917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:58 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-061c0a9f-98b8-4a83-a28a-ab702c878aac tempest-GroupSnapshotsTest-581803404 None] Group tempest-GroupSnapshotsTest-Group-116968967: created successfully
Nov 04 12:12:58 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-061c0a9f-98b8-4a83-a28a-ab702c878aac tempest-GroupSnapshotsTest-581803404 None] Create group completed successfully.
Nov 04 12:12:58 devstack sudo[92917]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-91f0ae8d-6800-4e2d-bc6a-f6cd47fee6d1 tempest-VolumesTransfersTest-1766046199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8d8c3848-4b48-4aa2-824d-cb71d76a310d" returned: 0 in 0.402s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-91f0ae8d-6800-4e2d-bc6a-f6cd47fee6d1 tempest-VolumesTransfersTest-1766046199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8d8c3848-4b48-4aa2-824d-cb71d76a310d {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:58 devstack sudo[92924]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8d8c3848-4b48-4aa2-824d-cb71d76a310d
Nov 04 12:12:58 devstack sudo[92924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:59 devstack sudo[92924]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-91f0ae8d-6800-4e2d-bc6a-f6cd47fee6d1 tempest-VolumesTransfersTest-1766046199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8d8c3848-4b48-4aa2-824d-cb71d76a310d" returned: 0 in 0.266s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:59 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-91f0ae8d-6800-4e2d-bc6a-f6cd47fee6d1 tempest-VolumesTransfersTest-1766046199 None] Lock "cinder-quobyte-8d8c3848-4b48-4aa2-824d-cb71d76a310d" released by "delete_volume" :: held 0.727s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:12:59 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-91f0ae8d-6800-4e2d-bc6a-f6cd47fee6d1 tempest-VolumesTransfersTest-1766046199 None] Created reservations ['df96565b-b01b-4713-8538-3649ba52d49d', '75496b21-3210-4c9f-a2b9-fbc9a95858b4', '4679dc59-fab9-4e23-a9e3-2dc716ddc556', 'e330d4ca-f849-4eea-8e2c-8392c3a164a6'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:12:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-91f0ae8d-6800-4e2d-bc6a-f6cd47fee6d1 tempest-VolumesTransfersTest-1766046199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:12:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-91f0ae8d-6800-4e2d-bc6a-f6cd47fee6d1 tempest-VolumesTransfersTest-1766046199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:12:59 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-91f0ae8d-6800-4e2d-bc6a-f6cd47fee6d1 tempest-VolumesTransfersTest-1766046199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:12:59 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-91f0ae8d-6800-4e2d-bc6a-f6cd47fee6d1 tempest-VolumesTransfersTest-1766046199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:12:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-91f0ae8d-6800-4e2d-bc6a-f6cd47fee6d1 tempest-VolumesTransfersTest-1766046199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:12:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-91f0ae8d-6800-4e2d-bc6a-f6cd47fee6d1 tempest-VolumesTransfersTest-1766046199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:12:59 devstack sudo[92927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:12:59 devstack sudo[92927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:12:59 devstack sudo[92927]: pam_unix(sudo:session): session closed for user root
Nov 04 12:12:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-91f0ae8d-6800-4e2d-bc6a-f6cd47fee6d1 tempest-VolumesTransfersTest-1766046199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.512s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:12:59 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-91f0ae8d-6800-4e2d-bc6a-f6cd47fee6d1 tempest-VolumesTransfersTest-1766046199 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:12:59 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-91f0ae8d-6800-4e2d-bc6a-f6cd47fee6d1 tempest-VolumesTransfersTest-1766046199 None] Deleted volume successfully.
Nov 04 12:12:59 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-91f0ae8d-6800-4e2d-bc6a-f6cd47fee6d1 tempest-VolumesTransfersTest-1766046199 None] Lock "cinder-8d8c3848-4b48-4aa2-824d-cb71d76a310d-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:13:00 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-d91edb38-98c5-4c31-9520-10286215a533 tempest-VolumesTransfersTest-838195915 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:13:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d91edb38-98c5-4c31-9520-10286215a533 tempest-VolumesTransfersTest-838195915 None] Flow 'volume_create_manager' (d68a6678-6873-45e4-a899-84114af9d9e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:13:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d91edb38-98c5-4c31-9520-10286215a533 tempest-VolumesTransfersTest-838195915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8746c97f-51d4-4a97-a068-fbb55ab714bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:13:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d91edb38-98c5-4c31-9520-10286215a533 tempest-VolumesTransfersTest-838195915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8746c97f-51d4-4a97-a068-fbb55ab714bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1170790115',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e5c27aa-c29c-40cf-a753-73fc8e36f3eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f3441bcbd294a8bb416807f31a5a49c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:13:00Z,use_quota=True,user_id='7bd940da17464d5aa44832ad740dba9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:13:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d91edb38-98c5-4c31-9520-10286215a533 tempest-VolumesTransfersTest-838195915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b76a69a-394c-4814-9ba9-b51729a15c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:13:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d91edb38-98c5-4c31-9520-10286215a533 tempest-VolumesTransfersTest-838195915 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b76a69a-394c-4814-9ba9-b51729a15c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:13:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d91edb38-98c5-4c31-9520-10286215a533 tempest-VolumesTransfersTest-838195915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (505ef0b8-e277-45aa-a61c-841f02cbd274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:13:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d91edb38-98c5-4c31-9520-10286215a533 tempest-VolumesTransfersTest-838195915 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (505ef0b8-e277-45aa-a61c-841f02cbd274) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e5c27aa-c29c-40cf-a753-73fc8e36f3eb', 'volume_name': 'volume-1e5c27aa-c29c-40cf-a753-73fc8e36f3eb', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:13:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d91edb38-98c5-4c31-9520-10286215a533 tempest-VolumesTransfersTest-838195915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49abc188-0c7a-415e-9161-d58d73c339d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:13:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d91edb38-98c5-4c31-9520-10286215a533 tempest-VolumesTransfersTest-838195915 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49abc188-0c7a-415e-9161-d58d73c339d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:13:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d91edb38-98c5-4c31-9520-10286215a533 tempest-VolumesTransfersTest-838195915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd8dc363-2a6d-4c7a-a378-3aaef657cd3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:13:00 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-d91edb38-98c5-4c31-9520-10286215a533 tempest-VolumesTransfersTest-838195915 None] Volume 1e5c27aa-c29c-40cf-a753-73fc8e36f3eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e5c27aa-c29c-40cf-a753-73fc8e36f3eb', 'volume_size': 1}
Nov 04 12:13:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d91edb38-98c5-4c31-9520-10286215a533 tempest-VolumesTransfersTest-838195915 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:13:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d91edb38-98c5-4c31-9520-10286215a533 tempest-VolumesTransfersTest-838195915 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:13:00 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d91edb38-98c5-4c31-9520-10286215a533 tempest-VolumesTransfersTest-838195915 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1170790115',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e5c27aa-c29c-40cf-a753-73fc8e36f3eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f3441bcbd294a8bb416807f31a5a49c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:13:00Z,use_quota=True,user_id='7bd940da17464d5aa44832ad740dba9f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:13:00 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-d91edb38-98c5-4c31-9520-10286215a533 tempest-VolumesTransfersTest-838195915 None] Creating volume 1e5c27aa-c29c-40cf-a753-73fc8e36f3eb {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:13:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d91edb38-98c5-4c31-9520-10286215a533 tempest-VolumesTransfersTest-838195915 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:13:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d91edb38-98c5-4c31-9520-10286215a533 tempest-VolumesTransfersTest-838195915 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:13:00 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d91edb38-98c5-4c31-9520-10286215a533 tempest-VolumesTransfersTest-838195915 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:13:00 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d91edb38-98c5-4c31-9520-10286215a533 tempest-VolumesTransfersTest-838195915 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:13:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d91edb38-98c5-4c31-9520-10286215a533 tempest-VolumesTransfersTest-838195915 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:13:00 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d91edb38-98c5-4c31-9520-10286215a533 tempest-VolumesTransfersTest-838195915 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:13:00 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-d91edb38-98c5-4c31-9520-10286215a533 tempest-VolumesTransfersTest-838195915 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:13:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d91edb38-98c5-4c31-9520-10286215a533 tempest-VolumesTransfersTest-838195915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1e5c27aa-c29c-40cf-a753-73fc8e36f3eb 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:13:00 devstack sudo[92954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1e5c27aa-c29c-40cf-a753-73fc8e36f3eb 1073741824
Nov 04 12:13:00 devstack sudo[92954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:13:00 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-f168ff11-6fc4-405b-bfce-5a5e50059744 tempest-GroupSnapshotsTest-581803404 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:13:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f168ff11-6fc4-405b-bfce-5a5e50059744 tempest-GroupSnapshotsTest-581803404 None] Flow 'volume_create_manager' (e6a7cb3f-4ef5-4946-8eba-4be7650bcf49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:13:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f168ff11-6fc4-405b-bfce-5a5e50059744 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a94bc06c-4ac5-4623-85f6-3206d1742759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:13:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f168ff11-6fc4-405b-bfce-5a5e50059744 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a94bc06c-4ac5-4623-85f6-3206d1742759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1665427607',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=970135d3-306c-4525-ac64-f05aadfbce5a,host='devstack@QuobyteHD#QuobyteHD',id=83da7a80-bae1-4eef-a7af-e0d28eea8699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18239611c6334bd99f08b0d276e50538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:13:01Z,use_quota=True,user_id='b56985e97bbe4ea7a2a67e3e9becd36e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81db8d44-e986-4904-ad86-11eba5ee571a),volume_type_id=81db8d44-e986-4904-ad86-11eba5ee571a)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:13:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f168ff11-6fc4-405b-bfce-5a5e50059744 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a3503d5-86ee-4079-a76e-bc9953a50683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:13:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f168ff11-6fc4-405b-bfce-5a5e50059744 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a3503d5-86ee-4079-a76e-bc9953a50683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:13:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f168ff11-6fc4-405b-bfce-5a5e50059744 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bd67b30-1ea6-4980-8dbc-006a91db5966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:13:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f168ff11-6fc4-405b-bfce-5a5e50059744 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bd67b30-1ea6-4980-8dbc-006a91db5966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83da7a80-bae1-4eef-a7af-e0d28eea8699', 'volume_name': 'volume-83da7a80-bae1-4eef-a7af-e0d28eea8699', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:13:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f168ff11-6fc4-405b-bfce-5a5e50059744 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (706999e9-d8f1-4150-96ac-bed5aa27939e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:13:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f168ff11-6fc4-405b-bfce-5a5e50059744 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (706999e9-d8f1-4150-96ac-bed5aa27939e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:13:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f168ff11-6fc4-405b-bfce-5a5e50059744 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a24161cd-3770-49c7-a101-f3b56af3ff97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:13:00 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-f168ff11-6fc4-405b-bfce-5a5e50059744 tempest-GroupSnapshotsTest-581803404 None] Volume 83da7a80-bae1-4eef-a7af-e0d28eea8699: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83da7a80-bae1-4eef-a7af-e0d28eea8699', 'volume_size': 1}
Nov 04 12:13:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f168ff11-6fc4-405b-bfce-5a5e50059744 tempest-GroupSnapshotsTest-581803404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:13:01 devstack sudo[92954]: pam_unix(sudo:session): session closed for user root
Nov 04 12:13:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d91edb38-98c5-4c31-9520-10286215a533 tempest-VolumesTransfersTest-838195915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1e5c27aa-c29c-40cf-a753-73fc8e36f3eb 1073741824" returned: 0 in 0.666s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:13:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d91edb38-98c5-4c31-9520-10286215a533 tempest-VolumesTransfersTest-838195915 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1e5c27aa-c29c-40cf-a753-73fc8e36f3eb {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:13:01 devstack sudo[92961]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1e5c27aa-c29c-40cf-a753-73fc8e36f3eb
Nov 04 12:13:01 devstack sudo[92961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:13:01 devstack sudo[92961]: pam_unix(sudo:session): session closed for user root
Nov 04 12:13:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d91edb38-98c5-4c31-9520-10286215a533 tempest-VolumesTransfersTest-838195915 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1e5c27aa-c29c-40cf-a753-73fc8e36f3eb" returned: 0 in 0.291s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:13:01 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d91edb38-98c5-4c31-9520-10286215a533 tempest-VolumesTransfersTest-838195915 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:13:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d91edb38-98c5-4c31-9520-10286215a533 tempest-VolumesTransfersTest-838195915 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:13:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f168ff11-6fc4-405b-bfce-5a5e50059744 tempest-GroupSnapshotsTest-581803404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.790s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:13:01 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f168ff11-6fc4-405b-bfce-5a5e50059744 tempest-GroupSnapshotsTest-581803404 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=970135d3-306c-4525-ac64-f05aadfbce5a,created_at=2026-11-04T11:13:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1665427607',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=970135d3-306c-4525-ac64-f05aadfbce5a,host='devstack@QuobyteHD#QuobyteHD',id=83da7a80-bae1-4eef-a7af-e0d28eea8699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18239611c6334bd99f08b0d276e50538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:13:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:13:01Z,use_quota=True,user_id='b56985e97bbe4ea7a2a67e3e9becd36e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(81db8d44-e986-4904-ad86-11eba5ee571a),volume_type_id=81db8d44-e986-4904-ad86-11eba5ee571a)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:13:01 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-f168ff11-6fc4-405b-bfce-5a5e50059744 tempest-GroupSnapshotsTest-581803404 None] Creating volume 83da7a80-bae1-4eef-a7af-e0d28eea8699 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:13:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f168ff11-6fc4-405b-bfce-5a5e50059744 tempest-GroupSnapshotsTest-581803404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:13:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f168ff11-6fc4-405b-bfce-5a5e50059744 tempest-GroupSnapshotsTest-581803404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:13:01 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f168ff11-6fc4-405b-bfce-5a5e50059744 tempest-GroupSnapshotsTest-581803404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:13:01 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f168ff11-6fc4-405b-bfce-5a5e50059744 tempest-GroupSnapshotsTest-581803404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:13:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f168ff11-6fc4-405b-bfce-5a5e50059744 tempest-GroupSnapshotsTest-581803404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:13:01 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f168ff11-6fc4-405b-bfce-5a5e50059744 tempest-GroupSnapshotsTest-581803404 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:13:01 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-f168ff11-6fc4-405b-bfce-5a5e50059744 tempest-GroupSnapshotsTest-581803404 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:13:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f168ff11-6fc4-405b-bfce-5a5e50059744 tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:13:01 devstack sudo[92966]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699 1073741824
Nov 04 12:13:01 devstack sudo[92966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:13:01 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d91edb38-98c5-4c31-9520-10286215a533 tempest-VolumesTransfersTest-838195915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd8dc363-2a6d-4c7a-a378-3aaef657cd3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e5c27aa-c29c-40cf-a753-73fc8e36f3eb', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:13:01 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d91edb38-98c5-4c31-9520-10286215a533 tempest-VolumesTransfersTest-838195915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6263d01-5963-4a91-960c-f82995c274f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:13:01 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-d91edb38-98c5-4c31-9520-10286215a533 tempest-VolumesTransfersTest-838195915 None] Volume volume-1e5c27aa-c29c-40cf-a753-73fc8e36f3eb (1e5c27aa-c29c-40cf-a753-73fc8e36f3eb): created successfully
Nov 04 12:13:01 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d91edb38-98c5-4c31-9520-10286215a533 tempest-VolumesTransfersTest-838195915 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6263d01-5963-4a91-960c-f82995c274f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:13:01 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d91edb38-98c5-4c31-9520-10286215a533 tempest-VolumesTransfersTest-838195915 None] Flow 'volume_create_manager' (d68a6678-6873-45e4-a899-84114af9d9e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:13:01 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-d91edb38-98c5-4c31-9520-10286215a533 tempest-VolumesTransfersTest-838195915 None] Created volume successfully.
Nov 04 12:13:02 devstack sudo[92966]: pam_unix(sudo:session): session closed for user root
Nov 04 12:13:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f168ff11-6fc4-405b-bfce-5a5e50059744 tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699 1073741824" returned: 0 in 0.522s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:13:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f168ff11-6fc4-405b-bfce-5a5e50059744 tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:13:02 devstack sudo[92972]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699
Nov 04 12:13:02 devstack sudo[92972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:13:02 devstack sudo[92972]: pam_unix(sudo:session): session closed for user root
Nov 04 12:13:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f168ff11-6fc4-405b-bfce-5a5e50059744 tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699" returned: 0 in 0.343s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:13:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f168ff11-6fc4-405b-bfce-5a5e50059744 tempest-GroupSnapshotsTest-581803404 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:13:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f168ff11-6fc4-405b-bfce-5a5e50059744 tempest-GroupSnapshotsTest-581803404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:13:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f168ff11-6fc4-405b-bfce-5a5e50059744 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a24161cd-3770-49c7-a101-f3b56af3ff97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83da7a80-bae1-4eef-a7af-e0d28eea8699', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:13:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f168ff11-6fc4-405b-bfce-5a5e50059744 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d672b3f-c6ff-4521-8554-5e52f4fafb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:13:02 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-f168ff11-6fc4-405b-bfce-5a5e50059744 tempest-GroupSnapshotsTest-581803404 None] Volume volume-83da7a80-bae1-4eef-a7af-e0d28eea8699 (83da7a80-bae1-4eef-a7af-e0d28eea8699): created successfully
Nov 04 12:13:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f168ff11-6fc4-405b-bfce-5a5e50059744 tempest-GroupSnapshotsTest-581803404 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d672b3f-c6ff-4521-8554-5e52f4fafb9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:13:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f168ff11-6fc4-405b-bfce-5a5e50059744 tempest-GroupSnapshotsTest-581803404 None] Flow 'volume_create_manager' (e6a7cb3f-4ef5-4946-8eba-4be7650bcf49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:13:02 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-f168ff11-6fc4-405b-bfce-5a5e50059744 tempest-GroupSnapshotsTest-581803404 None] Created volume successfully.
Nov 04 12:13:02 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-0bdfaab0-edf2-4dee-9c6c-b49d78143add tempest-VolumesTransfersTest-1766046199 None] Acquiring lock "cinder-1e5c27aa-c29c-40cf-a753-73fc8e36f3eb-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:13:02 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-0bdfaab0-edf2-4dee-9c6c-b49d78143add tempest-VolumesTransfersTest-1766046199 None] Lock "cinder-1e5c27aa-c29c-40cf-a753-73fc8e36f3eb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:13:02 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-0bdfaab0-edf2-4dee-9c6c-b49d78143add tempest-VolumesTransfersTest-1766046199 None] Acquiring lock "cinder-quobyte-1e5c27aa-c29c-40cf-a753-73fc8e36f3eb" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:13:02 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-0bdfaab0-edf2-4dee-9c6c-b49d78143add tempest-VolumesTransfersTest-1766046199 None] Lock "cinder-quobyte-1e5c27aa-c29c-40cf-a753-73fc8e36f3eb" acquired by "delete_volume" :: waited 0.019s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:13:02 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9576c4a-e495-44f4-b457-7771f4e04c93]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:13:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0bdfaab0-edf2-4dee-9c6c-b49d78143add tempest-VolumesTransfersTest-1766046199 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1e5c27aa-c29c-40cf-a753-73fc8e36f3eb {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:13:03 devstack sudo[92975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1e5c27aa-c29c-40cf-a753-73fc8e36f3eb
Nov 04 12:13:03 devstack sudo[92975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:13:03 devstack sudo[92975]: pam_unix(sudo:session): session closed for user root
Nov 04 12:13:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0bdfaab0-edf2-4dee-9c6c-b49d78143add tempest-VolumesTransfersTest-1766046199 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1e5c27aa-c29c-40cf-a753-73fc8e36f3eb" returned: 0 in 0.439s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:13:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0bdfaab0-edf2-4dee-9c6c-b49d78143add tempest-VolumesTransfersTest-1766046199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1e5c27aa-c29c-40cf-a753-73fc8e36f3eb {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:13:03 devstack sudo[92980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1e5c27aa-c29c-40cf-a753-73fc8e36f3eb
Nov 04 12:13:03 devstack sudo[92980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:13:03 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-b4635602-5593-4641-9bf7-989e591330fa tempest-GroupSnapshotsTest-581803404 None] GroupSnapshot b932de5e-903c-44c9-b21d-a4a367a71d67: creating.
Nov 04 12:13:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b4635602-5593-4641-9bf7-989e591330fa tempest-GroupSnapshotsTest-581803404 None] Group snapshot b932de5e-903c-44c9-b21d-a4a367a71d67: creating. {{(pid=87169) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 04 12:13:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b4635602-5593-4641-9bf7-989e591330fa tempest-GroupSnapshotsTest-581803404 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:13:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b4635602-5593-4641-9bf7-989e591330fa tempest-GroupSnapshotsTest-581803404 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:13:03 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-b4635602-5593-4641-9bf7-989e591330fa tempest-GroupSnapshotsTest-581803404 None] Creating offline snapshot e3900f6b-5df5-474f-8c33-57ce4a9c2568 of volume 83da7a80-bae1-4eef-a7af-e0d28eea8699 {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:13:03 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c5e2c11-b208-4bca-b175-9626ef5685d4]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:13:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b4635602-5593-4641-9bf7-989e591330fa tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:13:03 devstack sudo[92982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699
Nov 04 12:13:03 devstack sudo[92982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:13:03 devstack sudo[92980]: pam_unix(sudo:session): session closed for user root
Nov 04 12:13:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0bdfaab0-edf2-4dee-9c6c-b49d78143add tempest-VolumesTransfersTest-1766046199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1e5c27aa-c29c-40cf-a753-73fc8e36f3eb" returned: 0 in 0.283s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:13:03 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-0bdfaab0-edf2-4dee-9c6c-b49d78143add tempest-VolumesTransfersTest-1766046199 None] Lock "cinder-quobyte-1e5c27aa-c29c-40cf-a753-73fc8e36f3eb" released by "delete_volume" :: held 0.787s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:13:03 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-0bdfaab0-edf2-4dee-9c6c-b49d78143add tempest-VolumesTransfersTest-1766046199 None] Created reservations ['a142c831-6ccc-4b28-8588-f4018d65b177', 'af6e2c4c-d0fd-4acf-8c99-8a384ece4761', '26092880-c455-44a2-ad54-c65304fffe2c', 'd3b33ba5-f2e7-476c-862c-b8d62e0e720f'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:13:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-0bdfaab0-edf2-4dee-9c6c-b49d78143add tempest-VolumesTransfersTest-1766046199 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:13:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-0bdfaab0-edf2-4dee-9c6c-b49d78143add tempest-VolumesTransfersTest-1766046199 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:13:03 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-0bdfaab0-edf2-4dee-9c6c-b49d78143add tempest-VolumesTransfersTest-1766046199 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:13:03 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-0bdfaab0-edf2-4dee-9c6c-b49d78143add tempest-VolumesTransfersTest-1766046199 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:13:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-0bdfaab0-edf2-4dee-9c6c-b49d78143add tempest-VolumesTransfersTest-1766046199 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:13:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0bdfaab0-edf2-4dee-9c6c-b49d78143add tempest-VolumesTransfersTest-1766046199 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:13:03 devstack sudo[92986]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:13:03 devstack sudo[92986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:13:03 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d7df9310-3bf2-451b-815f-97df6f499ce4 tempest-AttachVolumeShelveTestJSON-907729002 None] Acquiring lock "cinder-a9bc7f83-0fc7-410e-bfda-2d0cc5d4054b-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:13:03 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d7df9310-3bf2-451b-815f-97df6f499ce4 tempest-AttachVolumeShelveTestJSON-907729002 None] Lock "cinder-a9bc7f83-0fc7-410e-bfda-2d0cc5d4054b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:13:04 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d7df9310-3bf2-451b-815f-97df6f499ce4 tempest-AttachVolumeShelveTestJSON-907729002 None] Acquiring lock "cinder-quobyte-a9bc7f83-0fc7-410e-bfda-2d0cc5d4054b" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:13:04 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d7df9310-3bf2-451b-815f-97df6f499ce4 tempest-AttachVolumeShelveTestJSON-907729002 None] Lock "cinder-quobyte-a9bc7f83-0fc7-410e-bfda-2d0cc5d4054b" acquired by "delete_volume" :: waited 0.064s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:13:04 devstack sudo[92982]: pam_unix(sudo:session): session closed for user root
Nov 04 12:13:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b4635602-5593-4641-9bf7-989e591330fa tempest-GroupSnapshotsTest-581803404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699" returned: 0 in 0.616s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:13:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b4635602-5593-4641-9bf7-989e591330fa tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699.e3900f6b-5df5-474f-8c33-57ce4a9c2568 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:13:04 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62ea3b6-27fc-407d-8c18-3d89a52f5568]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:13:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d7df9310-3bf2-451b-815f-97df6f499ce4 tempest-AttachVolumeShelveTestJSON-907729002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a9bc7f83-0fc7-410e-bfda-2d0cc5d4054b {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:13:04 devstack sudo[92990]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699.e3900f6b-5df5-474f-8c33-57ce4a9c2568 1G
Nov 04 12:13:04 devstack sudo[92990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:13:04 devstack sudo[92991]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a9bc7f83-0fc7-410e-bfda-2d0cc5d4054b
Nov 04 12:13:04 devstack sudo[92991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:13:04 devstack sudo[92986]: pam_unix(sudo:session): session closed for user root
Nov 04 12:13:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0bdfaab0-edf2-4dee-9c6c-b49d78143add tempest-VolumesTransfersTest-1766046199 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.500s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:13:04 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-0bdfaab0-edf2-4dee-9c6c-b49d78143add tempest-VolumesTransfersTest-1766046199 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:13:04 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-0bdfaab0-edf2-4dee-9c6c-b49d78143add tempest-VolumesTransfersTest-1766046199 None] Deleted volume successfully.
Nov 04 12:13:04 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-0bdfaab0-edf2-4dee-9c6c-b49d78143add tempest-VolumesTransfersTest-1766046199 None] Lock "cinder-1e5c27aa-c29c-40cf-a753-73fc8e36f3eb-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:13:04 devstack sudo[92991]: pam_unix(sudo:session): session closed for user root
Nov 04 12:13:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d7df9310-3bf2-451b-815f-97df6f499ce4 tempest-AttachVolumeShelveTestJSON-907729002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a9bc7f83-0fc7-410e-bfda-2d0cc5d4054b" returned: 0 in 0.548s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:13:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d7df9310-3bf2-451b-815f-97df6f499ce4 tempest-AttachVolumeShelveTestJSON-907729002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a9bc7f83-0fc7-410e-bfda-2d0cc5d4054b {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:13:04 devstack sudo[92990]: pam_unix(sudo:session): session closed for user root
Nov 04 12:13:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b4635602-5593-4641-9bf7-989e591330fa tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699.e3900f6b-5df5-474f-8c33-57ce4a9c2568 1G" returned: 0 in 0.602s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:13:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b4635602-5593-4641-9bf7-989e591330fa tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83da7a80-bae1-4eef-a7af-e0d28eea8699 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699.e3900f6b-5df5-474f-8c33-57ce4a9c2568 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:13:04 devstack sudo[93002]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a9bc7f83-0fc7-410e-bfda-2d0cc5d4054b
Nov 04 12:13:04 devstack sudo[93002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:13:04 devstack sudo[93003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83da7a80-bae1-4eef-a7af-e0d28eea8699 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699.e3900f6b-5df5-474f-8c33-57ce4a9c2568
Nov 04 12:13:04 devstack sudo[93003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:13:05 devstack sudo[93002]: pam_unix(sudo:session): session closed for user root
Nov 04 12:13:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d7df9310-3bf2-451b-815f-97df6f499ce4 tempest-AttachVolumeShelveTestJSON-907729002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a9bc7f83-0fc7-410e-bfda-2d0cc5d4054b" returned: 0 in 0.378s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:13:05 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d7df9310-3bf2-451b-815f-97df6f499ce4 tempest-AttachVolumeShelveTestJSON-907729002 None] Lock "cinder-quobyte-a9bc7f83-0fc7-410e-bfda-2d0cc5d4054b" released by "delete_volume" :: held 0.995s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:13:05 devstack sudo[93003]: pam_unix(sudo:session): session closed for user root
Nov 04 12:13:05 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-d7df9310-3bf2-451b-815f-97df6f499ce4 tempest-AttachVolumeShelveTestJSON-907729002 None] Created reservations ['b4686a54-2a22-4f49-b217-661cfb57ae9c', '5891f021-508a-4560-9511-8696bbd1934d', 'a04ac734-b9c8-4c64-aeaa-d50476523124', 'ec70b5bb-6e26-4e70-b571-e6ff9fbeade6'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:13:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b4635602-5593-4641-9bf7-989e591330fa tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83da7a80-bae1-4eef-a7af-e0d28eea8699 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699.e3900f6b-5df5-474f-8c33-57ce4a9c2568" returned: 0 in 0.437s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:13:05 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-b4635602-5593-4641-9bf7-989e591330fa tempest-GroupSnapshotsTest-581803404 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699.e3900f6b-5df5-474f-8c33-57ce4a9c2568 is being set with open permissions: ugo+rw: NotImplementedError
Nov 04 12:13:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b4635602-5593-4641-9bf7-989e591330fa tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699.e3900f6b-5df5-474f-8c33-57ce4a9c2568 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:13:05 devstack sudo[93015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699.e3900f6b-5df5-474f-8c33-57ce4a9c2568
Nov 04 12:13:05 devstack sudo[93015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:13:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d7df9310-3bf2-451b-815f-97df6f499ce4 tempest-AttachVolumeShelveTestJSON-907729002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:13:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d7df9310-3bf2-451b-815f-97df6f499ce4 tempest-AttachVolumeShelveTestJSON-907729002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:13:05 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d7df9310-3bf2-451b-815f-97df6f499ce4 tempest-AttachVolumeShelveTestJSON-907729002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:13:05 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d7df9310-3bf2-451b-815f-97df6f499ce4 tempest-AttachVolumeShelveTestJSON-907729002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:13:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d7df9310-3bf2-451b-815f-97df6f499ce4 tempest-AttachVolumeShelveTestJSON-907729002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:13:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d7df9310-3bf2-451b-815f-97df6f499ce4 tempest-AttachVolumeShelveTestJSON-907729002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:13:05 devstack sudo[93017]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:13:05 devstack sudo[93017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:13:05 devstack sudo[93015]: pam_unix(sudo:session): session closed for user root
Nov 04 12:13:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b4635602-5593-4641-9bf7-989e591330fa tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699.e3900f6b-5df5-474f-8c33-57ce4a9c2568" returned: 0 in 0.333s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:13:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b4635602-5593-4641-9bf7-989e591330fa tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:13:05 devstack sudo[93021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699.info
Nov 04 12:13:05 devstack sudo[93021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:13:05 devstack sudo[93017]: pam_unix(sudo:session): session closed for user root
Nov 04 12:13:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d7df9310-3bf2-451b-815f-97df6f499ce4 tempest-AttachVolumeShelveTestJSON-907729002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.304s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:13:05 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-d7df9310-3bf2-451b-815f-97df6f499ce4 tempest-AttachVolumeShelveTestJSON-907729002 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:13:05 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-d7df9310-3bf2-451b-815f-97df6f499ce4 tempest-AttachVolumeShelveTestJSON-907729002 None] Deleted volume successfully.
Nov 04 12:13:05 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d7df9310-3bf2-451b-815f-97df6f499ce4 tempest-AttachVolumeShelveTestJSON-907729002 None] Lock "cinder-a9bc7f83-0fc7-410e-bfda-2d0cc5d4054b-delete_volume" released by "delete_volume" :: held 1.723s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:13:05 devstack sudo[93021]: pam_unix(sudo:session): session closed for user root
Nov 04 12:13:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b4635602-5593-4641-9bf7-989e591330fa tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699.info" returned: 0 in 0.298s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:13:05 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-b4635602-5593-4641-9bf7-989e591330fa tempest-GroupSnapshotsTest-581803404 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 04 12:13:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b4635602-5593-4641-9bf7-989e591330fa tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:13:05 devstack sudo[93024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699.info
Nov 04 12:13:05 devstack sudo[93024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:13:06 devstack sudo[93024]: pam_unix(sudo:session): session closed for user root
Nov 04 12:13:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b4635602-5593-4641-9bf7-989e591330fa tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699.info" returned: 0 in 0.286s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:13:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b4635602-5593-4641-9bf7-989e591330fa tempest-GroupSnapshotsTest-581803404 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.686s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:13:06 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-b4635602-5593-4641-9bf7-989e591330fa tempest-GroupSnapshotsTest-581803404 None] group_snapshot b932de5e-903c-44c9-b21d-a4a367a71d67: created successfully
Nov 04 12:13:06 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-f003cd3a-36e5-4b5a-82bb-0812b8fbcc47 tempest-GroupSnapshotsTest-581803404 None] group_snapshot b932de5e-903c-44c9-b21d-a4a367a71d67: deleting
Nov 04 12:13:06 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f003cd3a-36e5-4b5a-82bb-0812b8fbcc47 tempest-GroupSnapshotsTest-581803404 None] group_snapshot b932de5e-903c-44c9-b21d-a4a367a71d67: deleting {{(pid=87169) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 04 12:13:06 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f003cd3a-36e5-4b5a-82bb-0812b8fbcc47 tempest-GroupSnapshotsTest-581803404 None] Acquiring lock "cinder-quobyte-83da7a80-bae1-4eef-a7af-e0d28eea8699" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:13:06 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f003cd3a-36e5-4b5a-82bb-0812b8fbcc47 tempest-GroupSnapshotsTest-581803404 None] Lock "cinder-quobyte-83da7a80-bae1-4eef-a7af-e0d28eea8699" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:13:06 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f003cd3a-36e5-4b5a-82bb-0812b8fbcc47 tempest-GroupSnapshotsTest-581803404 None] Acquiring lock "cinder-quobyte-e3900f6b-5df5-474f-8c33-57ce4a9c2568" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:13:07 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f003cd3a-36e5-4b5a-82bb-0812b8fbcc47 tempest-GroupSnapshotsTest-581803404 None] Lock "cinder-quobyte-e3900f6b-5df5-474f-8c33-57ce4a9c2568" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:13:07 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-f003cd3a-36e5-4b5a-82bb-0812b8fbcc47 tempest-GroupSnapshotsTest-581803404 None] Deleting offline snapshot e3900f6b-5df5-474f-8c33-57ce4a9c2568 of volume 83da7a80-bae1-4eef-a7af-e0d28eea8699 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:13:07 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-f003cd3a-36e5-4b5a-82bb-0812b8fbcc47 tempest-GroupSnapshotsTest-581803404 None] snapshot_file for this snap is: volume-83da7a80-bae1-4eef-a7af-e0d28eea8699.e3900f6b-5df5-474f-8c33-57ce4a9c2568 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:13:07 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[98317ae2-9c43-42af-96e8-6fef0d3b7874]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:13:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f003cd3a-36e5-4b5a-82bb-0812b8fbcc47 tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699.e3900f6b-5df5-474f-8c33-57ce4a9c2568 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:13:07 devstack sudo[93027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699.e3900f6b-5df5-474f-8c33-57ce4a9c2568
Nov 04 12:13:07 devstack sudo[93027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:13:07 devstack sudo[93027]: pam_unix(sudo:session): session closed for user root
Nov 04 12:13:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f003cd3a-36e5-4b5a-82bb-0812b8fbcc47 tempest-GroupSnapshotsTest-581803404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699.e3900f6b-5df5-474f-8c33-57ce4a9c2568" returned: 0 in 0.534s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:13:07 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-f003cd3a-36e5-4b5a-82bb-0812b8fbcc47 tempest-GroupSnapshotsTest-581803404 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83da7a80-bae1-4eef-a7af-e0d28eea8699(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:13:07 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9063797-e7da-44a7-81bd-082a4c28adcd]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:13:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f003cd3a-36e5-4b5a-82bb-0812b8fbcc47 tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:13:07 devstack sudo[93035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699
Nov 04 12:13:07 devstack sudo[93035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:13:08 devstack sudo[93035]: pam_unix(sudo:session): session closed for user root
Nov 04 12:13:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f003cd3a-36e5-4b5a-82bb-0812b8fbcc47 tempest-GroupSnapshotsTest-581803404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699" returned: 0 in 0.476s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:13:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f003cd3a-36e5-4b5a-82bb-0812b8fbcc47 tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699.e3900f6b-5df5-474f-8c33-57ce4a9c2568 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:13:08 devstack sudo[93041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699.e3900f6b-5df5-474f-8c33-57ce4a9c2568
Nov 04 12:13:08 devstack sudo[93041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:13:08 devstack sudo[93041]: pam_unix(sudo:session): session closed for user root
Nov 04 12:13:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f003cd3a-36e5-4b5a-82bb-0812b8fbcc47 tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699.e3900f6b-5df5-474f-8c33-57ce4a9c2568" returned: 0 in 0.531s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:13:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f003cd3a-36e5-4b5a-82bb-0812b8fbcc47 tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699.e3900f6b-5df5-474f-8c33-57ce4a9c2568 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:13:08 devstack sudo[93047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699.e3900f6b-5df5-474f-8c33-57ce4a9c2568
Nov 04 12:13:08 devstack sudo[93047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:13:09 devstack sudo[93047]: pam_unix(sudo:session): session closed for user root
Nov 04 12:13:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f003cd3a-36e5-4b5a-82bb-0812b8fbcc47 tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699.e3900f6b-5df5-474f-8c33-57ce4a9c2568" returned: 0 in 0.309s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:13:09 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f003cd3a-36e5-4b5a-82bb-0812b8fbcc47 tempest-GroupSnapshotsTest-581803404 None] Lock "cinder-quobyte-e3900f6b-5df5-474f-8c33-57ce4a9c2568" released by "_delete_snapshot" :: held 2.015s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:13:09 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f003cd3a-36e5-4b5a-82bb-0812b8fbcc47 tempest-GroupSnapshotsTest-581803404 None] Lock "cinder-quobyte-83da7a80-bae1-4eef-a7af-e0d28eea8699" released by "delete_snapshot" :: held 2.060s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:13:09 devstack cinder-volume[87169]: WARNING cinder.quota [None req-f003cd3a-36e5-4b5a-82bb-0812b8fbcc47 tempest-GroupSnapshotsTest-581803404 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1097552511 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1097552511, it is now deprecated. Please use the default quota class for default quota.
Nov 04 12:13:09 devstack cinder-volume[87169]: WARNING cinder.quota [None req-f003cd3a-36e5-4b5a-82bb-0812b8fbcc47 tempest-GroupSnapshotsTest-581803404 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1097552511 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1097552511, it is now deprecated. Please use the default quota class for default quota.
Nov 04 12:13:09 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-f003cd3a-36e5-4b5a-82bb-0812b8fbcc47 tempest-GroupSnapshotsTest-581803404 None] Created reservations ['7bff10a0-66c3-41b5-ade1-61069a63d373', 'b293adb5-59c9-4e1c-8632-b6f63ba0c98d', '7b8f1c35-6bfd-4892-b490-6b2e1d52ca91', '78b5f75b-2ed2-4231-b772-363836fcdb56'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:13:09 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-f003cd3a-36e5-4b5a-82bb-0812b8fbcc47 tempest-GroupSnapshotsTest-581803404 None] group_snapshot b932de5e-903c-44c9-b21d-a4a367a71d67: deleted successfully
Nov 04 12:13:09 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3422441b-179d-4fb8-a44d-1e27fa847507 tempest-GroupSnapshotsTest-581803404 None] Acquiring lock "cinder-quobyte-83da7a80-bae1-4eef-a7af-e0d28eea8699" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:13:09 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3422441b-179d-4fb8-a44d-1e27fa847507 tempest-GroupSnapshotsTest-581803404 None] Lock "cinder-quobyte-83da7a80-bae1-4eef-a7af-e0d28eea8699" acquired by "delete_volume" :: waited 0.019s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:13:09 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3947da-7e5a-4b3d-8803-0cdd60bf5b0e]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:13:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3422441b-179d-4fb8-a44d-1e27fa847507 tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:13:10 devstack sudo[93050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699
Nov 04 12:13:10 devstack sudo[93050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:13:10 devstack sudo[93050]: pam_unix(sudo:session): session closed for user root
Nov 04 12:13:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3422441b-179d-4fb8-a44d-1e27fa847507 tempest-GroupSnapshotsTest-581803404 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699" returned: 0 in 0.434s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:13:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3422441b-179d-4fb8-a44d-1e27fa847507 tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:13:10 devstack sudo[93055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699
Nov 04 12:13:10 devstack sudo[93055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:13:10 devstack sudo[93055]: pam_unix(sudo:session): session closed for user root
Nov 04 12:13:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3422441b-179d-4fb8-a44d-1e27fa847507 tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-83da7a80-bae1-4eef-a7af-e0d28eea8699" returned: 0 in 0.255s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:13:10 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3422441b-179d-4fb8-a44d-1e27fa847507 tempest-GroupSnapshotsTest-581803404 None] Lock "cinder-quobyte-83da7a80-bae1-4eef-a7af-e0d28eea8699" released by "delete_volume" :: held 0.817s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:13:10 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-3422441b-179d-4fb8-a44d-1e27fa847507 tempest-GroupSnapshotsTest-581803404 None] Created reservations ['5d455b89-768e-4fb2-88b0-d97d90b1d688'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:13:10 devstack cinder-volume[87169]: WARNING cinder.quota [None req-3422441b-179d-4fb8-a44d-1e27fa847507 tempest-GroupSnapshotsTest-581803404 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1097552511 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1097552511, it is now deprecated. Please use the default quota class for default quota.
Nov 04 12:13:10 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-3422441b-179d-4fb8-a44d-1e27fa847507 tempest-GroupSnapshotsTest-581803404 None] Created reservations ['d416f4be-a438-4dc7-92d3-e684955d3ebf', 'f65adc17-6119-478a-9ce0-57d09abca3b3', 'fe827bb6-4014-4402-a251-b3e344327bf3', '206f367d-b7df-4a7f-9452-20879b990051'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:13:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3422441b-179d-4fb8-a44d-1e27fa847507 tempest-GroupSnapshotsTest-581803404 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:13:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3422441b-179d-4fb8-a44d-1e27fa847507 tempest-GroupSnapshotsTest-581803404 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:13:10 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3422441b-179d-4fb8-a44d-1e27fa847507 tempest-GroupSnapshotsTest-581803404 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:13:10 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3422441b-179d-4fb8-a44d-1e27fa847507 tempest-GroupSnapshotsTest-581803404 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:13:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3422441b-179d-4fb8-a44d-1e27fa847507 tempest-GroupSnapshotsTest-581803404 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:13:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3422441b-179d-4fb8-a44d-1e27fa847507 tempest-GroupSnapshotsTest-581803404 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:13:10 devstack sudo[93059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:13:10 devstack sudo[93059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:13:11 devstack sudo[93059]: pam_unix(sudo:session): session closed for user root
Nov 04 12:13:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3422441b-179d-4fb8-a44d-1e27fa847507 tempest-GroupSnapshotsTest-581803404 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.291s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:13:11 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-3422441b-179d-4fb8-a44d-1e27fa847507 tempest-GroupSnapshotsTest-581803404 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:13:11 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-3422441b-179d-4fb8-a44d-1e27fa847507 tempest-GroupSnapshotsTest-581803404 None] Delete group completed successfully.
Nov 04 12:13:18 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=141,cinder:UPDATE=161,cinder:INSERT=43,cinder:DELETE=7 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:13:18 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=146,cinder:UPDATE=152,cinder:INSERT=31,cinder:DELETE=5 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:13:18 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-872b8e57-d178-4aef-9dc2-f0bfcf9c439d tempest-VolumesTransfersV355Test-1927505488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:13:18 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-872b8e57-d178-4aef-9dc2-f0bfcf9c439d tempest-VolumesTransfersV355Test-1927505488 None] Flow 'volume_create_manager' (3ee75c04-f5ee-463d-814e-313a7f1e5573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:13:18 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-872b8e57-d178-4aef-9dc2-f0bfcf9c439d tempest-VolumesTransfersV355Test-1927505488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caeea412-c45e-4c10-812f-d8a7b97fe26c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:13:18 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-872b8e57-d178-4aef-9dc2-f0bfcf9c439d tempest-VolumesTransfersV355Test-1927505488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caeea412-c45e-4c10-812f-d8a7b97fe26c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1462350843',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=144a0971-8d5c-49d0-a72a-69323f720932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31784aae403482e82a559aed153db69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:13:18Z,use_quota=True,user_id='9b4fe3e42aad4ddfbaec352c341f4ea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:13:18 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-872b8e57-d178-4aef-9dc2-f0bfcf9c439d tempest-VolumesTransfersV355Test-1927505488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e752d13-722b-4503-bd1a-1c1994a9c072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:13:18 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-872b8e57-d178-4aef-9dc2-f0bfcf9c439d tempest-VolumesTransfersV355Test-1927505488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e752d13-722b-4503-bd1a-1c1994a9c072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:13:18 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-872b8e57-d178-4aef-9dc2-f0bfcf9c439d tempest-VolumesTransfersV355Test-1927505488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (385532e5-196d-4aeb-9ebb-37baa0f2b433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:13:18 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-872b8e57-d178-4aef-9dc2-f0bfcf9c439d tempest-VolumesTransfersV355Test-1927505488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (385532e5-196d-4aeb-9ebb-37baa0f2b433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '144a0971-8d5c-49d0-a72a-69323f720932', 'volume_name': 'volume-144a0971-8d5c-49d0-a72a-69323f720932', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:13:18 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-872b8e57-d178-4aef-9dc2-f0bfcf9c439d tempest-VolumesTransfersV355Test-1927505488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb6158db-6d6a-4a42-89be-c8124f758931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:13:18 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-872b8e57-d178-4aef-9dc2-f0bfcf9c439d tempest-VolumesTransfersV355Test-1927505488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb6158db-6d6a-4a42-89be-c8124f758931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:13:18 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-872b8e57-d178-4aef-9dc2-f0bfcf9c439d tempest-VolumesTransfersV355Test-1927505488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e9fb70-5d23-4836-8290-439cba736dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:13:18 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-872b8e57-d178-4aef-9dc2-f0bfcf9c439d tempest-VolumesTransfersV355Test-1927505488 None] Volume 144a0971-8d5c-49d0-a72a-69323f720932: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-144a0971-8d5c-49d0-a72a-69323f720932', 'volume_size': 1}
Nov 04 12:13:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-872b8e57-d178-4aef-9dc2-f0bfcf9c439d tempest-VolumesTransfersV355Test-1927505488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:13:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-872b8e57-d178-4aef-9dc2-f0bfcf9c439d tempest-VolumesTransfersV355Test-1927505488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:13:18 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-872b8e57-d178-4aef-9dc2-f0bfcf9c439d tempest-VolumesTransfersV355Test-1927505488 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1462350843',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=144a0971-8d5c-49d0-a72a-69323f720932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31784aae403482e82a559aed153db69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:13:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:13:18Z,use_quota=True,user_id='9b4fe3e42aad4ddfbaec352c341f4ea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:13:18 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-872b8e57-d178-4aef-9dc2-f0bfcf9c439d tempest-VolumesTransfersV355Test-1927505488 None] Creating volume 144a0971-8d5c-49d0-a72a-69323f720932 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:13:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-872b8e57-d178-4aef-9dc2-f0bfcf9c439d tempest-VolumesTransfersV355Test-1927505488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:13:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-872b8e57-d178-4aef-9dc2-f0bfcf9c439d tempest-VolumesTransfersV355Test-1927505488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:13:18 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-872b8e57-d178-4aef-9dc2-f0bfcf9c439d tempest-VolumesTransfersV355Test-1927505488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:13:18 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-872b8e57-d178-4aef-9dc2-f0bfcf9c439d tempest-VolumesTransfersV355Test-1927505488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:13:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-872b8e57-d178-4aef-9dc2-f0bfcf9c439d tempest-VolumesTransfersV355Test-1927505488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:13:18 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-872b8e57-d178-4aef-9dc2-f0bfcf9c439d tempest-VolumesTransfersV355Test-1927505488 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:13:18 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-872b8e57-d178-4aef-9dc2-f0bfcf9c439d tempest-VolumesTransfersV355Test-1927505488 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:13:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-872b8e57-d178-4aef-9dc2-f0bfcf9c439d tempest-VolumesTransfersV355Test-1927505488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-144a0971-8d5c-49d0-a72a-69323f720932 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:13:18 devstack sudo[93064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-144a0971-8d5c-49d0-a72a-69323f720932 1073741824
Nov 04 12:13:18 devstack sudo[93064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:13:18 devstack sudo[93064]: pam_unix(sudo:session): session closed for user root
Nov 04 12:13:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-872b8e57-d178-4aef-9dc2-f0bfcf9c439d tempest-VolumesTransfersV355Test-1927505488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-144a0971-8d5c-49d0-a72a-69323f720932 1073741824" returned: 0 in 0.621s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:13:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-872b8e57-d178-4aef-9dc2-f0bfcf9c439d tempest-VolumesTransfersV355Test-1927505488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-144a0971-8d5c-49d0-a72a-69323f720932 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:13:19 devstack sudo[93070]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-144a0971-8d5c-49d0-a72a-69323f720932
Nov 04 12:13:19 devstack sudo[93070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:13:19 devstack sudo[93070]: pam_unix(sudo:session): session closed for user root
Nov 04 12:13:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-872b8e57-d178-4aef-9dc2-f0bfcf9c439d tempest-VolumesTransfersV355Test-1927505488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-144a0971-8d5c-49d0-a72a-69323f720932" returned: 0 in 0.288s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:13:19 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-872b8e57-d178-4aef-9dc2-f0bfcf9c439d tempest-VolumesTransfersV355Test-1927505488 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:13:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-872b8e57-d178-4aef-9dc2-f0bfcf9c439d tempest-VolumesTransfersV355Test-1927505488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:13:19 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-872b8e57-d178-4aef-9dc2-f0bfcf9c439d tempest-VolumesTransfersV355Test-1927505488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84e9fb70-5d23-4836-8290-439cba736dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-144a0971-8d5c-49d0-a72a-69323f720932', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:13:19 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-872b8e57-d178-4aef-9dc2-f0bfcf9c439d tempest-VolumesTransfersV355Test-1927505488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3351ab22-b0e6-4905-8c6b-17136de60332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:13:19 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-872b8e57-d178-4aef-9dc2-f0bfcf9c439d tempest-VolumesTransfersV355Test-1927505488 None] Volume volume-144a0971-8d5c-49d0-a72a-69323f720932 (144a0971-8d5c-49d0-a72a-69323f720932): created successfully
Nov 04 12:13:19 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-872b8e57-d178-4aef-9dc2-f0bfcf9c439d tempest-VolumesTransfersV355Test-1927505488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3351ab22-b0e6-4905-8c6b-17136de60332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:13:19 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-872b8e57-d178-4aef-9dc2-f0bfcf9c439d tempest-VolumesTransfersV355Test-1927505488 None] Flow 'volume_create_manager' (3ee75c04-f5ee-463d-814e-313a7f1e5573) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:13:19 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-872b8e57-d178-4aef-9dc2-f0bfcf9c439d tempest-VolumesTransfersV355Test-1927505488 None] Created volume successfully.
Nov 04 12:13:21 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-a652fc64-68b3-4e60-ace0-5524a2a2b573 tempest-VolumesTransfersV355Test-512281114 None] Transfer volume completed successfully.
Nov 04 12:13:22 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-644727a0-894f-4ac7-b830-d73279cb3d78 tempest-VolumesTransfersV355Test-389165323 None] Acquiring lock "cinder-144a0971-8d5c-49d0-a72a-69323f720932-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:13:22 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-644727a0-894f-4ac7-b830-d73279cb3d78 tempest-VolumesTransfersV355Test-389165323 None] Lock "cinder-144a0971-8d5c-49d0-a72a-69323f720932-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:13:22 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-644727a0-894f-4ac7-b830-d73279cb3d78 tempest-VolumesTransfersV355Test-389165323 None] Acquiring lock "cinder-quobyte-144a0971-8d5c-49d0-a72a-69323f720932" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:13:22 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-644727a0-894f-4ac7-b830-d73279cb3d78 tempest-VolumesTransfersV355Test-389165323 None] Lock "cinder-quobyte-144a0971-8d5c-49d0-a72a-69323f720932" acquired by "delete_volume" :: waited 0.027s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:13:22 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[25a31c16-862a-4ce8-923d-eec2aeebd7bc]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:13:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-644727a0-894f-4ac7-b830-d73279cb3d78 tempest-VolumesTransfersV355Test-389165323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-144a0971-8d5c-49d0-a72a-69323f720932 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:13:22 devstack sudo[93075]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-144a0971-8d5c-49d0-a72a-69323f720932
Nov 04 12:13:22 devstack sudo[93075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:13:22 devstack sudo[93075]: pam_unix(sudo:session): session closed for user root
Nov 04 12:13:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-644727a0-894f-4ac7-b830-d73279cb3d78 tempest-VolumesTransfersV355Test-389165323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-144a0971-8d5c-49d0-a72a-69323f720932" returned: 0 in 0.448s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:13:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-644727a0-894f-4ac7-b830-d73279cb3d78 tempest-VolumesTransfersV355Test-389165323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-144a0971-8d5c-49d0-a72a-69323f720932 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:13:22 devstack sudo[93081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-144a0971-8d5c-49d0-a72a-69323f720932
Nov 04 12:13:22 devstack sudo[93081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:13:23 devstack sudo[93081]: pam_unix(sudo:session): session closed for user root
Nov 04 12:13:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-644727a0-894f-4ac7-b830-d73279cb3d78 tempest-VolumesTransfersV355Test-389165323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-144a0971-8d5c-49d0-a72a-69323f720932" returned: 0 in 0.344s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:13:23 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-644727a0-894f-4ac7-b830-d73279cb3d78 tempest-VolumesTransfersV355Test-389165323 None] Lock "cinder-quobyte-144a0971-8d5c-49d0-a72a-69323f720932" released by "delete_volume" :: held 0.869s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:13:23 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-644727a0-894f-4ac7-b830-d73279cb3d78 tempest-VolumesTransfersV355Test-389165323 None] Created reservations ['7fcadcf6-c995-45aa-86d5-3345bdb2400c', 'ff50ac8a-9dd2-4202-a1db-4e6fb3f92494', 'ec3bacbc-222f-4d5a-85d1-d8fae11c4563', '351b662d-fa01-4d38-9937-8a11060189d7'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:13:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-644727a0-894f-4ac7-b830-d73279cb3d78 tempest-VolumesTransfersV355Test-389165323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:13:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-644727a0-894f-4ac7-b830-d73279cb3d78 tempest-VolumesTransfersV355Test-389165323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:13:23 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-644727a0-894f-4ac7-b830-d73279cb3d78 tempest-VolumesTransfersV355Test-389165323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:13:23 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-644727a0-894f-4ac7-b830-d73279cb3d78 tempest-VolumesTransfersV355Test-389165323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:13:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-644727a0-894f-4ac7-b830-d73279cb3d78 tempest-VolumesTransfersV355Test-389165323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:13:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-644727a0-894f-4ac7-b830-d73279cb3d78 tempest-VolumesTransfersV355Test-389165323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:13:23 devstack sudo[93084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:13:23 devstack sudo[93084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:13:23 devstack sudo[93084]: pam_unix(sudo:session): session closed for user root
Nov 04 12:13:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-644727a0-894f-4ac7-b830-d73279cb3d78 tempest-VolumesTransfersV355Test-389165323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.291s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:13:23 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-644727a0-894f-4ac7-b830-d73279cb3d78 tempest-VolumesTransfersV355Test-389165323 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:13:23 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-644727a0-894f-4ac7-b830-d73279cb3d78 tempest-VolumesTransfersV355Test-389165323 None] Deleted volume successfully.
Nov 04 12:13:23 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-644727a0-894f-4ac7-b830-d73279cb3d78 tempest-VolumesTransfersV355Test-389165323 None] Lock "cinder-144a0971-8d5c-49d0-a72a-69323f720932-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:13:25 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-04dfd9ca-8dd5-4053-a5d6-1ca7f33cbc81 tempest-VolumesTransfersV355Test-1927505488 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:13:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-04dfd9ca-8dd5-4053-a5d6-1ca7f33cbc81 tempest-VolumesTransfersV355Test-1927505488 None] Flow 'volume_create_manager' (5eda5735-1ee9-4023-91a0-e61b89877375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:13:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-04dfd9ca-8dd5-4053-a5d6-1ca7f33cbc81 tempest-VolumesTransfersV355Test-1927505488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30b294c9-cafc-4505-8d99-da467296448d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:13:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-04dfd9ca-8dd5-4053-a5d6-1ca7f33cbc81 tempest-VolumesTransfersV355Test-1927505488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30b294c9-cafc-4505-8d99-da467296448d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-614970108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8407b37d-8048-40f0-a3a2-4e6f65ad80ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31784aae403482e82a559aed153db69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:13:26Z,use_quota=True,user_id='9b4fe3e42aad4ddfbaec352c341f4ea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:13:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-04dfd9ca-8dd5-4053-a5d6-1ca7f33cbc81 tempest-VolumesTransfersV355Test-1927505488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24be9bb1-d391-4c79-aded-564ae510bb75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:13:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-04dfd9ca-8dd5-4053-a5d6-1ca7f33cbc81 tempest-VolumesTransfersV355Test-1927505488 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24be9bb1-d391-4c79-aded-564ae510bb75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:13:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-04dfd9ca-8dd5-4053-a5d6-1ca7f33cbc81 tempest-VolumesTransfersV355Test-1927505488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89c9a243-fd05-4ff5-a3fd-727b734224a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:13:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-04dfd9ca-8dd5-4053-a5d6-1ca7f33cbc81 tempest-VolumesTransfersV355Test-1927505488 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89c9a243-fd05-4ff5-a3fd-727b734224a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8407b37d-8048-40f0-a3a2-4e6f65ad80ca', 'volume_name': 'volume-8407b37d-8048-40f0-a3a2-4e6f65ad80ca', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:13:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-04dfd9ca-8dd5-4053-a5d6-1ca7f33cbc81 tempest-VolumesTransfersV355Test-1927505488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b68efdd3-1c73-47ef-8036-48e926dc5a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:13:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-04dfd9ca-8dd5-4053-a5d6-1ca7f33cbc81 tempest-VolumesTransfersV355Test-1927505488 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b68efdd3-1c73-47ef-8036-48e926dc5a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:13:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-04dfd9ca-8dd5-4053-a5d6-1ca7f33cbc81 tempest-VolumesTransfersV355Test-1927505488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcce23ac-d329-4b98-8950-4705db5fb1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:13:25 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-04dfd9ca-8dd5-4053-a5d6-1ca7f33cbc81 tempest-VolumesTransfersV355Test-1927505488 None] Volume 8407b37d-8048-40f0-a3a2-4e6f65ad80ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8407b37d-8048-40f0-a3a2-4e6f65ad80ca', 'volume_size': 1}
Nov 04 12:13:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-04dfd9ca-8dd5-4053-a5d6-1ca7f33cbc81 tempest-VolumesTransfersV355Test-1927505488 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:13:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-04dfd9ca-8dd5-4053-a5d6-1ca7f33cbc81 tempest-VolumesTransfersV355Test-1927505488 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:13:25 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-04dfd9ca-8dd5-4053-a5d6-1ca7f33cbc81 tempest-VolumesTransfersV355Test-1927505488 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:13:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-614970108',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8407b37d-8048-40f0-a3a2-4e6f65ad80ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f31784aae403482e82a559aed153db69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:13:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:13:26Z,use_quota=True,user_id='9b4fe3e42aad4ddfbaec352c341f4ea1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:13:25 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-04dfd9ca-8dd5-4053-a5d6-1ca7f33cbc81 tempest-VolumesTransfersV355Test-1927505488 None] Creating volume 8407b37d-8048-40f0-a3a2-4e6f65ad80ca {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:13:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-04dfd9ca-8dd5-4053-a5d6-1ca7f33cbc81 tempest-VolumesTransfersV355Test-1927505488 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:13:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-04dfd9ca-8dd5-4053-a5d6-1ca7f33cbc81 tempest-VolumesTransfersV355Test-1927505488 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:13:25 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-04dfd9ca-8dd5-4053-a5d6-1ca7f33cbc81 tempest-VolumesTransfersV355Test-1927505488 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:13:25 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-04dfd9ca-8dd5-4053-a5d6-1ca7f33cbc81 tempest-VolumesTransfersV355Test-1927505488 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:13:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-04dfd9ca-8dd5-4053-a5d6-1ca7f33cbc81 tempest-VolumesTransfersV355Test-1927505488 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:13:25 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-04dfd9ca-8dd5-4053-a5d6-1ca7f33cbc81 tempest-VolumesTransfersV355Test-1927505488 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:13:25 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-04dfd9ca-8dd5-4053-a5d6-1ca7f33cbc81 tempest-VolumesTransfersV355Test-1927505488 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:13:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-04dfd9ca-8dd5-4053-a5d6-1ca7f33cbc81 tempest-VolumesTransfersV355Test-1927505488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8407b37d-8048-40f0-a3a2-4e6f65ad80ca 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:13:26 devstack sudo[93126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8407b37d-8048-40f0-a3a2-4e6f65ad80ca 1073741824
Nov 04 12:13:26 devstack sudo[93126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:13:26 devstack sudo[93126]: pam_unix(sudo:session): session closed for user root
Nov 04 12:13:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-04dfd9ca-8dd5-4053-a5d6-1ca7f33cbc81 tempest-VolumesTransfersV355Test-1927505488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8407b37d-8048-40f0-a3a2-4e6f65ad80ca 1073741824" returned: 0 in 0.902s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:13:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-04dfd9ca-8dd5-4053-a5d6-1ca7f33cbc81 tempest-VolumesTransfersV355Test-1927505488 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8407b37d-8048-40f0-a3a2-4e6f65ad80ca {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:13:26 devstack sudo[93137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8407b37d-8048-40f0-a3a2-4e6f65ad80ca
Nov 04 12:13:26 devstack sudo[93137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:13:27 devstack sudo[93137]: pam_unix(sudo:session): session closed for user root
Nov 04 12:13:27 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-04dfd9ca-8dd5-4053-a5d6-1ca7f33cbc81 tempest-VolumesTransfersV355Test-1927505488 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8407b37d-8048-40f0-a3a2-4e6f65ad80ca" returned: 0 in 0.455s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:13:27 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-04dfd9ca-8dd5-4053-a5d6-1ca7f33cbc81 tempest-VolumesTransfersV355Test-1927505488 None] <== create_volume: return (1449ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:13:27 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-04dfd9ca-8dd5-4053-a5d6-1ca7f33cbc81 tempest-VolumesTransfersV355Test-1927505488 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.457s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:13:27 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-04dfd9ca-8dd5-4053-a5d6-1ca7f33cbc81 tempest-VolumesTransfersV355Test-1927505488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dcce23ac-d329-4b98-8950-4705db5fb1b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8407b37d-8048-40f0-a3a2-4e6f65ad80ca', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:13:27 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-04dfd9ca-8dd5-4053-a5d6-1ca7f33cbc81 tempest-VolumesTransfersV355Test-1927505488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a94c39a-28c2-4f80-8d08-f882f965bf34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:13:27 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-04dfd9ca-8dd5-4053-a5d6-1ca7f33cbc81 tempest-VolumesTransfersV355Test-1927505488 None] Volume volume-8407b37d-8048-40f0-a3a2-4e6f65ad80ca (8407b37d-8048-40f0-a3a2-4e6f65ad80ca): created successfully
Nov 04 12:13:27 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-04dfd9ca-8dd5-4053-a5d6-1ca7f33cbc81 tempest-VolumesTransfersV355Test-1927505488 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a94c39a-28c2-4f80-8d08-f882f965bf34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:13:27 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-04dfd9ca-8dd5-4053-a5d6-1ca7f33cbc81 tempest-VolumesTransfersV355Test-1927505488 None] Flow 'volume_create_manager' (5eda5735-1ee9-4023-91a0-e61b89877375) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:13:27 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-04dfd9ca-8dd5-4053-a5d6-1ca7f33cbc81 tempest-VolumesTransfersV355Test-1927505488 None] Created volume successfully.
Nov 04 12:13:28 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-7d5e4ea2-2f20-4cc7-9035-72ee0c1a8d05 tempest-VolumesTransfersV355Test-389165323 None] Acquiring lock "cinder-8407b37d-8048-40f0-a3a2-4e6f65ad80ca-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:13:28 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-7d5e4ea2-2f20-4cc7-9035-72ee0c1a8d05 tempest-VolumesTransfersV355Test-389165323 None] Lock "cinder-8407b37d-8048-40f0-a3a2-4e6f65ad80ca-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:13:28 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-7d5e4ea2-2f20-4cc7-9035-72ee0c1a8d05 tempest-VolumesTransfersV355Test-389165323 None] Acquiring lock "cinder-quobyte-8407b37d-8048-40f0-a3a2-4e6f65ad80ca" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:13:28 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-7d5e4ea2-2f20-4cc7-9035-72ee0c1a8d05 tempest-VolumesTransfersV355Test-389165323 None] Lock "cinder-quobyte-8407b37d-8048-40f0-a3a2-4e6f65ad80ca" acquired by "delete_volume" :: waited 0.035s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:13:28 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b285316-801f-408f-87e8-ced61e393e0e]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:13:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7d5e4ea2-2f20-4cc7-9035-72ee0c1a8d05 tempest-VolumesTransfersV355Test-389165323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8407b37d-8048-40f0-a3a2-4e6f65ad80ca {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:13:28 devstack sudo[93157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8407b37d-8048-40f0-a3a2-4e6f65ad80ca
Nov 04 12:13:28 devstack sudo[93157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:13:29 devstack sudo[93157]: pam_unix(sudo:session): session closed for user root
Nov 04 12:13:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7d5e4ea2-2f20-4cc7-9035-72ee0c1a8d05 tempest-VolumesTransfersV355Test-389165323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8407b37d-8048-40f0-a3a2-4e6f65ad80ca" returned: 0 in 0.655s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:13:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7d5e4ea2-2f20-4cc7-9035-72ee0c1a8d05 tempest-VolumesTransfersV355Test-389165323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8407b37d-8048-40f0-a3a2-4e6f65ad80ca {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:13:29 devstack sudo[93169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8407b37d-8048-40f0-a3a2-4e6f65ad80ca
Nov 04 12:13:29 devstack sudo[93169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:13:29 devstack sudo[93169]: pam_unix(sudo:session): session closed for user root
Nov 04 12:13:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7d5e4ea2-2f20-4cc7-9035-72ee0c1a8d05 tempest-VolumesTransfersV355Test-389165323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8407b37d-8048-40f0-a3a2-4e6f65ad80ca" returned: 0 in 0.493s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:13:29 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-7d5e4ea2-2f20-4cc7-9035-72ee0c1a8d05 tempest-VolumesTransfersV355Test-389165323 None] Lock "cinder-quobyte-8407b37d-8048-40f0-a3a2-4e6f65ad80ca" released by "delete_volume" :: held 1.219s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:13:29 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-7d5e4ea2-2f20-4cc7-9035-72ee0c1a8d05 tempest-VolumesTransfersV355Test-389165323 None] Created reservations ['10653e61-042b-4150-9db9-3ae4fa8dbf1e', 'c4aee922-9e14-48fa-81fb-3642ad4abe77', 'f4ca1f56-9b34-4186-a70f-4c40ef55129d', 'a4719403-1a99-42ed-808f-3014a76cc57b'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:13:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7d5e4ea2-2f20-4cc7-9035-72ee0c1a8d05 tempest-VolumesTransfersV355Test-389165323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:13:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7d5e4ea2-2f20-4cc7-9035-72ee0c1a8d05 tempest-VolumesTransfersV355Test-389165323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:13:30 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-7d5e4ea2-2f20-4cc7-9035-72ee0c1a8d05 tempest-VolumesTransfersV355Test-389165323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:13:30 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-7d5e4ea2-2f20-4cc7-9035-72ee0c1a8d05 tempest-VolumesTransfersV355Test-389165323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:13:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7d5e4ea2-2f20-4cc7-9035-72ee0c1a8d05 tempest-VolumesTransfersV355Test-389165323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:13:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7d5e4ea2-2f20-4cc7-9035-72ee0c1a8d05 tempest-VolumesTransfersV355Test-389165323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:13:30 devstack sudo[93181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:13:30 devstack sudo[93181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:13:30 devstack sudo[93181]: pam_unix(sudo:session): session closed for user root
Nov 04 12:13:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7d5e4ea2-2f20-4cc7-9035-72ee0c1a8d05 tempest-VolumesTransfersV355Test-389165323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.287s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:13:30 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-7d5e4ea2-2f20-4cc7-9035-72ee0c1a8d05 tempest-VolumesTransfersV355Test-389165323 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:13:30 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-7d5e4ea2-2f20-4cc7-9035-72ee0c1a8d05 tempest-VolumesTransfersV355Test-389165323 None] Deleted volume successfully.
Nov 04 12:13:30 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-7d5e4ea2-2f20-4cc7-9035-72ee0c1a8d05 tempest-VolumesTransfersV355Test-389165323 None] Lock "cinder-8407b37d-8048-40f0-a3a2-4e6f65ad80ca-delete_volume" released by "delete_volume" :: held 1.899s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:13:39 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=12,cinder:INSERT=5,cinder:UPDATE=20,cinder:DELETE=1 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:13:40 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=16,cinder:UPDATE=23,cinder:INSERT=5,cinder:DELETE=3 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:13:49 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:13:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:13:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:13:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:13:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:13:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:13:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:13:49 devstack sudo[93331]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:13:49 devstack sudo[93331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:13:50 devstack sudo[93331]: pam_unix(sudo:session): session closed for user root
Nov 04 12:13:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.705s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:13:50 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:13:50 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager._thread_info {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:13:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread count: 28 {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 12:13:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread info: [<_MainThread(MainThread, started 137165867425920)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137165754678912)>, <Thread(Thread-3 (stat_writer), started daemon 137165754130752)>, <Thread(Rabbit-heartbeat, started daemon 137165752997504)>, <Thread(Thread-5 (_runner), started daemon 137165753227712)>, <Thread(Thread-7 (_runner), started daemon 137165751273856)>, <Thread(fd_logger, started daemon 137165755322048)>, <Thread(privsep_reader, started daemon 137165748896704)>, <Thread(tpool_thread_0, started daemon 137165742520000)>, <Thread(tpool_thread_1, started daemon 137165734127296)>, <Thread(tpool_thread_2, started daemon 137165725734592)>, <Thread(tpool_thread_3, started daemon 137165717341888)>, <Thread(tpool_thread_4, started daemon 137165708949184)>, <Thread(tpool_thread_5, started daemon 137165700556480)>, <Thread(tpool_thread_6, started daemon 137165692163776)>, <Thread(tpool_thread_7, started daemon 137165683771072)>, <Thread(tpool_thread_8, started daemon 137165675378368)>, <Thread(tpool_thread_9, started daemon 137165666985664)>, <Thread(tpool_thread_10, started daemon 137165658592960)>, <Thread(tpool_thread_11, started daemon 137165650183872)>, <Thread(tpool_thread_12, started daemon 137165641774784)>, <Thread(tpool_thread_13, started daemon 137165633365696)>, <Thread(tpool_thread_14, started daemon 137165624956608)>, <Thread(tpool_thread_15, started daemon 137165616547520)>, <Thread(tpool_thread_16, started daemon 137165608138432)>, <Thread(tpool_thread_17, started daemon 137165599729344)>, <Thread(tpool_thread_18, started daemon 137165591320256)>, <Thread(tpool_thread_19, started daemon 137165582911168)>] {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 12:14:02 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-414f154b-b336-4a39-8f52-7841a4316c96 tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:14:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-414f154b-b336-4a39-8f52-7841a4316c96 tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Flow 'volume_create_manager' (b0095930-6c2d-45f8-9947-c0ac55ae17a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:14:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-414f154b-b336-4a39-8f52-7841a4316c96 tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0e4c4f2-8323-4ac4-92ae-2cb688df6503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:14:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-414f154b-b336-4a39-8f52-7841a4316c96 tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0e4c4f2-8323-4ac4-92ae-2cb688df6503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-826024072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=311d5651-7383-4c08-a299-071dd3df8891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fea80ee34ea442abc63b0286295a735',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:14:03Z,use_quota=True,user_id='021c2109ea4c48718d6f55de0084d63d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:14:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-414f154b-b336-4a39-8f52-7841a4316c96 tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7d8693b-9c66-4ba0-868c-e589ca8c91b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:14:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-414f154b-b336-4a39-8f52-7841a4316c96 tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7d8693b-9c66-4ba0-868c-e589ca8c91b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:14:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-414f154b-b336-4a39-8f52-7841a4316c96 tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2363294-1d7b-4168-89a1-fb59abb0ed26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:14:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-414f154b-b336-4a39-8f52-7841a4316c96 tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2363294-1d7b-4168-89a1-fb59abb0ed26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '311d5651-7383-4c08-a299-071dd3df8891', 'volume_name': 'volume-311d5651-7383-4c08-a299-071dd3df8891', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:14:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-414f154b-b336-4a39-8f52-7841a4316c96 tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eca74e3f-6e22-4e47-b39a-ab43955ad074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:14:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-414f154b-b336-4a39-8f52-7841a4316c96 tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eca74e3f-6e22-4e47-b39a-ab43955ad074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:14:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-414f154b-b336-4a39-8f52-7841a4316c96 tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f48a790d-53c3-412f-b12d-992b55339150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:14:02 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-414f154b-b336-4a39-8f52-7841a4316c96 tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Volume 311d5651-7383-4c08-a299-071dd3df8891: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-311d5651-7383-4c08-a299-071dd3df8891', 'volume_size': 1}
Nov 04 12:14:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-414f154b-b336-4a39-8f52-7841a4316c96 tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:14:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-414f154b-b336-4a39-8f52-7841a4316c96 tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:14:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-414f154b-b336-4a39-8f52-7841a4316c96 tempest-VolumeQuotasNegativeTestJSON-1266089664 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:14:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-826024072',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=311d5651-7383-4c08-a299-071dd3df8891,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fea80ee34ea442abc63b0286295a735',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:14:03Z,use_quota=True,user_id='021c2109ea4c48718d6f55de0084d63d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:14:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-414f154b-b336-4a39-8f52-7841a4316c96 tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Creating volume 311d5651-7383-4c08-a299-071dd3df8891 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:14:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-414f154b-b336-4a39-8f52-7841a4316c96 tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:14:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-414f154b-b336-4a39-8f52-7841a4316c96 tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:14:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-414f154b-b336-4a39-8f52-7841a4316c96 tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:14:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-414f154b-b336-4a39-8f52-7841a4316c96 tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:14:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-414f154b-b336-4a39-8f52-7841a4316c96 tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:14:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-414f154b-b336-4a39-8f52-7841a4316c96 tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:14:02 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-414f154b-b336-4a39-8f52-7841a4316c96 tempest-VolumeQuotasNegativeTestJSON-1266089664 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:14:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-414f154b-b336-4a39-8f52-7841a4316c96 tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-311d5651-7383-4c08-a299-071dd3df8891 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:14:02 devstack sudo[93504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-311d5651-7383-4c08-a299-071dd3df8891 1073741824
Nov 04 12:14:02 devstack sudo[93504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:14:04 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d851811-70b5-40b3-b86e-838e4f87e0df tempest-ServerRescueNegativeTestJSON-1562462202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:14:04 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2d851811-70b5-40b3-b86e-838e4f87e0df tempest-ServerRescueNegativeTestJSON-1562462202 None] Flow 'volume_create_manager' (16e5aafe-7fd7-43e1-b079-c0a0814e9593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:14:04 devstack sudo[93504]: pam_unix(sudo:session): session closed for user root
Nov 04 12:14:04 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2d851811-70b5-40b3-b86e-838e4f87e0df tempest-ServerRescueNegativeTestJSON-1562462202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db17527b-7f5b-42f0-93ea-16621b5a9015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:14:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-414f154b-b336-4a39-8f52-7841a4316c96 tempest-VolumeQuotasNegativeTestJSON-1266089664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-311d5651-7383-4c08-a299-071dd3df8891 1073741824" returned: 0 in 1.267s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:14:04 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2d851811-70b5-40b3-b86e-838e4f87e0df tempest-ServerRescueNegativeTestJSON-1562462202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db17527b-7f5b-42f0-93ea-16621b5a9015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-904453109',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a2e453c-cb65-46f9-a810-abe8e2491e7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9678ea647add49a5842551398eca7c0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:14:04Z,use_quota=True,user_id='331cc6fb32ce4056aec3b873e71eddf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:14:04 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2d851811-70b5-40b3-b86e-838e4f87e0df tempest-ServerRescueNegativeTestJSON-1562462202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b6c74cd-8689-44bd-b4c3-c3430c6911ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:14:04 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2d851811-70b5-40b3-b86e-838e4f87e0df tempest-ServerRescueNegativeTestJSON-1562462202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b6c74cd-8689-44bd-b4c3-c3430c6911ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:14:04 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2d851811-70b5-40b3-b86e-838e4f87e0df tempest-ServerRescueNegativeTestJSON-1562462202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6028a47-afe2-448a-aa95-20800a7ee919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:14:04 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2d851811-70b5-40b3-b86e-838e4f87e0df tempest-ServerRescueNegativeTestJSON-1562462202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6028a47-afe2-448a-aa95-20800a7ee919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a2e453c-cb65-46f9-a810-abe8e2491e7a', 'volume_name': 'volume-3a2e453c-cb65-46f9-a810-abe8e2491e7a', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:14:04 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2d851811-70b5-40b3-b86e-838e4f87e0df tempest-ServerRescueNegativeTestJSON-1562462202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7995df28-2f3a-475a-97fd-739a02f6168c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:14:04 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2d851811-70b5-40b3-b86e-838e4f87e0df tempest-ServerRescueNegativeTestJSON-1562462202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7995df28-2f3a-475a-97fd-739a02f6168c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:14:04 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2d851811-70b5-40b3-b86e-838e4f87e0df tempest-ServerRescueNegativeTestJSON-1562462202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (593d675f-d218-4325-bba1-0f376e7ab517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:14:04 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-2d851811-70b5-40b3-b86e-838e4f87e0df tempest-ServerRescueNegativeTestJSON-1562462202 None] Volume 3a2e453c-cb65-46f9-a810-abe8e2491e7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a2e453c-cb65-46f9-a810-abe8e2491e7a', 'volume_size': 1}
Nov 04 12:14:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2d851811-70b5-40b3-b86e-838e4f87e0df tempest-ServerRescueNegativeTestJSON-1562462202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:14:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-414f154b-b336-4a39-8f52-7841a4316c96 tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-311d5651-7383-4c08-a299-071dd3df8891 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:14:04 devstack sudo[93509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-311d5651-7383-4c08-a299-071dd3df8891
Nov 04 12:14:04 devstack sudo[93509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:14:05 devstack sudo[93509]: pam_unix(sudo:session): session closed for user root
Nov 04 12:14:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-414f154b-b336-4a39-8f52-7841a4316c96 tempest-VolumeQuotasNegativeTestJSON-1266089664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-311d5651-7383-4c08-a299-071dd3df8891" returned: 0 in 0.855s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:14:05 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-414f154b-b336-4a39-8f52-7841a4316c96 tempest-VolumeQuotasNegativeTestJSON-1266089664 None] <== create_volume: return (2427ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:14:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-414f154b-b336-4a39-8f52-7841a4316c96 tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.430s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:14:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2d851811-70b5-40b3-b86e-838e4f87e0df tempest-ServerRescueNegativeTestJSON-1562462202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.959s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:14:05 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-2d851811-70b5-40b3-b86e-838e4f87e0df tempest-ServerRescueNegativeTestJSON-1562462202 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-904453109',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a2e453c-cb65-46f9-a810-abe8e2491e7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9678ea647add49a5842551398eca7c0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:14:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:14:04Z,use_quota=True,user_id='331cc6fb32ce4056aec3b873e71eddf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:14:05 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-2d851811-70b5-40b3-b86e-838e4f87e0df tempest-ServerRescueNegativeTestJSON-1562462202 None] Creating volume 3a2e453c-cb65-46f9-a810-abe8e2491e7a {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:14:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2d851811-70b5-40b3-b86e-838e4f87e0df tempest-ServerRescueNegativeTestJSON-1562462202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:14:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2d851811-70b5-40b3-b86e-838e4f87e0df tempest-ServerRescueNegativeTestJSON-1562462202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:14:05 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-2d851811-70b5-40b3-b86e-838e4f87e0df tempest-ServerRescueNegativeTestJSON-1562462202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:14:05 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-2d851811-70b5-40b3-b86e-838e4f87e0df tempest-ServerRescueNegativeTestJSON-1562462202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:14:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2d851811-70b5-40b3-b86e-838e4f87e0df tempest-ServerRescueNegativeTestJSON-1562462202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:14:05 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-2d851811-70b5-40b3-b86e-838e4f87e0df tempest-ServerRescueNegativeTestJSON-1562462202 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:14:05 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-2d851811-70b5-40b3-b86e-838e4f87e0df tempest-ServerRescueNegativeTestJSON-1562462202 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:14:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2d851811-70b5-40b3-b86e-838e4f87e0df tempest-ServerRescueNegativeTestJSON-1562462202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3a2e453c-cb65-46f9-a810-abe8e2491e7a 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:14:05 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-414f154b-b336-4a39-8f52-7841a4316c96 tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f48a790d-53c3-412f-b12d-992b55339150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-311d5651-7383-4c08-a299-071dd3df8891', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:14:05 devstack sudo[93512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3a2e453c-cb65-46f9-a810-abe8e2491e7a 1073741824
Nov 04 12:14:05 devstack sudo[93512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:14:05 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-414f154b-b336-4a39-8f52-7841a4316c96 tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (108c7f8b-c29b-4535-889a-d3f0653999a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:14:05 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-414f154b-b336-4a39-8f52-7841a4316c96 tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Volume volume-311d5651-7383-4c08-a299-071dd3df8891 (311d5651-7383-4c08-a299-071dd3df8891): created successfully
Nov 04 12:14:05 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-414f154b-b336-4a39-8f52-7841a4316c96 tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (108c7f8b-c29b-4535-889a-d3f0653999a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:14:05 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-414f154b-b336-4a39-8f52-7841a4316c96 tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Flow 'volume_create_manager' (b0095930-6c2d-45f8-9947-c0ac55ae17a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:14:05 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-414f154b-b336-4a39-8f52-7841a4316c96 tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Created volume successfully.
Nov 04 12:14:06 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-83b401ab-e2e4-4c0a-aac8-f91bf5b3de43 tempest-VolumesActionsTest-1608425806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:14:06 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-83b401ab-e2e4-4c0a-aac8-f91bf5b3de43 tempest-VolumesActionsTest-1608425806 None] Flow 'volume_create_manager' (55a40985-0a20-4881-9dfd-1fda6bc34830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:14:06 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-83b401ab-e2e4-4c0a-aac8-f91bf5b3de43 tempest-VolumesActionsTest-1608425806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb496e6e-3b9f-4a95-addc-70bbcb6c4f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:14:06 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-83b401ab-e2e4-4c0a-aac8-f91bf5b3de43 tempest-VolumesActionsTest-1608425806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb496e6e-3b9f-4a95-addc-70bbcb6c4f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-149514188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d4ac416-d113-4ebf-b2c0-8b719b3830b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='047dd07ec89147069eed3a5591b0472c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:14:06Z,use_quota=True,user_id='1bff5d970ebc417fa36a04a7d6596d66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:14:06 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-83b401ab-e2e4-4c0a-aac8-f91bf5b3de43 tempest-VolumesActionsTest-1608425806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0384268-6b19-4eb3-9f8d-02bca987e078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:14:06 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-83b401ab-e2e4-4c0a-aac8-f91bf5b3de43 tempest-VolumesActionsTest-1608425806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0384268-6b19-4eb3-9f8d-02bca987e078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:14:06 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-83b401ab-e2e4-4c0a-aac8-f91bf5b3de43 tempest-VolumesActionsTest-1608425806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87649bc3-e40f-4377-b66e-abc584e6ba88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:14:06 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-83b401ab-e2e4-4c0a-aac8-f91bf5b3de43 tempest-VolumesActionsTest-1608425806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (87649bc3-e40f-4377-b66e-abc584e6ba88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d4ac416-d113-4ebf-b2c0-8b719b3830b5', 'volume_name': 'volume-4d4ac416-d113-4ebf-b2c0-8b719b3830b5', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:14:06 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-83b401ab-e2e4-4c0a-aac8-f91bf5b3de43 tempest-VolumesActionsTest-1608425806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (549251c0-6f72-453d-b74d-ef94a26aff99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:14:06 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-83b401ab-e2e4-4c0a-aac8-f91bf5b3de43 tempest-VolumesActionsTest-1608425806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (549251c0-6f72-453d-b74d-ef94a26aff99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:14:06 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-83b401ab-e2e4-4c0a-aac8-f91bf5b3de43 tempest-VolumesActionsTest-1608425806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b92e00b-1626-4b8d-b4ea-e51aa11090be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:14:06 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-83b401ab-e2e4-4c0a-aac8-f91bf5b3de43 tempest-VolumesActionsTest-1608425806 None] Volume 4d4ac416-d113-4ebf-b2c0-8b719b3830b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d4ac416-d113-4ebf-b2c0-8b719b3830b5', 'volume_size': 1}
Nov 04 12:14:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-83b401ab-e2e4-4c0a-aac8-f91bf5b3de43 tempest-VolumesActionsTest-1608425806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:14:06 devstack sudo[93512]: pam_unix(sudo:session): session closed for user root
Nov 04 12:14:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2d851811-70b5-40b3-b86e-838e4f87e0df tempest-ServerRescueNegativeTestJSON-1562462202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3a2e453c-cb65-46f9-a810-abe8e2491e7a 1073741824" returned: 0 in 1.460s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:14:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2d851811-70b5-40b3-b86e-838e4f87e0df tempest-ServerRescueNegativeTestJSON-1562462202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3a2e453c-cb65-46f9-a810-abe8e2491e7a {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:14:07 devstack sudo[93519]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3a2e453c-cb65-46f9-a810-abe8e2491e7a
Nov 04 12:14:07 devstack sudo[93519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:14:07 devstack sudo[93519]: pam_unix(sudo:session): session closed for user root
Nov 04 12:14:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2d851811-70b5-40b3-b86e-838e4f87e0df tempest-ServerRescueNegativeTestJSON-1562462202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3a2e453c-cb65-46f9-a810-abe8e2491e7a" returned: 0 in 0.584s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:14:07 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-2d851811-70b5-40b3-b86e-838e4f87e0df tempest-ServerRescueNegativeTestJSON-1562462202 None] <== create_volume: return (2186ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:14:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2d851811-70b5-40b3-b86e-838e4f87e0df tempest-ServerRescueNegativeTestJSON-1562462202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.207s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:14:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-83b401ab-e2e4-4c0a-aac8-f91bf5b3de43 tempest-VolumesActionsTest-1608425806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.036s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:14:07 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-83b401ab-e2e4-4c0a-aac8-f91bf5b3de43 tempest-VolumesActionsTest-1608425806 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:14:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-149514188',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d4ac416-d113-4ebf-b2c0-8b719b3830b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='047dd07ec89147069eed3a5591b0472c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:14:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:14:06Z,use_quota=True,user_id='1bff5d970ebc417fa36a04a7d6596d66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:14:07 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-83b401ab-e2e4-4c0a-aac8-f91bf5b3de43 tempest-VolumesActionsTest-1608425806 None] Creating volume 4d4ac416-d113-4ebf-b2c0-8b719b3830b5 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:14:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-83b401ab-e2e4-4c0a-aac8-f91bf5b3de43 tempest-VolumesActionsTest-1608425806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:14:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-83b401ab-e2e4-4c0a-aac8-f91bf5b3de43 tempest-VolumesActionsTest-1608425806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:14:07 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-83b401ab-e2e4-4c0a-aac8-f91bf5b3de43 tempest-VolumesActionsTest-1608425806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:14:07 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-83b401ab-e2e4-4c0a-aac8-f91bf5b3de43 tempest-VolumesActionsTest-1608425806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:14:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-83b401ab-e2e4-4c0a-aac8-f91bf5b3de43 tempest-VolumesActionsTest-1608425806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:14:07 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-83b401ab-e2e4-4c0a-aac8-f91bf5b3de43 tempest-VolumesActionsTest-1608425806 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:14:07 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-83b401ab-e2e4-4c0a-aac8-f91bf5b3de43 tempest-VolumesActionsTest-1608425806 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:14:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-83b401ab-e2e4-4c0a-aac8-f91bf5b3de43 tempest-VolumesActionsTest-1608425806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4d4ac416-d113-4ebf-b2c0-8b719b3830b5 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:14:07 devstack sudo[93523]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4d4ac416-d113-4ebf-b2c0-8b719b3830b5 1073741824
Nov 04 12:14:07 devstack sudo[93523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:14:07 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2d851811-70b5-40b3-b86e-838e4f87e0df tempest-ServerRescueNegativeTestJSON-1562462202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (593d675f-d218-4325-bba1-0f376e7ab517) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a2e453c-cb65-46f9-a810-abe8e2491e7a', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:14:07 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2d851811-70b5-40b3-b86e-838e4f87e0df tempest-ServerRescueNegativeTestJSON-1562462202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (439460bf-c68d-4f6a-89e3-bea12f240ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:14:07 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-2d851811-70b5-40b3-b86e-838e4f87e0df tempest-ServerRescueNegativeTestJSON-1562462202 None] Volume volume-3a2e453c-cb65-46f9-a810-abe8e2491e7a (3a2e453c-cb65-46f9-a810-abe8e2491e7a): created successfully
Nov 04 12:14:07 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2d851811-70b5-40b3-b86e-838e4f87e0df tempest-ServerRescueNegativeTestJSON-1562462202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (439460bf-c68d-4f6a-89e3-bea12f240ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:14:07 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2d851811-70b5-40b3-b86e-838e4f87e0df tempest-ServerRescueNegativeTestJSON-1562462202 None] Flow 'volume_create_manager' (16e5aafe-7fd7-43e1-b079-c0a0814e9593) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:14:07 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-2d851811-70b5-40b3-b86e-838e4f87e0df tempest-ServerRescueNegativeTestJSON-1562462202 None] Created volume successfully.
Nov 04 12:14:08 devstack sudo[93523]: pam_unix(sudo:session): session closed for user root
Nov 04 12:14:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-83b401ab-e2e4-4c0a-aac8-f91bf5b3de43 tempest-VolumesActionsTest-1608425806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4d4ac416-d113-4ebf-b2c0-8b719b3830b5 1073741824" returned: 0 in 0.926s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:14:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-83b401ab-e2e4-4c0a-aac8-f91bf5b3de43 tempest-VolumesActionsTest-1608425806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4d4ac416-d113-4ebf-b2c0-8b719b3830b5 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:14:08 devstack sudo[93528]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4d4ac416-d113-4ebf-b2c0-8b719b3830b5
Nov 04 12:14:08 devstack sudo[93528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:14:08 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-054c0218-668d-4c1e-b79f-e1b77751dd9a tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Acquiring lock "cinder-311d5651-7383-4c08-a299-071dd3df8891-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:14:08 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-054c0218-668d-4c1e-b79f-e1b77751dd9a tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Lock "cinder-311d5651-7383-4c08-a299-071dd3df8891-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:14:08 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-054c0218-668d-4c1e-b79f-e1b77751dd9a tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Acquiring lock "cinder-quobyte-311d5651-7383-4c08-a299-071dd3df8891" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:14:09 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-054c0218-668d-4c1e-b79f-e1b77751dd9a tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Lock "cinder-quobyte-311d5651-7383-4c08-a299-071dd3df8891" acquired by "delete_volume" :: waited 0.048s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:14:09 devstack sudo[93528]: pam_unix(sudo:session): session closed for user root
Nov 04 12:14:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-83b401ab-e2e4-4c0a-aac8-f91bf5b3de43 tempest-VolumesActionsTest-1608425806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4d4ac416-d113-4ebf-b2c0-8b719b3830b5" returned: 0 in 0.409s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:14:09 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-83b401ab-e2e4-4c0a-aac8-f91bf5b3de43 tempest-VolumesActionsTest-1608425806 None] <== create_volume: return (1454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:14:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-83b401ab-e2e4-4c0a-aac8-f91bf5b3de43 tempest-VolumesActionsTest-1608425806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:14:09 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[240aa686-8e99-4942-b46c-4541831074fa]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:14:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-054c0218-668d-4c1e-b79f-e1b77751dd9a tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-311d5651-7383-4c08-a299-071dd3df8891 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:14:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-83b401ab-e2e4-4c0a-aac8-f91bf5b3de43 tempest-VolumesActionsTest-1608425806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b92e00b-1626-4b8d-b4ea-e51aa11090be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d4ac416-d113-4ebf-b2c0-8b719b3830b5', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:14:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-83b401ab-e2e4-4c0a-aac8-f91bf5b3de43 tempest-VolumesActionsTest-1608425806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (992e6607-2234-4840-9780-ca766a5db853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:14:09 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-83b401ab-e2e4-4c0a-aac8-f91bf5b3de43 tempest-VolumesActionsTest-1608425806 None] Volume volume-4d4ac416-d113-4ebf-b2c0-8b719b3830b5 (4d4ac416-d113-4ebf-b2c0-8b719b3830b5): created successfully
Nov 04 12:14:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-83b401ab-e2e4-4c0a-aac8-f91bf5b3de43 tempest-VolumesActionsTest-1608425806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (992e6607-2234-4840-9780-ca766a5db853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:14:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-83b401ab-e2e4-4c0a-aac8-f91bf5b3de43 tempest-VolumesActionsTest-1608425806 None] Flow 'volume_create_manager' (55a40985-0a20-4881-9dfd-1fda6bc34830) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:14:09 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-83b401ab-e2e4-4c0a-aac8-f91bf5b3de43 tempest-VolumesActionsTest-1608425806 None] Created volume successfully.
Nov 04 12:14:09 devstack sudo[93532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-311d5651-7383-4c08-a299-071dd3df8891
Nov 04 12:14:09 devstack sudo[93532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:14:09 devstack sudo[93532]: pam_unix(sudo:session): session closed for user root
Nov 04 12:14:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-054c0218-668d-4c1e-b79f-e1b77751dd9a tempest-VolumeQuotasNegativeTestJSON-1266089664 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-311d5651-7383-4c08-a299-071dd3df8891" returned: 0 in 0.600s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:14:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-054c0218-668d-4c1e-b79f-e1b77751dd9a tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-311d5651-7383-4c08-a299-071dd3df8891 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:14:09 devstack sudo[93537]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-311d5651-7383-4c08-a299-071dd3df8891
Nov 04 12:14:09 devstack sudo[93537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:14:10 devstack sudo[93537]: pam_unix(sudo:session): session closed for user root
Nov 04 12:14:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-054c0218-668d-4c1e-b79f-e1b77751dd9a tempest-VolumeQuotasNegativeTestJSON-1266089664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-311d5651-7383-4c08-a299-071dd3df8891" returned: 0 in 0.365s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:14:10 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-054c0218-668d-4c1e-b79f-e1b77751dd9a tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Lock "cinder-quobyte-311d5651-7383-4c08-a299-071dd3df8891" released by "delete_volume" :: held 1.046s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:14:10 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-054c0218-668d-4c1e-b79f-e1b77751dd9a tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Created reservations ['9ecd64f9-ede6-44af-bef7-aa68e028bd0f', 'a8898cad-f37b-4038-8abb-a2c5004eec08', '3f65611c-319c-45f1-88d1-38c46be5d9a6', 'dea5971e-fe9c-44c7-8c12-2f983e1bfd19'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:14:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-054c0218-668d-4c1e-b79f-e1b77751dd9a tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:14:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-054c0218-668d-4c1e-b79f-e1b77751dd9a tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:14:10 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-054c0218-668d-4c1e-b79f-e1b77751dd9a tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:14:10 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-054c0218-668d-4c1e-b79f-e1b77751dd9a tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:14:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-054c0218-668d-4c1e-b79f-e1b77751dd9a tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:14:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-054c0218-668d-4c1e-b79f-e1b77751dd9a tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:14:10 devstack sudo[93545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:14:10 devstack sudo[93545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:14:10 devstack sudo[93545]: pam_unix(sudo:session): session closed for user root
Nov 04 12:14:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-054c0218-668d-4c1e-b79f-e1b77751dd9a tempest-VolumeQuotasNegativeTestJSON-1266089664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.330s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:14:10 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-054c0218-668d-4c1e-b79f-e1b77751dd9a tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:14:10 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-054c0218-668d-4c1e-b79f-e1b77751dd9a tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Deleted volume successfully.
Nov 04 12:14:10 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-054c0218-668d-4c1e-b79f-e1b77751dd9a tempest-VolumeQuotasNegativeTestJSON-1266089664 None] Lock "cinder-311d5651-7383-4c08-a299-071dd3df8891-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:14:20 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=10,cinder:UPDATE=16,cinder:INSERT=2,cinder:DELETE=3 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:14:20 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:UPDATE=19,cinder:SELECT=13,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:14:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3f110d0b-89ab-4c10-98ba-48458cd4b1d6 tempest-ServerRescueNegativeTestJSON-1562462202 None] Acquiring lock "cinder-3a2e453c-cb65-46f9-a810-abe8e2491e7a-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:14:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3f110d0b-89ab-4c10-98ba-48458cd4b1d6 tempest-ServerRescueNegativeTestJSON-1562462202 None] Lock "cinder-3a2e453c-cb65-46f9-a810-abe8e2491e7a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:14:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3f110d0b-89ab-4c10-98ba-48458cd4b1d6 tempest-ServerRescueNegativeTestJSON-1562462202 None] Acquiring lock "cinder-quobyte-3a2e453c-cb65-46f9-a810-abe8e2491e7a" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:14:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3f110d0b-89ab-4c10-98ba-48458cd4b1d6 tempest-ServerRescueNegativeTestJSON-1562462202 None] Lock "cinder-quobyte-3a2e453c-cb65-46f9-a810-abe8e2491e7a" acquired by "delete_volume" :: waited 0.025s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:14:20 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab8e73a-ddf2-466b-b719-325aa9626e5a]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:14:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3f110d0b-89ab-4c10-98ba-48458cd4b1d6 tempest-ServerRescueNegativeTestJSON-1562462202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3a2e453c-cb65-46f9-a810-abe8e2491e7a {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:14:20 devstack sudo[93753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3a2e453c-cb65-46f9-a810-abe8e2491e7a
Nov 04 12:14:20 devstack sudo[93753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:14:21 devstack sudo[93753]: pam_unix(sudo:session): session closed for user root
Nov 04 12:14:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3f110d0b-89ab-4c10-98ba-48458cd4b1d6 tempest-ServerRescueNegativeTestJSON-1562462202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3a2e453c-cb65-46f9-a810-abe8e2491e7a" returned: 0 in 0.675s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:14:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3f110d0b-89ab-4c10-98ba-48458cd4b1d6 tempest-ServerRescueNegativeTestJSON-1562462202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3a2e453c-cb65-46f9-a810-abe8e2491e7a {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:14:21 devstack sudo[93762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3a2e453c-cb65-46f9-a810-abe8e2491e7a
Nov 04 12:14:21 devstack sudo[93762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:14:22 devstack sudo[93762]: pam_unix(sudo:session): session closed for user root
Nov 04 12:14:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3f110d0b-89ab-4c10-98ba-48458cd4b1d6 tempest-ServerRescueNegativeTestJSON-1562462202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3a2e453c-cb65-46f9-a810-abe8e2491e7a" returned: 0 in 0.603s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:14:22 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3f110d0b-89ab-4c10-98ba-48458cd4b1d6 tempest-ServerRescueNegativeTestJSON-1562462202 None] Lock "cinder-quobyte-3a2e453c-cb65-46f9-a810-abe8e2491e7a" released by "delete_volume" :: held 1.374s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:14:22 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-3f110d0b-89ab-4c10-98ba-48458cd4b1d6 tempest-ServerRescueNegativeTestJSON-1562462202 None] Created reservations ['b77ea20f-b52e-4272-b150-437925cadfd7', 'ce05e4e5-78c3-4384-a7fc-024f430de7f6', '730bd281-6d39-4ae7-930b-5c878ed35a20', '5bf94633-cd6e-4a3b-93c4-d0f3ddc5a80b'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:14:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3f110d0b-89ab-4c10-98ba-48458cd4b1d6 tempest-ServerRescueNegativeTestJSON-1562462202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:14:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3f110d0b-89ab-4c10-98ba-48458cd4b1d6 tempest-ServerRescueNegativeTestJSON-1562462202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:14:22 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3f110d0b-89ab-4c10-98ba-48458cd4b1d6 tempest-ServerRescueNegativeTestJSON-1562462202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:14:22 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3f110d0b-89ab-4c10-98ba-48458cd4b1d6 tempest-ServerRescueNegativeTestJSON-1562462202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:14:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3f110d0b-89ab-4c10-98ba-48458cd4b1d6 tempest-ServerRescueNegativeTestJSON-1562462202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:14:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3f110d0b-89ab-4c10-98ba-48458cd4b1d6 tempest-ServerRescueNegativeTestJSON-1562462202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:14:22 devstack sudo[93766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:14:22 devstack sudo[93766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:14:23 devstack sudo[93766]: pam_unix(sudo:session): session closed for user root
Nov 04 12:14:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3f110d0b-89ab-4c10-98ba-48458cd4b1d6 tempest-ServerRescueNegativeTestJSON-1562462202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.733s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:14:23 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-3f110d0b-89ab-4c10-98ba-48458cd4b1d6 tempest-ServerRescueNegativeTestJSON-1562462202 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:14:23 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-3f110d0b-89ab-4c10-98ba-48458cd4b1d6 tempest-ServerRescueNegativeTestJSON-1562462202 None] Deleted volume successfully.
Nov 04 12:14:23 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3f110d0b-89ab-4c10-98ba-48458cd4b1d6 tempest-ServerRescueNegativeTestJSON-1562462202 None] Lock "cinder-3a2e453c-cb65-46f9-a810-abe8e2491e7a-delete_volume" released by "delete_volume" :: held 2.680s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:14:23 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-b847a7d0-d235-4488-b9c3-273676bd412b tempest-VolumesActionsTest-1608425806 None] Acquiring lock "cinder-4d4ac416-d113-4ebf-b2c0-8b719b3830b5" by "attach_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:14:23 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-b847a7d0-d235-4488-b9c3-273676bd412b tempest-VolumesActionsTest-1608425806 None] Lock "cinder-4d4ac416-d113-4ebf-b2c0-8b719b3830b5" acquired by "attach_volume" :: waited 0.062s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:14:23 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-b847a7d0-d235-4488-b9c3-273676bd412b tempest-VolumesActionsTest-1608425806 None] Attaching volume 4d4ac416-d113-4ebf-b2c0-8b719b3830b5 to instance db5a7919-d132-4ea3-82b6-f184275efbcc at mountpoint /dev/vdb on host None.
Nov 04 12:14:23 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-b847a7d0-d235-4488-b9c3-273676bd412b tempest-VolumesActionsTest-1608425806 None] Attach volume completed successfully.
Nov 04 12:14:23 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-b847a7d0-d235-4488-b9c3-273676bd412b tempest-VolumesActionsTest-1608425806 None] Lock "cinder-4d4ac416-d113-4ebf-b2c0-8b719b3830b5" released by "attach_volume" :: held 0.289s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:14:24 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-14f9f897-9ed1-4d93-bc35-2ffcadf8c634 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:14:24 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-14f9f897-9ed1-4d93-bc35-2ffcadf8c634 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Flow 'volume_create_manager' (aa27884c-550b-4dbf-bf27-972df430b498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:14:24 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-14f9f897-9ed1-4d93-bc35-2ffcadf8c634 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67996470-af79-4cef-ae79-2b54b3c2492e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:14:24 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-14f9f897-9ed1-4d93-bc35-2ffcadf8c634 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67996470-af79-4cef-ae79-2b54b3c2492e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1602823305',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2042c61b-17ab-4986-8ca6-9423a24b8f22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f1eeb4e6bd492d9b5229477ec0faff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:14:24Z,use_quota=True,user_id='3f2ebea09d43402dae23b133cbab235c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8180a018-434a-49fa-b0d6-2282a0dc05d6),volume_type_id=8180a018-434a-49fa-b0d6-2282a0dc05d6)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:14:24 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-14f9f897-9ed1-4d93-bc35-2ffcadf8c634 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df2242b7-b99f-4291-9201-24faa5342f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:14:24 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-14f9f897-9ed1-4d93-bc35-2ffcadf8c634 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df2242b7-b99f-4291-9201-24faa5342f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:14:24 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-14f9f897-9ed1-4d93-bc35-2ffcadf8c634 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c056855-3a4b-473a-8d2f-4c2305119e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:14:24 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-14f9f897-9ed1-4d93-bc35-2ffcadf8c634 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c056855-3a4b-473a-8d2f-4c2305119e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2042c61b-17ab-4986-8ca6-9423a24b8f22', 'volume_name': 'volume-2042c61b-17ab-4986-8ca6-9423a24b8f22', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:14:24 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-14f9f897-9ed1-4d93-bc35-2ffcadf8c634 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bec266f1-4a58-432b-80ce-a2231ceca869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:14:24 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-14f9f897-9ed1-4d93-bc35-2ffcadf8c634 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bec266f1-4a58-432b-80ce-a2231ceca869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:14:24 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-14f9f897-9ed1-4d93-bc35-2ffcadf8c634 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f95cf480-6838-463b-a153-de59cc2c8e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:14:24 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-14f9f897-9ed1-4d93-bc35-2ffcadf8c634 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Volume 2042c61b-17ab-4986-8ca6-9423a24b8f22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2042c61b-17ab-4986-8ca6-9423a24b8f22', 'volume_size': 1}
Nov 04 12:14:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-14f9f897-9ed1-4d93-bc35-2ffcadf8c634 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:14:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-14f9f897-9ed1-4d93-bc35-2ffcadf8c634 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:14:24 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-14f9f897-9ed1-4d93-bc35-2ffcadf8c634 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1602823305',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2042c61b-17ab-4986-8ca6-9423a24b8f22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43f1eeb4e6bd492d9b5229477ec0faff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:14:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:14:24Z,use_quota=True,user_id='3f2ebea09d43402dae23b133cbab235c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8180a018-434a-49fa-b0d6-2282a0dc05d6),volume_type_id=8180a018-434a-49fa-b0d6-2282a0dc05d6)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:14:24 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-14f9f897-9ed1-4d93-bc35-2ffcadf8c634 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Creating volume 2042c61b-17ab-4986-8ca6-9423a24b8f22 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:14:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-14f9f897-9ed1-4d93-bc35-2ffcadf8c634 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:14:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-14f9f897-9ed1-4d93-bc35-2ffcadf8c634 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:14:24 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-14f9f897-9ed1-4d93-bc35-2ffcadf8c634 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:14:24 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-14f9f897-9ed1-4d93-bc35-2ffcadf8c634 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:14:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-14f9f897-9ed1-4d93-bc35-2ffcadf8c634 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:14:24 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-14f9f897-9ed1-4d93-bc35-2ffcadf8c634 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:14:24 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-14f9f897-9ed1-4d93-bc35-2ffcadf8c634 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:14:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-14f9f897-9ed1-4d93-bc35-2ffcadf8c634 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2042c61b-17ab-4986-8ca6-9423a24b8f22 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:14:24 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d9f43918-8b4c-4c6e-904a-a3f47057d5fa tempest-VolumesActionsTest-1608425806 None] Acquiring lock "cinder-4d4ac416-d113-4ebf-b2c0-8b719b3830b5-detach_volume" by "detach_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:14:24 devstack sudo[93788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2042c61b-17ab-4986-8ca6-9423a24b8f22 1073741824
Nov 04 12:14:24 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d9f43918-8b4c-4c6e-904a-a3f47057d5fa tempest-VolumesActionsTest-1608425806 None] Lock "cinder-4d4ac416-d113-4ebf-b2c0-8b719b3830b5-detach_volume" acquired by "detach_volume" :: waited 0.066s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:14:24 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-d9f43918-8b4c-4c6e-904a-a3f47057d5fa tempest-VolumesActionsTest-1608425806 None] Detaching volume 4d4ac416-d113-4ebf-b2c0-8b719b3830b5 from instance db5a7919-d132-4ea3-82b6-f184275efbcc.
Nov 04 12:14:24 devstack sudo[93788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:14:24 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-d9f43918-8b4c-4c6e-904a-a3f47057d5fa tempest-VolumesActionsTest-1608425806 None] Detach volume completed successfully.
Nov 04 12:14:24 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d9f43918-8b4c-4c6e-904a-a3f47057d5fa tempest-VolumesActionsTest-1608425806 None] Lock "cinder-4d4ac416-d113-4ebf-b2c0-8b719b3830b5-detach_volume" released by "detach_volume" :: held 0.256s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:14:25 devstack sudo[93788]: pam_unix(sudo:session): session closed for user root
Nov 04 12:14:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-14f9f897-9ed1-4d93-bc35-2ffcadf8c634 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2042c61b-17ab-4986-8ca6-9423a24b8f22 1073741824" returned: 0 in 1.003s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:14:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-14f9f897-9ed1-4d93-bc35-2ffcadf8c634 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2042c61b-17ab-4986-8ca6-9423a24b8f22 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:14:25 devstack sudo[93802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2042c61b-17ab-4986-8ca6-9423a24b8f22
Nov 04 12:14:25 devstack sudo[93802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:14:26 devstack sudo[93802]: pam_unix(sudo:session): session closed for user root
Nov 04 12:14:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-14f9f897-9ed1-4d93-bc35-2ffcadf8c634 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2042c61b-17ab-4986-8ca6-9423a24b8f22" returned: 0 in 0.722s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:14:26 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-14f9f897-9ed1-4d93-bc35-2ffcadf8c634 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] <== create_volume: return (1881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:14:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-14f9f897-9ed1-4d93-bc35-2ffcadf8c634 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.885s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:14:26 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-14f9f897-9ed1-4d93-bc35-2ffcadf8c634 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f95cf480-6838-463b-a153-de59cc2c8e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2042c61b-17ab-4986-8ca6-9423a24b8f22', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:14:26 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-14f9f897-9ed1-4d93-bc35-2ffcadf8c634 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e4745d3-0d6c-4391-9656-092072e30f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:14:26 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-14f9f897-9ed1-4d93-bc35-2ffcadf8c634 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Volume volume-2042c61b-17ab-4986-8ca6-9423a24b8f22 (2042c61b-17ab-4986-8ca6-9423a24b8f22): created successfully
Nov 04 12:14:26 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-14f9f897-9ed1-4d93-bc35-2ffcadf8c634 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e4745d3-0d6c-4391-9656-092072e30f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:14:26 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-14f9f897-9ed1-4d93-bc35-2ffcadf8c634 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Flow 'volume_create_manager' (aa27884c-550b-4dbf-bf27-972df430b498) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:14:26 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-14f9f897-9ed1-4d93-bc35-2ffcadf8c634 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Created volume successfully.
Nov 04 12:14:28 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb0e797e-7d8d-4257-842b-f0224b358ffe tempest-AttachVolumeTestJSON-852332315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:14:28 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-fb0e797e-7d8d-4257-842b-f0224b358ffe tempest-AttachVolumeTestJSON-852332315 None] Flow 'volume_create_manager' (ec23ff8f-13b7-4685-b288-b5edaddec07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:14:28 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-fb0e797e-7d8d-4257-842b-f0224b358ffe tempest-AttachVolumeTestJSON-852332315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b254afe8-8fc6-445e-a79d-8ffc72f4419e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:14:28 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-fb0e797e-7d8d-4257-842b-f0224b358ffe tempest-AttachVolumeTestJSON-852332315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b254afe8-8fc6-445e-a79d-8ffc72f4419e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:14:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2027515809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd3ba824-b061-44a7-852f-f28e924bea18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6848a83209f4bdd8542c9f37acedb7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:14:29Z,use_quota=True,user_id='e17ff439a08249cdb11b401f10815922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:14:28 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-fb0e797e-7d8d-4257-842b-f0224b358ffe tempest-AttachVolumeTestJSON-852332315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b1bba14-bd15-4f07-af19-4994ce02d3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:14:28 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-fb0e797e-7d8d-4257-842b-f0224b358ffe tempest-AttachVolumeTestJSON-852332315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b1bba14-bd15-4f07-af19-4994ce02d3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:14:28 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-fb0e797e-7d8d-4257-842b-f0224b358ffe tempest-AttachVolumeTestJSON-852332315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41172397-ae0f-41d8-a1bc-e436fe7bbb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:14:28 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-fb0e797e-7d8d-4257-842b-f0224b358ffe tempest-AttachVolumeTestJSON-852332315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41172397-ae0f-41d8-a1bc-e436fe7bbb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd3ba824-b061-44a7-852f-f28e924bea18', 'volume_name': 'volume-cd3ba824-b061-44a7-852f-f28e924bea18', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:14:28 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-fb0e797e-7d8d-4257-842b-f0224b358ffe tempest-AttachVolumeTestJSON-852332315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60d86707-a934-4457-adde-34f08b5aeb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:14:28 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-fb0e797e-7d8d-4257-842b-f0224b358ffe tempest-AttachVolumeTestJSON-852332315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60d86707-a934-4457-adde-34f08b5aeb9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:14:28 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-fb0e797e-7d8d-4257-842b-f0224b358ffe tempest-AttachVolumeTestJSON-852332315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f35247e-8072-4903-a743-9a1b143c936a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:14:28 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-fb0e797e-7d8d-4257-842b-f0224b358ffe tempest-AttachVolumeTestJSON-852332315 None] Volume cd3ba824-b061-44a7-852f-f28e924bea18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd3ba824-b061-44a7-852f-f28e924bea18', 'volume_size': 1}
Nov 04 12:14:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-fb0e797e-7d8d-4257-842b-f0224b358ffe tempest-AttachVolumeTestJSON-852332315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:14:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-fb0e797e-7d8d-4257-842b-f0224b358ffe tempest-AttachVolumeTestJSON-852332315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:14:28 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-fb0e797e-7d8d-4257-842b-f0224b358ffe tempest-AttachVolumeTestJSON-852332315 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:14:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2027515809',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd3ba824-b061-44a7-852f-f28e924bea18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6848a83209f4bdd8542c9f37acedb7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:14:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:14:29Z,use_quota=True,user_id='e17ff439a08249cdb11b401f10815922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:14:28 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-fb0e797e-7d8d-4257-842b-f0224b358ffe tempest-AttachVolumeTestJSON-852332315 None] Creating volume cd3ba824-b061-44a7-852f-f28e924bea18 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:14:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-fb0e797e-7d8d-4257-842b-f0224b358ffe tempest-AttachVolumeTestJSON-852332315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:14:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-fb0e797e-7d8d-4257-842b-f0224b358ffe tempest-AttachVolumeTestJSON-852332315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:14:28 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-fb0e797e-7d8d-4257-842b-f0224b358ffe tempest-AttachVolumeTestJSON-852332315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:14:28 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-fb0e797e-7d8d-4257-842b-f0224b358ffe tempest-AttachVolumeTestJSON-852332315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:14:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-fb0e797e-7d8d-4257-842b-f0224b358ffe tempest-AttachVolumeTestJSON-852332315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:14:28 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-fb0e797e-7d8d-4257-842b-f0224b358ffe tempest-AttachVolumeTestJSON-852332315 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:14:28 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-fb0e797e-7d8d-4257-842b-f0224b358ffe tempest-AttachVolumeTestJSON-852332315 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:14:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fb0e797e-7d8d-4257-842b-f0224b358ffe tempest-AttachVolumeTestJSON-852332315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cd3ba824-b061-44a7-852f-f28e924bea18 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:14:28 devstack sudo[93884]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cd3ba824-b061-44a7-852f-f28e924bea18 1073741824
Nov 04 12:14:28 devstack sudo[93884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:14:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3c9e76e9-f54a-4ee7-b968-76b3171885b7 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:14:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3c9e76e9-f54a-4ee7-b968-76b3171885b7 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:14:29 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3c9e76e9-f54a-4ee7-b968-76b3171885b7 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:14:29 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3c9e76e9-f54a-4ee7-b968-76b3171885b7 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:14:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3c9e76e9-f54a-4ee7-b968-76b3171885b7 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:14:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3c9e76e9-f54a-4ee7-b968-76b3171885b7 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:14:29 devstack sudo[93892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:14:29 devstack sudo[93892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:14:29 devstack sudo[93892]: pam_unix(sudo:session): session closed for user root
Nov 04 12:14:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3c9e76e9-f54a-4ee7-b968-76b3171885b7 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.382s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:14:29 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-3c9e76e9-f54a-4ee7-b968-76b3171885b7 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:14:29 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-3c9e76e9-f54a-4ee7-b968-76b3171885b7 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Retype volume completed successfully.
Nov 04 12:14:29 devstack sudo[93884]: pam_unix(sudo:session): session closed for user root
Nov 04 12:14:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fb0e797e-7d8d-4257-842b-f0224b358ffe tempest-AttachVolumeTestJSON-852332315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cd3ba824-b061-44a7-852f-f28e924bea18 1073741824" returned: 0 in 0.695s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:14:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fb0e797e-7d8d-4257-842b-f0224b358ffe tempest-AttachVolumeTestJSON-852332315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cd3ba824-b061-44a7-852f-f28e924bea18 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:14:29 devstack sudo[93901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cd3ba824-b061-44a7-852f-f28e924bea18
Nov 04 12:14:29 devstack sudo[93901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:14:29 devstack sudo[93901]: pam_unix(sudo:session): session closed for user root
Nov 04 12:14:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fb0e797e-7d8d-4257-842b-f0224b358ffe tempest-AttachVolumeTestJSON-852332315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cd3ba824-b061-44a7-852f-f28e924bea18" returned: 0 in 0.365s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:14:29 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-fb0e797e-7d8d-4257-842b-f0224b358ffe tempest-AttachVolumeTestJSON-852332315 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:14:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-fb0e797e-7d8d-4257-842b-f0224b358ffe tempest-AttachVolumeTestJSON-852332315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.169s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:14:29 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-fb0e797e-7d8d-4257-842b-f0224b358ffe tempest-AttachVolumeTestJSON-852332315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f35247e-8072-4903-a743-9a1b143c936a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd3ba824-b061-44a7-852f-f28e924bea18', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:14:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-fb0e797e-7d8d-4257-842b-f0224b358ffe tempest-AttachVolumeTestJSON-852332315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea30f01-2fbd-4234-8169-1c96e0d431e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:14:30 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-fb0e797e-7d8d-4257-842b-f0224b358ffe tempest-AttachVolumeTestJSON-852332315 None] Volume volume-cd3ba824-b061-44a7-852f-f28e924bea18 (cd3ba824-b061-44a7-852f-f28e924bea18): created successfully
Nov 04 12:14:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-fb0e797e-7d8d-4257-842b-f0224b358ffe tempest-AttachVolumeTestJSON-852332315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ea30f01-2fbd-4234-8169-1c96e0d431e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:14:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-fb0e797e-7d8d-4257-842b-f0224b358ffe tempest-AttachVolumeTestJSON-852332315 None] Flow 'volume_create_manager' (ec23ff8f-13b7-4685-b288-b5edaddec07e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:14:30 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-fb0e797e-7d8d-4257-842b-f0224b358ffe tempest-AttachVolumeTestJSON-852332315 None] Created volume successfully.
Nov 04 12:14:30 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-4bc1b422-21c7-4023-8827-f7cd9374a9e7 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Acquiring lock "cinder-2042c61b-17ab-4986-8ca6-9423a24b8f22-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:14:30 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-4bc1b422-21c7-4023-8827-f7cd9374a9e7 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Lock "cinder-2042c61b-17ab-4986-8ca6-9423a24b8f22-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:14:30 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-4bc1b422-21c7-4023-8827-f7cd9374a9e7 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Acquiring lock "cinder-quobyte-2042c61b-17ab-4986-8ca6-9423a24b8f22" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:14:30 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-4bc1b422-21c7-4023-8827-f7cd9374a9e7 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Lock "cinder-quobyte-2042c61b-17ab-4986-8ca6-9423a24b8f22" acquired by "delete_volume" :: waited 0.026s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:14:30 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a31653e-a5e8-4023-8a60-370c87cc1bfa]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:14:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4bc1b422-21c7-4023-8827-f7cd9374a9e7 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2042c61b-17ab-4986-8ca6-9423a24b8f22 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:14:30 devstack sudo[93906]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2042c61b-17ab-4986-8ca6-9423a24b8f22
Nov 04 12:14:30 devstack sudo[93906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:14:30 devstack sudo[93906]: pam_unix(sudo:session): session closed for user root
Nov 04 12:14:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4bc1b422-21c7-4023-8827-f7cd9374a9e7 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2042c61b-17ab-4986-8ca6-9423a24b8f22" returned: 0 in 0.518s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:14:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4bc1b422-21c7-4023-8827-f7cd9374a9e7 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2042c61b-17ab-4986-8ca6-9423a24b8f22 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:14:30 devstack sudo[93919]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2042c61b-17ab-4986-8ca6-9423a24b8f22
Nov 04 12:14:30 devstack sudo[93919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:14:31 devstack sudo[93919]: pam_unix(sudo:session): session closed for user root
Nov 04 12:14:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4bc1b422-21c7-4023-8827-f7cd9374a9e7 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2042c61b-17ab-4986-8ca6-9423a24b8f22" returned: 0 in 0.330s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:14:31 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-4bc1b422-21c7-4023-8827-f7cd9374a9e7 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Lock "cinder-quobyte-2042c61b-17ab-4986-8ca6-9423a24b8f22" released by "delete_volume" :: held 0.914s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:14:31 devstack cinder-volume[87169]: WARNING cinder.quota [None req-4bc1b422-21c7-4023-8827-f7cd9374a9e7 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Nov 04 12:14:31 devstack cinder-volume[87169]: WARNING cinder.quota [None req-4bc1b422-21c7-4023-8827-f7cd9374a9e7 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Nov 04 12:14:31 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-4bc1b422-21c7-4023-8827-f7cd9374a9e7 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Created reservations ['c6abd86e-eace-4991-9160-7d396591164c', '259ed336-92e4-4a52-8c76-968047bdcca1', '90281a0b-6c5b-4d0b-b2ff-0d784ea4b9ee', 'e2e5b3b3-3c4a-4ba3-b7e4-904885758363'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:14:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-4bc1b422-21c7-4023-8827-f7cd9374a9e7 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:14:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-4bc1b422-21c7-4023-8827-f7cd9374a9e7 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:14:31 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-4bc1b422-21c7-4023-8827-f7cd9374a9e7 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:14:31 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-4bc1b422-21c7-4023-8827-f7cd9374a9e7 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:14:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-4bc1b422-21c7-4023-8827-f7cd9374a9e7 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:14:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4bc1b422-21c7-4023-8827-f7cd9374a9e7 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:14:31 devstack sudo[93935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:14:31 devstack sudo[93935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:14:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-2db7e732-165d-441f-b190-b2cf135e0377 req-b89f0bff-51d7-4bb6-9c32-ec62245701d2 tempest-AttachVolumeTestJSON-852332315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:14:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-2db7e732-165d-441f-b190-b2cf135e0377 req-b89f0bff-51d7-4bb6-9c32-ec62245701d2 tempest-AttachVolumeTestJSON-852332315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:14:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-2db7e732-165d-441f-b190-b2cf135e0377 req-b89f0bff-51d7-4bb6-9c32-ec62245701d2 tempest-AttachVolumeTestJSON-852332315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:14:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-2db7e732-165d-441f-b190-b2cf135e0377 req-b89f0bff-51d7-4bb6-9c32-ec62245701d2 tempest-AttachVolumeTestJSON-852332315 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79', 'name': 'volume-cd3ba824-b061-44a7-852f-f28e924bea18', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9fdba586-3829-49c7-b11c-2a2b53744935', 'enforce_multipath': True} {{(pid=87169) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 04 12:14:31 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-2db7e732-165d-441f-b190-b2cf135e0377 req-b89f0bff-51d7-4bb6-9c32-ec62245701d2 tempest-AttachVolumeTestJSON-852332315 None] attachment_update completed successfully.
Nov 04 12:14:31 devstack sudo[93935]: pam_unix(sudo:session): session closed for user root
Nov 04 12:14:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4bc1b422-21c7-4023-8827-f7cd9374a9e7 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.357s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:14:31 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-4bc1b422-21c7-4023-8827-f7cd9374a9e7 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:14:31 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-4bc1b422-21c7-4023-8827-f7cd9374a9e7 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Deleted volume successfully.
Nov 04 12:14:31 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-4bc1b422-21c7-4023-8827-f7cd9374a9e7 tempest-VolumeRetypeWithoutMigrationTest-4008104 None] Lock "cinder-2042c61b-17ab-4986-8ca6-9423a24b8f22-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:14:40 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-7470084a-9497-406b-afca-3688e61be4d9 tempest-VolumesActionsTest-1608425806 None] Acquiring lock "cinder-4d4ac416-d113-4ebf-b2c0-8b719b3830b5" by "attach_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:14:40 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-7470084a-9497-406b-afca-3688e61be4d9 tempest-VolumesActionsTest-1608425806 None] Lock "cinder-4d4ac416-d113-4ebf-b2c0-8b719b3830b5" acquired by "attach_volume" :: waited 0.054s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:14:40 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-7470084a-9497-406b-afca-3688e61be4d9 tempest-VolumesActionsTest-1608425806 None] Attaching volume 4d4ac416-d113-4ebf-b2c0-8b719b3830b5 to instance e8b17ba3-dea6-4795-9984-058ff17030cd at mountpoint /dev/vdb on host None.
Nov 04 12:14:40 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-7470084a-9497-406b-afca-3688e61be4d9 tempest-VolumesActionsTest-1608425806 None] Attach volume completed successfully.
Nov 04 12:14:40 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-7470084a-9497-406b-afca-3688e61be4d9 tempest-VolumesActionsTest-1608425806 None] Lock "cinder-4d4ac416-d113-4ebf-b2c0-8b719b3830b5" released by "attach_volume" :: held 0.224s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:14:41 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-b854eec9-0122-4a08-8fcb-f8dc891b3bcd tempest-VolumesActionsTest-1608425806 None] Acquiring lock "cinder-4d4ac416-d113-4ebf-b2c0-8b719b3830b5-detach_volume" by "detach_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:14:41 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-b854eec9-0122-4a08-8fcb-f8dc891b3bcd tempest-VolumesActionsTest-1608425806 None] Lock "cinder-4d4ac416-d113-4ebf-b2c0-8b719b3830b5-detach_volume" acquired by "detach_volume" :: waited 0.036s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:14:41 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-b854eec9-0122-4a08-8fcb-f8dc891b3bcd tempest-VolumesActionsTest-1608425806 None] Detaching volume 4d4ac416-d113-4ebf-b2c0-8b719b3830b5 from instance e8b17ba3-dea6-4795-9984-058ff17030cd.
Nov 04 12:14:42 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-b854eec9-0122-4a08-8fcb-f8dc891b3bcd tempest-VolumesActionsTest-1608425806 None] Detach volume completed successfully.
Nov 04 12:14:42 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-b854eec9-0122-4a08-8fcb-f8dc891b3bcd tempest-VolumesActionsTest-1608425806 None] Lock "cinder-4d4ac416-d113-4ebf-b2c0-8b719b3830b5-detach_volume" released by "detach_volume" :: held 0.180s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:14:42 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b7503ae-67c6-4415-af01-b712863a4cf0 tempest-VolumesServicesTestJSON-821759627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:14:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3b7503ae-67c6-4415-af01-b712863a4cf0 tempest-VolumesServicesTestJSON-821759627 None] Flow 'volume_create_manager' (634960e2-4e07-4eea-9601-42ed3a9843e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:14:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3b7503ae-67c6-4415-af01-b712863a4cf0 tempest-VolumesServicesTestJSON-821759627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9a8ea6b-aa16-4651-8c4b-fa266e3262a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:14:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3b7503ae-67c6-4415-af01-b712863a4cf0 tempest-VolumesServicesTestJSON-821759627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9a8ea6b-aa16-4651-8c4b-fa266e3262a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-447811133',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26ecb4b4-eb4f-462c-a454-c4b499092ffc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1d7bec0773b40bc9aa4da5fcacdf87f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:14:43Z,use_quota=True,user_id='279fd2d4a82849eca90781904ea469cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:14:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3b7503ae-67c6-4415-af01-b712863a4cf0 tempest-VolumesServicesTestJSON-821759627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1291f365-42c8-452a-8138-08bd7ce3eb29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:14:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3b7503ae-67c6-4415-af01-b712863a4cf0 tempest-VolumesServicesTestJSON-821759627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1291f365-42c8-452a-8138-08bd7ce3eb29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:14:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3b7503ae-67c6-4415-af01-b712863a4cf0 tempest-VolumesServicesTestJSON-821759627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15680de2-f333-4950-9db9-6be380d4d93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:14:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3b7503ae-67c6-4415-af01-b712863a4cf0 tempest-VolumesServicesTestJSON-821759627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15680de2-f333-4950-9db9-6be380d4d93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26ecb4b4-eb4f-462c-a454-c4b499092ffc', 'volume_name': 'volume-26ecb4b4-eb4f-462c-a454-c4b499092ffc', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:14:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3b7503ae-67c6-4415-af01-b712863a4cf0 tempest-VolumesServicesTestJSON-821759627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14dbf79c-60ab-4916-810a-b4656bebf815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:14:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3b7503ae-67c6-4415-af01-b712863a4cf0 tempest-VolumesServicesTestJSON-821759627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14dbf79c-60ab-4916-810a-b4656bebf815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:14:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3b7503ae-67c6-4415-af01-b712863a4cf0 tempest-VolumesServicesTestJSON-821759627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c7401f2-87dc-4599-adc5-66cd9605e9d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:14:43 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-3b7503ae-67c6-4415-af01-b712863a4cf0 tempest-VolumesServicesTestJSON-821759627 None] Volume 26ecb4b4-eb4f-462c-a454-c4b499092ffc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26ecb4b4-eb4f-462c-a454-c4b499092ffc', 'volume_size': 1}
Nov 04 12:14:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3b7503ae-67c6-4415-af01-b712863a4cf0 tempest-VolumesServicesTestJSON-821759627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:14:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3b7503ae-67c6-4415-af01-b712863a4cf0 tempest-VolumesServicesTestJSON-821759627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:14:43 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3b7503ae-67c6-4415-af01-b712863a4cf0 tempest-VolumesServicesTestJSON-821759627 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:14:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-447811133',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26ecb4b4-eb4f-462c-a454-c4b499092ffc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1d7bec0773b40bc9aa4da5fcacdf87f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:14:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:14:43Z,use_quota=True,user_id='279fd2d4a82849eca90781904ea469cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:14:43 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-3b7503ae-67c6-4415-af01-b712863a4cf0 tempest-VolumesServicesTestJSON-821759627 None] Creating volume 26ecb4b4-eb4f-462c-a454-c4b499092ffc {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:14:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3b7503ae-67c6-4415-af01-b712863a4cf0 tempest-VolumesServicesTestJSON-821759627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:14:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3b7503ae-67c6-4415-af01-b712863a4cf0 tempest-VolumesServicesTestJSON-821759627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:14:43 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3b7503ae-67c6-4415-af01-b712863a4cf0 tempest-VolumesServicesTestJSON-821759627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:14:43 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3b7503ae-67c6-4415-af01-b712863a4cf0 tempest-VolumesServicesTestJSON-821759627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:14:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3b7503ae-67c6-4415-af01-b712863a4cf0 tempest-VolumesServicesTestJSON-821759627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:14:43 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3b7503ae-67c6-4415-af01-b712863a4cf0 tempest-VolumesServicesTestJSON-821759627 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:14:43 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-3b7503ae-67c6-4415-af01-b712863a4cf0 tempest-VolumesServicesTestJSON-821759627 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:14:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3b7503ae-67c6-4415-af01-b712863a4cf0 tempest-VolumesServicesTestJSON-821759627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-26ecb4b4-eb4f-462c-a454-c4b499092ffc 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:14:43 devstack sudo[94960]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-26ecb4b4-eb4f-462c-a454-c4b499092ffc 1073741824
Nov 04 12:14:43 devstack sudo[94960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:14:44 devstack sudo[94960]: pam_unix(sudo:session): session closed for user root
Nov 04 12:14:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3b7503ae-67c6-4415-af01-b712863a4cf0 tempest-VolumesServicesTestJSON-821759627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-26ecb4b4-eb4f-462c-a454-c4b499092ffc 1073741824" returned: 0 in 0.946s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:14:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3b7503ae-67c6-4415-af01-b712863a4cf0 tempest-VolumesServicesTestJSON-821759627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-26ecb4b4-eb4f-462c-a454-c4b499092ffc {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:14:44 devstack sudo[95003]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-26ecb4b4-eb4f-462c-a454-c4b499092ffc
Nov 04 12:14:44 devstack sudo[95003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:14:44 devstack sudo[95003]: pam_unix(sudo:session): session closed for user root
Nov 04 12:14:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3b7503ae-67c6-4415-af01-b712863a4cf0 tempest-VolumesServicesTestJSON-821759627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-26ecb4b4-eb4f-462c-a454-c4b499092ffc" returned: 0 in 0.463s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:14:44 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3b7503ae-67c6-4415-af01-b712863a4cf0 tempest-VolumesServicesTestJSON-821759627 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:14:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3b7503ae-67c6-4415-af01-b712863a4cf0 tempest-VolumesServicesTestJSON-821759627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:14:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3b7503ae-67c6-4415-af01-b712863a4cf0 tempest-VolumesServicesTestJSON-821759627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c7401f2-87dc-4599-adc5-66cd9605e9d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26ecb4b4-eb4f-462c-a454-c4b499092ffc', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:14:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3b7503ae-67c6-4415-af01-b712863a4cf0 tempest-VolumesServicesTestJSON-821759627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a40cb206-fcb0-4492-9fa0-a61a688679e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:14:44 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-3b7503ae-67c6-4415-af01-b712863a4cf0 tempest-VolumesServicesTestJSON-821759627 None] Volume volume-26ecb4b4-eb4f-462c-a454-c4b499092ffc (26ecb4b4-eb4f-462c-a454-c4b499092ffc): created successfully
Nov 04 12:14:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3b7503ae-67c6-4415-af01-b712863a4cf0 tempest-VolumesServicesTestJSON-821759627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a40cb206-fcb0-4492-9fa0-a61a688679e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:14:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3b7503ae-67c6-4415-af01-b712863a4cf0 tempest-VolumesServicesTestJSON-821759627 None] Flow 'volume_create_manager' (634960e2-4e07-4eea-9601-42ed3a9843e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:14:44 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-3b7503ae-67c6-4415-af01-b712863a4cf0 tempest-VolumesServicesTestJSON-821759627 None] Created volume successfully.
Nov 04 12:14:46 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c49080c0-1713-409f-a804-be6356c789b5 tempest-VolumesServicesTestJSON-821759627 None] Acquiring lock "cinder-26ecb4b4-eb4f-462c-a454-c4b499092ffc-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:14:46 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c49080c0-1713-409f-a804-be6356c789b5 tempest-VolumesServicesTestJSON-821759627 None] Lock "cinder-26ecb4b4-eb4f-462c-a454-c4b499092ffc-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:14:46 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c49080c0-1713-409f-a804-be6356c789b5 tempest-VolumesServicesTestJSON-821759627 None] Acquiring lock "cinder-quobyte-26ecb4b4-eb4f-462c-a454-c4b499092ffc" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:14:46 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c49080c0-1713-409f-a804-be6356c789b5 tempest-VolumesServicesTestJSON-821759627 None] Lock "cinder-quobyte-26ecb4b4-eb4f-462c-a454-c4b499092ffc" acquired by "delete_volume" :: waited 0.034s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:14:46 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[92632fa7-81f8-4140-a10c-8aa14ccddaab]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:14:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c49080c0-1713-409f-a804-be6356c789b5 tempest-VolumesServicesTestJSON-821759627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-26ecb4b4-eb4f-462c-a454-c4b499092ffc {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:14:46 devstack sudo[95016]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-26ecb4b4-eb4f-462c-a454-c4b499092ffc
Nov 04 12:14:46 devstack sudo[95016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:14:47 devstack sudo[95016]: pam_unix(sudo:session): session closed for user root
Nov 04 12:14:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c49080c0-1713-409f-a804-be6356c789b5 tempest-VolumesServicesTestJSON-821759627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-26ecb4b4-eb4f-462c-a454-c4b499092ffc" returned: 0 in 0.578s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:14:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c49080c0-1713-409f-a804-be6356c789b5 tempest-VolumesServicesTestJSON-821759627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-26ecb4b4-eb4f-462c-a454-c4b499092ffc {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:14:47 devstack sudo[95021]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-26ecb4b4-eb4f-462c-a454-c4b499092ffc
Nov 04 12:14:47 devstack sudo[95021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:14:47 devstack sudo[95021]: pam_unix(sudo:session): session closed for user root
Nov 04 12:14:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c49080c0-1713-409f-a804-be6356c789b5 tempest-VolumesServicesTestJSON-821759627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-26ecb4b4-eb4f-462c-a454-c4b499092ffc" returned: 0 in 0.369s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:14:47 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c49080c0-1713-409f-a804-be6356c789b5 tempest-VolumesServicesTestJSON-821759627 None] Lock "cinder-quobyte-26ecb4b4-eb4f-462c-a454-c4b499092ffc" released by "delete_volume" :: held 1.039s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:14:47 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-c49080c0-1713-409f-a804-be6356c789b5 tempest-VolumesServicesTestJSON-821759627 None] Created reservations ['1af2503a-0b57-424d-9f0c-3c82270812ce', '06ae077a-fc06-4376-bf89-08a9d7085a71', '78426ea3-366c-412f-83c3-3f4286984dd8', '3274dc7a-5a33-4693-9268-620b75885b6c'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:14:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c49080c0-1713-409f-a804-be6356c789b5 tempest-VolumesServicesTestJSON-821759627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:14:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c49080c0-1713-409f-a804-be6356c789b5 tempest-VolumesServicesTestJSON-821759627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:14:47 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c49080c0-1713-409f-a804-be6356c789b5 tempest-VolumesServicesTestJSON-821759627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:14:47 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c49080c0-1713-409f-a804-be6356c789b5 tempest-VolumesServicesTestJSON-821759627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:14:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c49080c0-1713-409f-a804-be6356c789b5 tempest-VolumesServicesTestJSON-821759627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:14:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c49080c0-1713-409f-a804-be6356c789b5 tempest-VolumesServicesTestJSON-821759627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:14:47 devstack sudo[95024]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:14:47 devstack sudo[95024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:14:48 devstack sudo[95024]: pam_unix(sudo:session): session closed for user root
Nov 04 12:14:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c49080c0-1713-409f-a804-be6356c789b5 tempest-VolumesServicesTestJSON-821759627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.328s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:14:48 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-c49080c0-1713-409f-a804-be6356c789b5 tempest-VolumesServicesTestJSON-821759627 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:14:48 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-c49080c0-1713-409f-a804-be6356c789b5 tempest-VolumesServicesTestJSON-821759627 None] Deleted volume successfully.
Nov 04 12:14:48 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c49080c0-1713-409f-a804-be6356c789b5 tempest-VolumesServicesTestJSON-821759627 None] Lock "cinder-26ecb4b4-eb4f-462c-a454-c4b499092ffc-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:14:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-4b102ef3-e96a-45a3-8309-745c2c388e4a tempest-VolumesActionsTest-1608425806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:14:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-4b102ef3-e96a-45a3-8309-745c2c388e4a tempest-VolumesActionsTest-1608425806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:14:49 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ef3152-dc21-478a-97b5-9b69d05e9a6a]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:14:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4b102ef3-e96a-45a3-8309-745c2c388e4a tempest-VolumesActionsTest-1608425806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4d4ac416-d113-4ebf-b2c0-8b719b3830b5 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:14:49 devstack sudo[95027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4d4ac416-d113-4ebf-b2c0-8b719b3830b5
Nov 04 12:14:49 devstack sudo[95027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:14:49 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:14:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:14:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:14:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:14:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:14:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:14:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:14:49 devstack sudo[95029]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:14:49 devstack sudo[95029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:14:50 devstack sudo[95029]: pam_unix(sudo:session): session closed for user root
Nov 04 12:14:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.505s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:14:50 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:14:50 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager._thread_info {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:14:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread count: 28 {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 12:14:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread info: [<_MainThread(MainThread, started 137165867425920)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137165754678912)>, <Thread(Thread-3 (stat_writer), started daemon 137165754130752)>, <Thread(Rabbit-heartbeat, started daemon 137165752997504)>, <Thread(Thread-5 (_runner), started daemon 137165753227712)>, <Thread(Thread-7 (_runner), started daemon 137165751273856)>, <Thread(fd_logger, started daemon 137165755322048)>, <Thread(privsep_reader, started daemon 137165748896704)>, <Thread(tpool_thread_0, started daemon 137165742520000)>, <Thread(tpool_thread_1, started daemon 137165734127296)>, <Thread(tpool_thread_2, started daemon 137165725734592)>, <Thread(tpool_thread_3, started daemon 137165717341888)>, <Thread(tpool_thread_4, started daemon 137165708949184)>, <Thread(tpool_thread_5, started daemon 137165700556480)>, <Thread(tpool_thread_6, started daemon 137165692163776)>, <Thread(tpool_thread_7, started daemon 137165683771072)>, <Thread(tpool_thread_8, started daemon 137165675378368)>, <Thread(tpool_thread_9, started daemon 137165666985664)>, <Thread(tpool_thread_10, started daemon 137165658592960)>, <Thread(tpool_thread_11, started daemon 137165650183872)>, <Thread(tpool_thread_12, started daemon 137165641774784)>, <Thread(tpool_thread_13, started daemon 137165633365696)>, <Thread(tpool_thread_14, started daemon 137165624956608)>, <Thread(tpool_thread_15, started daemon 137165616547520)>, <Thread(tpool_thread_16, started daemon 137165608138432)>, <Thread(tpool_thread_17, started daemon 137165599729344)>, <Thread(tpool_thread_18, started daemon 137165591320256)>, <Thread(tpool_thread_19, started daemon 137165582911168)>] {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 12:14:50 devstack sudo[95027]: pam_unix(sudo:session): session closed for user root
Nov 04 12:14:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4b102ef3-e96a-45a3-8309-745c2c388e4a tempest-VolumesActionsTest-1608425806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4d4ac416-d113-4ebf-b2c0-8b719b3830b5" returned: 0 in 0.791s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:14:50 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[69bcf422-1979-4bbc-abce-15468d8d0558]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:14:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4b102ef3-e96a-45a3-8309-745c2c388e4a tempest-VolumesActionsTest-1608425806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4d4ac416-d113-4ebf-b2c0-8b719b3830b5 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:14:50 devstack sudo[95035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4d4ac416-d113-4ebf-b2c0-8b719b3830b5
Nov 04 12:14:50 devstack sudo[95035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:14:50 devstack sudo[95035]: pam_unix(sudo:session): session closed for user root
Nov 04 12:14:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4b102ef3-e96a-45a3-8309-745c2c388e4a tempest-VolumesActionsTest-1608425806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4d4ac416-d113-4ebf-b2c0-8b719b3830b5" returned: 0 in 0.584s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:14:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4b102ef3-e96a-45a3-8309-745c2c388e4a tempest-VolumesActionsTest-1608425806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4d4ac416-d113-4ebf-b2c0-8b719b3830b5 /opt/stack/data/cinder/conversion/4d4ac416-d113-4ebf-b2c0-8b719b3830b5.temp_image.f5c09ec2-595f-4ef8-92f6-f28ca865cb07922y__mj.img {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:14:51 devstack sudo[95041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4d4ac416-d113-4ebf-b2c0-8b719b3830b5 /opt/stack/data/cinder/conversion/4d4ac416-d113-4ebf-b2c0-8b719b3830b5.temp_image.f5c09ec2-595f-4ef8-92f6-f28ca865cb07922y__mj.img
Nov 04 12:14:51 devstack sudo[95041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:14:58 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=44,cinder:INSERT=11,cinder:UPDATE=48,cinder:DELETE=3 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:14:59 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:UPDATE=42,cinder:SELECT=52,cinder:INSERT=8,cinder:DELETE=3 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:15:01 devstack sudo[95041]: pam_unix(sudo:session): session closed for user root
Nov 04 12:15:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4b102ef3-e96a-45a3-8309-745c2c388e4a tempest-VolumesActionsTest-1608425806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4d4ac416-d113-4ebf-b2c0-8b719b3830b5 /opt/stack/data/cinder/conversion/4d4ac416-d113-4ebf-b2c0-8b719b3830b5.temp_image.f5c09ec2-595f-4ef8-92f6-f28ca865cb07922y__mj.img" returned: 0 in 10.350s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:15:01 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[99dcbc10-57c6-4b87-97a9-6aeffac05d6f]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:15:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4b102ef3-e96a-45a3-8309-745c2c388e4a tempest-VolumesActionsTest-1608425806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4d4ac416-d113-4ebf-b2c0-8b719b3830b5 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:15:01 devstack sudo[95099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4d4ac416-d113-4ebf-b2c0-8b719b3830b5
Nov 04 12:15:01 devstack sudo[95099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:15:02 devstack sudo[95099]: pam_unix(sudo:session): session closed for user root
Nov 04 12:15:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4b102ef3-e96a-45a3-8309-745c2c388e4a tempest-VolumesActionsTest-1608425806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4d4ac416-d113-4ebf-b2c0-8b719b3830b5" returned: 0 in 0.728s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:15:02 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-4b102ef3-e96a-45a3-8309-745c2c388e4a tempest-VolumesActionsTest-1608425806 None] Image conversion details: src /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4d4ac416-d113-4ebf-b2c0-8b719b3830b5, size 1024.00 MB, duration 10.35 sec, destination /opt/stack/data/cinder/conversion/4d4ac416-d113-4ebf-b2c0-8b719b3830b5.temp_image.f5c09ec2-595f-4ef8-92f6-f28ca865cb07922y__mj.img {{(pid=87169) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 12:15:02 devstack cinder-volume[87169]: INFO cinder.image.image_utils [None req-4b102ef3-e96a-45a3-8309-745c2c388e4a tempest-VolumesActionsTest-1608425806 None] Converted 1024.00 MB image at 98.93 MB/s
Nov 04 12:15:02 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-4b102ef3-e96a-45a3-8309-745c2c388e4a tempest-VolumesActionsTest-1608425806 None] f5c09ec2-595f-4ef8-92f6-f28ca865cb07 was raw, no need to convert to raw {{(pid=87169) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Nov 04 12:15:09 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-c6fa97f4-8f8f-4b83-8f5e-eb4f3b5865c1 req-f59a62f4-e659-4ace-ba44-a09fce3c3099 tempest-AttachVolumeTestJSON-852332315 None] Terminate volume connection completed successfully.
Nov 04 12:15:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-c6fa97f4-8f8f-4b83-8f5e-eb4f3b5865c1 req-f59a62f4-e659-4ace-ba44-a09fce3c3099 tempest-AttachVolumeTestJSON-852332315 None] Deleting attachment 9fdba586-3829-49c7-b11c-2a2b53744935. {{(pid=87169) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 12:15:12 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=1 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:15:19 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=3 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:15:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-4b102ef3-e96a-45a3-8309-745c2c388e4a tempest-VolumesActionsTest-1608425806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 46.791s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:15:36 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-4b102ef3-e96a-45a3-8309-745c2c388e4a tempest-VolumesActionsTest-1608425806 None] Uploaded volume to glance image-id: f5c09ec2-595f-4ef8-92f6-f28ca865cb07. {{(pid=87169) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 04 12:15:36 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-4b102ef3-e96a-45a3-8309-745c2c388e4a tempest-VolumesActionsTest-1608425806 None] Copy volume to image completed successfully.
Nov 04 12:15:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d48be701-8b8a-4384-a8c5-9b8f91aff1e6 tempest-VolumesActionsTest-1608425806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:15:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d48be701-8b8a-4384-a8c5-9b8f91aff1e6 tempest-VolumesActionsTest-1608425806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:15:37 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d0ed60-3be8-4967-a44d-68faa3983efb]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:15:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d48be701-8b8a-4384-a8c5-9b8f91aff1e6 tempest-VolumesActionsTest-1608425806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4d4ac416-d113-4ebf-b2c0-8b719b3830b5 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:15:37 devstack sudo[95385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4d4ac416-d113-4ebf-b2c0-8b719b3830b5
Nov 04 12:15:37 devstack sudo[95385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:15:38 devstack sudo[95385]: pam_unix(sudo:session): session closed for user root
Nov 04 12:15:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d48be701-8b8a-4384-a8c5-9b8f91aff1e6 tempest-VolumesActionsTest-1608425806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4d4ac416-d113-4ebf-b2c0-8b719b3830b5" returned: 0 in 0.431s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:15:38 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d0b747-129f-4ad6-bd45-db094526971b]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:15:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d48be701-8b8a-4384-a8c5-9b8f91aff1e6 tempest-VolumesActionsTest-1608425806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4d4ac416-d113-4ebf-b2c0-8b719b3830b5 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:15:38 devstack sudo[95390]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4d4ac416-d113-4ebf-b2c0-8b719b3830b5
Nov 04 12:15:38 devstack sudo[95390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:15:38 devstack sudo[95390]: pam_unix(sudo:session): session closed for user root
Nov 04 12:15:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d48be701-8b8a-4384-a8c5-9b8f91aff1e6 tempest-VolumesActionsTest-1608425806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4d4ac416-d113-4ebf-b2c0-8b719b3830b5" returned: 0 in 0.413s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:15:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d48be701-8b8a-4384-a8c5-9b8f91aff1e6 tempest-VolumesActionsTest-1608425806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4d4ac416-d113-4ebf-b2c0-8b719b3830b5 /opt/stack/data/cinder/conversion/4d4ac416-d113-4ebf-b2c0-8b719b3830b5.temp_image.5a4a4c7e-d488-4f81-a4f9-632aa26d633b81920chk.img {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:15:38 devstack sudo[95395]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4d4ac416-d113-4ebf-b2c0-8b719b3830b5 /opt/stack/data/cinder/conversion/4d4ac416-d113-4ebf-b2c0-8b719b3830b5.temp_image.5a4a4c7e-d488-4f81-a4f9-632aa26d633b81920chk.img
Nov 04 12:15:38 devstack sudo[95395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:15:44 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2f7ff92-3662-4dff-8bdc-a1defdc14696 tempest-AttachVolumeNegativeTest-1447430610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:15:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f2f7ff92-3662-4dff-8bdc-a1defdc14696 tempest-AttachVolumeNegativeTest-1447430610 None] Flow 'volume_create_manager' (2fd961e6-f3cf-43a6-ae1b-c6c2b9707098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:15:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f2f7ff92-3662-4dff-8bdc-a1defdc14696 tempest-AttachVolumeNegativeTest-1447430610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c821693b-42a9-4b46-b5e0-6245aab8e45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:15:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f2f7ff92-3662-4dff-8bdc-a1defdc14696 tempest-AttachVolumeNegativeTest-1447430610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c821693b-42a9-4b46-b5e0-6245aab8e45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-404438112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=053ecea3-f1c1-413d-8367-60380535ae67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c984da2769343719eed28765103c79e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:15:44Z,use_quota=True,user_id='952c91a30ef946e08ee0498a11ff1a91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:15:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f2f7ff92-3662-4dff-8bdc-a1defdc14696 tempest-AttachVolumeNegativeTest-1447430610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eae2556-220f-4441-8ecc-4f05ba65fce8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:15:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f2f7ff92-3662-4dff-8bdc-a1defdc14696 tempest-AttachVolumeNegativeTest-1447430610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eae2556-220f-4441-8ecc-4f05ba65fce8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:15:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f2f7ff92-3662-4dff-8bdc-a1defdc14696 tempest-AttachVolumeNegativeTest-1447430610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbe50e1b-ffad-434d-9332-170660df8b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:15:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f2f7ff92-3662-4dff-8bdc-a1defdc14696 tempest-AttachVolumeNegativeTest-1447430610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbe50e1b-ffad-434d-9332-170660df8b8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '053ecea3-f1c1-413d-8367-60380535ae67', 'volume_name': 'volume-053ecea3-f1c1-413d-8367-60380535ae67', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:15:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f2f7ff92-3662-4dff-8bdc-a1defdc14696 tempest-AttachVolumeNegativeTest-1447430610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db4793e0-3cd0-4b05-bcba-fe9fd109fa30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:15:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f2f7ff92-3662-4dff-8bdc-a1defdc14696 tempest-AttachVolumeNegativeTest-1447430610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db4793e0-3cd0-4b05-bcba-fe9fd109fa30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:15:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f2f7ff92-3662-4dff-8bdc-a1defdc14696 tempest-AttachVolumeNegativeTest-1447430610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b6f6bbe-311d-4289-ab78-b84cc313606d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:15:44 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-f2f7ff92-3662-4dff-8bdc-a1defdc14696 tempest-AttachVolumeNegativeTest-1447430610 None] Volume 053ecea3-f1c1-413d-8367-60380535ae67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-053ecea3-f1c1-413d-8367-60380535ae67', 'volume_size': 1}
Nov 04 12:15:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f2f7ff92-3662-4dff-8bdc-a1defdc14696 tempest-AttachVolumeNegativeTest-1447430610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:15:46 devstack sudo[95395]: pam_unix(sudo:session): session closed for user root
Nov 04 12:15:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d48be701-8b8a-4384-a8c5-9b8f91aff1e6 tempest-VolumesActionsTest-1608425806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4d4ac416-d113-4ebf-b2c0-8b719b3830b5 /opt/stack/data/cinder/conversion/4d4ac416-d113-4ebf-b2c0-8b719b3830b5.temp_image.5a4a4c7e-d488-4f81-a4f9-632aa26d633b81920chk.img" returned: 0 in 7.971s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:15:46 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1daf20-01bc-4876-b11e-15462fbf2066]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:15:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d48be701-8b8a-4384-a8c5-9b8f91aff1e6 tempest-VolumesActionsTest-1608425806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4d4ac416-d113-4ebf-b2c0-8b719b3830b5 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:15:46 devstack sudo[95413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4d4ac416-d113-4ebf-b2c0-8b719b3830b5
Nov 04 12:15:46 devstack sudo[95413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:15:47 devstack sudo[95413]: pam_unix(sudo:session): session closed for user root
Nov 04 12:15:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d48be701-8b8a-4384-a8c5-9b8f91aff1e6 tempest-VolumesActionsTest-1608425806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4d4ac416-d113-4ebf-b2c0-8b719b3830b5" returned: 0 in 0.616s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:15:47 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-d48be701-8b8a-4384-a8c5-9b8f91aff1e6 tempest-VolumesActionsTest-1608425806 None] Image conversion details: src /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4d4ac416-d113-4ebf-b2c0-8b719b3830b5, size 1024.00 MB, duration 7.97 sec, destination /opt/stack/data/cinder/conversion/4d4ac416-d113-4ebf-b2c0-8b719b3830b5.temp_image.5a4a4c7e-d488-4f81-a4f9-632aa26d633b81920chk.img {{(pid=87169) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 12:15:47 devstack cinder-volume[87169]: INFO cinder.image.image_utils [None req-d48be701-8b8a-4384-a8c5-9b8f91aff1e6 tempest-VolumesActionsTest-1608425806 None] Converted 1024.00 MB image at 128.42 MB/s
Nov 04 12:15:47 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-d48be701-8b8a-4384-a8c5-9b8f91aff1e6 tempest-VolumesActionsTest-1608425806 None] 5a4a4c7e-d488-4f81-a4f9-632aa26d633b was raw, converting to qcow2 {{(pid=87169) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}}
Nov 04 12:15:47 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[417f3415-0dd5-4c30-b9da-7a80c4cb0071]: (4, 'raw') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:15:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d48be701-8b8a-4384-a8c5-9b8f91aff1e6 tempest-VolumesActionsTest-1608425806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4d4ac416-d113-4ebf-b2c0-8b719b3830b5.temp_image.5a4a4c7e-d488-4f81-a4f9-632aa26d633b81920chk.img {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:15:47 devstack sudo[95419]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4d4ac416-d113-4ebf-b2c0-8b719b3830b5.temp_image.5a4a4c7e-d488-4f81-a4f9-632aa26d633b81920chk.img
Nov 04 12:15:47 devstack sudo[95419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:15:47 devstack sudo[95419]: pam_unix(sudo:session): session closed for user root
Nov 04 12:15:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d48be701-8b8a-4384-a8c5-9b8f91aff1e6 tempest-VolumesActionsTest-1608425806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/4d4ac416-d113-4ebf-b2c0-8b719b3830b5.temp_image.5a4a4c7e-d488-4f81-a4f9-632aa26d633b81920chk.img" returned: 0 in 0.384s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:15:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d48be701-8b8a-4384-a8c5-9b8f91aff1e6 tempest-VolumesActionsTest-1608425806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4d4ac416-d113-4ebf-b2c0-8b719b3830b5.temp_image.5a4a4c7e-d488-4f81-a4f9-632aa26d633b81920chk.img {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:15:47 devstack sudo[95423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4d4ac416-d113-4ebf-b2c0-8b719b3830b5.temp_image.5a4a4c7e-d488-4f81-a4f9-632aa26d633b81920chk.img
Nov 04 12:15:47 devstack sudo[95423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:15:48 devstack sudo[95423]: pam_unix(sudo:session): session closed for user root
Nov 04 12:15:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d48be701-8b8a-4384-a8c5-9b8f91aff1e6 tempest-VolumesActionsTest-1608425806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4d4ac416-d113-4ebf-b2c0-8b719b3830b5.temp_image.5a4a4c7e-d488-4f81-a4f9-632aa26d633b81920chk.img" returned: 1 in 0.366s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:15:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d48be701-8b8a-4384-a8c5-9b8f91aff1e6 tempest-VolumesActionsTest-1608425806 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/4d4ac416-d113-4ebf-b2c0-8b719b3830b5.temp_image.5a4a4c7e-d488-4f81-a4f9-632aa26d633b81920chk.img' failed. Not Retrying. {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 12:15:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d48be701-8b8a-4384-a8c5-9b8f91aff1e6 tempest-VolumesActionsTest-1608425806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4d4ac416-d113-4ebf-b2c0-8b719b3830b5.temp_image.5a4a4c7e-d488-4f81-a4f9-632aa26d633b81920chk.img /opt/stack/data/cinder/conversion/vol_upload_9ntl7kyr {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:15:48 devstack sudo[95428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4d4ac416-d113-4ebf-b2c0-8b719b3830b5.temp_image.5a4a4c7e-d488-4f81-a4f9-632aa26d633b81920chk.img /opt/stack/data/cinder/conversion/vol_upload_9ntl7kyr
Nov 04 12:15:48 devstack sudo[95428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:15:48 devstack sudo[95428]: pam_unix(sudo:session): session closed for user root
Nov 04 12:15:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d48be701-8b8a-4384-a8c5-9b8f91aff1e6 tempest-VolumesActionsTest-1608425806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/4d4ac416-d113-4ebf-b2c0-8b719b3830b5.temp_image.5a4a4c7e-d488-4f81-a4f9-632aa26d633b81920chk.img /opt/stack/data/cinder/conversion/vol_upload_9ntl7kyr" returned: 0 in 0.299s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:15:48 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-d48be701-8b8a-4384-a8c5-9b8f91aff1e6 tempest-VolumesActionsTest-1608425806 None] Image conversion details: src /opt/stack/data/cinder/conversion/4d4ac416-d113-4ebf-b2c0-8b719b3830b5.temp_image.5a4a4c7e-d488-4f81-a4f9-632aa26d633b81920chk.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_9ntl7kyr {{(pid=87169) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 12:15:48 devstack cinder-volume[87169]: INFO cinder.image.image_utils [None req-d48be701-8b8a-4384-a8c5-9b8f91aff1e6 tempest-VolumesActionsTest-1608425806 None] Converted 1024.00 MB image at 1024.00 MB/s
Nov 04 12:15:48 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea042f2d-091c-49fd-b39d-4ae3780c408b]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:15:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d48be701-8b8a-4384-a8c5-9b8f91aff1e6 tempest-VolumesActionsTest-1608425806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_9ntl7kyr {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:15:48 devstack sudo[95434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_9ntl7kyr
Nov 04 12:15:48 devstack sudo[95434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:15:48 devstack sudo[95434]: pam_unix(sudo:session): session closed for user root
Nov 04 12:15:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d48be701-8b8a-4384-a8c5-9b8f91aff1e6 tempest-VolumesActionsTest-1608425806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_9ntl7kyr" returned: 0 in 0.420s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:15:49 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:15:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:15:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:15:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:15:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:15:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:15:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:15:49 devstack sudo[95440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:15:49 devstack sudo[95440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:15:50 devstack sudo[95440]: pam_unix(sudo:session): session closed for user root
Nov 04 12:15:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.275s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:15:50 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:15:50 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager._thread_info {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:15:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread count: 28 {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 12:15:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread info: [<_MainThread(MainThread, started 137165867425920)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137165754678912)>, <Thread(Thread-3 (stat_writer), started daemon 137165754130752)>, <Thread(Rabbit-heartbeat, started daemon 137165752997504)>, <Thread(Thread-5 (_runner), started daemon 137165753227712)>, <Thread(Thread-7 (_runner), started daemon 137165751273856)>, <Thread(fd_logger, started daemon 137165755322048)>, <Thread(privsep_reader, started daemon 137165748896704)>, <Thread(tpool_thread_0, started daemon 137165742520000)>, <Thread(tpool_thread_1, started daemon 137165734127296)>, <Thread(tpool_thread_2, started daemon 137165725734592)>, <Thread(tpool_thread_3, started daemon 137165717341888)>, <Thread(tpool_thread_4, started daemon 137165708949184)>, <Thread(tpool_thread_5, started daemon 137165700556480)>, <Thread(tpool_thread_6, started daemon 137165692163776)>, <Thread(tpool_thread_7, started daemon 137165683771072)>, <Thread(tpool_thread_8, started daemon 137165675378368)>, <Thread(tpool_thread_9, started daemon 137165666985664)>, <Thread(tpool_thread_10, started daemon 137165658592960)>, <Thread(tpool_thread_11, started daemon 137165650183872)>, <Thread(tpool_thread_12, started daemon 137165641774784)>, <Thread(tpool_thread_13, started daemon 137165633365696)>, <Thread(tpool_thread_14, started daemon 137165624956608)>, <Thread(tpool_thread_15, started daemon 137165616547520)>, <Thread(tpool_thread_16, started daemon 137165608138432)>, <Thread(tpool_thread_17, started daemon 137165599729344)>, <Thread(tpool_thread_18, started daemon 137165591320256)>, <Thread(tpool_thread_19, started daemon 137165582911168)>] {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 12:15:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d48be701-8b8a-4384-a8c5-9b8f91aff1e6 tempest-VolumesActionsTest-1608425806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.462s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:15:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d48be701-8b8a-4384-a8c5-9b8f91aff1e6 tempest-VolumesActionsTest-1608425806 None] Uploaded volume to glance image-id: 5a4a4c7e-d488-4f81-a4f9-632aa26d633b. {{(pid=87169) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 04 12:15:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f2f7ff92-3662-4dff-8bdc-a1defdc14696 tempest-AttachVolumeNegativeTest-1447430610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.804s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:15:50 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f2f7ff92-3662-4dff-8bdc-a1defdc14696 tempest-AttachVolumeNegativeTest-1447430610 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-404438112',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=053ecea3-f1c1-413d-8367-60380535ae67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c984da2769343719eed28765103c79e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:15:44Z,use_quota=True,user_id='952c91a30ef946e08ee0498a11ff1a91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:15:50 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-f2f7ff92-3662-4dff-8bdc-a1defdc14696 tempest-AttachVolumeNegativeTest-1447430610 None] Creating volume 053ecea3-f1c1-413d-8367-60380535ae67 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:15:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f2f7ff92-3662-4dff-8bdc-a1defdc14696 tempest-AttachVolumeNegativeTest-1447430610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:15:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f2f7ff92-3662-4dff-8bdc-a1defdc14696 tempest-AttachVolumeNegativeTest-1447430610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:15:50 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f2f7ff92-3662-4dff-8bdc-a1defdc14696 tempest-AttachVolumeNegativeTest-1447430610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:15:50 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f2f7ff92-3662-4dff-8bdc-a1defdc14696 tempest-AttachVolumeNegativeTest-1447430610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:15:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f2f7ff92-3662-4dff-8bdc-a1defdc14696 tempest-AttachVolumeNegativeTest-1447430610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:15:50 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f2f7ff92-3662-4dff-8bdc-a1defdc14696 tempest-AttachVolumeNegativeTest-1447430610 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:15:50 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-f2f7ff92-3662-4dff-8bdc-a1defdc14696 tempest-AttachVolumeNegativeTest-1447430610 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:15:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f2f7ff92-3662-4dff-8bdc-a1defdc14696 tempest-AttachVolumeNegativeTest-1447430610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-053ecea3-f1c1-413d-8367-60380535ae67 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:15:50 devstack sudo[95443]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-053ecea3-f1c1-413d-8367-60380535ae67 1073741824
Nov 04 12:15:50 devstack sudo[95443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:15:50 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-d48be701-8b8a-4384-a8c5-9b8f91aff1e6 tempest-VolumesActionsTest-1608425806 None] Copy volume to image completed successfully.
Nov 04 12:15:50 devstack sudo[95443]: pam_unix(sudo:session): session closed for user root
Nov 04 12:15:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f2f7ff92-3662-4dff-8bdc-a1defdc14696 tempest-AttachVolumeNegativeTest-1447430610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-053ecea3-f1c1-413d-8367-60380535ae67 1073741824" returned: 0 in 0.532s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:15:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f2f7ff92-3662-4dff-8bdc-a1defdc14696 tempest-AttachVolumeNegativeTest-1447430610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-053ecea3-f1c1-413d-8367-60380535ae67 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:15:50 devstack sudo[95453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-053ecea3-f1c1-413d-8367-60380535ae67
Nov 04 12:15:50 devstack sudo[95453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:15:51 devstack sudo[95453]: pam_unix(sudo:session): session closed for user root
Nov 04 12:15:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f2f7ff92-3662-4dff-8bdc-a1defdc14696 tempest-AttachVolumeNegativeTest-1447430610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-053ecea3-f1c1-413d-8367-60380535ae67" returned: 0 in 0.298s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:15:51 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f2f7ff92-3662-4dff-8bdc-a1defdc14696 tempest-AttachVolumeNegativeTest-1447430610 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:15:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f2f7ff92-3662-4dff-8bdc-a1defdc14696 tempest-AttachVolumeNegativeTest-1447430610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:15:51 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f2f7ff92-3662-4dff-8bdc-a1defdc14696 tempest-AttachVolumeNegativeTest-1447430610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b6f6bbe-311d-4289-ab78-b84cc313606d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-053ecea3-f1c1-413d-8367-60380535ae67', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:15:51 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f2f7ff92-3662-4dff-8bdc-a1defdc14696 tempest-AttachVolumeNegativeTest-1447430610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15a8eda3-7051-49eb-b5b5-d403e43ef90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:15:51 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-466c78c1-bb79-4f27-a952-510e70f781bf tempest-VolumesActionsTest-1608425806 None] Acquiring lock "cinder-4d4ac416-d113-4ebf-b2c0-8b719b3830b5-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:15:51 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-f2f7ff92-3662-4dff-8bdc-a1defdc14696 tempest-AttachVolumeNegativeTest-1447430610 None] Volume volume-053ecea3-f1c1-413d-8367-60380535ae67 (053ecea3-f1c1-413d-8367-60380535ae67): created successfully
Nov 04 12:15:51 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f2f7ff92-3662-4dff-8bdc-a1defdc14696 tempest-AttachVolumeNegativeTest-1447430610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15a8eda3-7051-49eb-b5b5-d403e43ef90c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:15:51 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f2f7ff92-3662-4dff-8bdc-a1defdc14696 tempest-AttachVolumeNegativeTest-1447430610 None] Flow 'volume_create_manager' (2fd961e6-f3cf-43a6-ae1b-c6c2b9707098) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:15:51 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-466c78c1-bb79-4f27-a952-510e70f781bf tempest-VolumesActionsTest-1608425806 None] Lock "cinder-4d4ac416-d113-4ebf-b2c0-8b719b3830b5-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:15:51 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-f2f7ff92-3662-4dff-8bdc-a1defdc14696 tempest-AttachVolumeNegativeTest-1447430610 None] Created volume successfully.
Nov 04 12:15:51 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-466c78c1-bb79-4f27-a952-510e70f781bf tempest-VolumesActionsTest-1608425806 None] Acquiring lock "cinder-quobyte-4d4ac416-d113-4ebf-b2c0-8b719b3830b5" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:15:51 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-466c78c1-bb79-4f27-a952-510e70f781bf tempest-VolumesActionsTest-1608425806 None] Lock "cinder-quobyte-4d4ac416-d113-4ebf-b2c0-8b719b3830b5" acquired by "delete_volume" :: waited 0.016s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:15:51 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e6f7ec-ed29-4ad0-8b10-455af05e4d12]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:15:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-466c78c1-bb79-4f27-a952-510e70f781bf tempest-VolumesActionsTest-1608425806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4d4ac416-d113-4ebf-b2c0-8b719b3830b5 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:15:51 devstack sudo[95457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4d4ac416-d113-4ebf-b2c0-8b719b3830b5
Nov 04 12:15:51 devstack sudo[95457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:15:51 devstack sudo[95457]: pam_unix(sudo:session): session closed for user root
Nov 04 12:15:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-466c78c1-bb79-4f27-a952-510e70f781bf tempest-VolumesActionsTest-1608425806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4d4ac416-d113-4ebf-b2c0-8b719b3830b5" returned: 0 in 0.455s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:15:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-466c78c1-bb79-4f27-a952-510e70f781bf tempest-VolumesActionsTest-1608425806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4d4ac416-d113-4ebf-b2c0-8b719b3830b5 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:15:51 devstack sudo[95466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4d4ac416-d113-4ebf-b2c0-8b719b3830b5
Nov 04 12:15:51 devstack sudo[95466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:15:52 devstack sudo[95466]: pam_unix(sudo:session): session closed for user root
Nov 04 12:15:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-466c78c1-bb79-4f27-a952-510e70f781bf tempest-VolumesActionsTest-1608425806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4d4ac416-d113-4ebf-b2c0-8b719b3830b5" returned: 0 in 0.342s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:15:52 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-466c78c1-bb79-4f27-a952-510e70f781bf tempest-VolumesActionsTest-1608425806 None] Lock "cinder-quobyte-4d4ac416-d113-4ebf-b2c0-8b719b3830b5" released by "delete_volume" :: held 0.859s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:15:52 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-466c78c1-bb79-4f27-a952-510e70f781bf tempest-VolumesActionsTest-1608425806 None] Created reservations ['1b465ec3-384e-4a32-b8e5-45e71c57c94a', '7fbe0268-b07f-43d0-9f7e-5a302f4a2079', 'e7c605fb-cd51-4908-a86d-b2abc95b0fe9', 'b3c57f64-eaf1-426c-aeae-169bd540fd16'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:15:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-466c78c1-bb79-4f27-a952-510e70f781bf tempest-VolumesActionsTest-1608425806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:15:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-466c78c1-bb79-4f27-a952-510e70f781bf tempest-VolumesActionsTest-1608425806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:15:52 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-466c78c1-bb79-4f27-a952-510e70f781bf tempest-VolumesActionsTest-1608425806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:15:52 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-466c78c1-bb79-4f27-a952-510e70f781bf tempest-VolumesActionsTest-1608425806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:15:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-466c78c1-bb79-4f27-a952-510e70f781bf tempest-VolumesActionsTest-1608425806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:15:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-466c78c1-bb79-4f27-a952-510e70f781bf tempest-VolumesActionsTest-1608425806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:15:52 devstack sudo[95473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:15:52 devstack sudo[95473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:15:52 devstack sudo[95473]: pam_unix(sudo:session): session closed for user root
Nov 04 12:15:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-466c78c1-bb79-4f27-a952-510e70f781bf tempest-VolumesActionsTest-1608425806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.411s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:15:52 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-466c78c1-bb79-4f27-a952-510e70f781bf tempest-VolumesActionsTest-1608425806 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:15:52 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-466c78c1-bb79-4f27-a952-510e70f781bf tempest-VolumesActionsTest-1608425806 None] Deleted volume successfully.
Nov 04 12:15:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-7d13c622-5002-499a-a30a-2233e6e96b96 req-1424ae69-738a-4c6f-9271-395f10ddd029 tempest-AttachVolumeNegativeTest-1447430610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:15:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-7d13c622-5002-499a-a30a-2233e6e96b96 req-1424ae69-738a-4c6f-9271-395f10ddd029 tempest-AttachVolumeNegativeTest-1447430610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:15:52 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-466c78c1-bb79-4f27-a952-510e70f781bf tempest-VolumesActionsTest-1608425806 None] Lock "cinder-4d4ac416-d113-4ebf-b2c0-8b719b3830b5-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:15:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-7d13c622-5002-499a-a30a-2233e6e96b96 req-1424ae69-738a-4c6f-9271-395f10ddd029 tempest-AttachVolumeNegativeTest-1447430610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:15:52 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-7d13c622-5002-499a-a30a-2233e6e96b96 req-1424ae69-738a-4c6f-9271-395f10ddd029 tempest-AttachVolumeNegativeTest-1447430610 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79', 'name': 'volume-053ecea3-f1c1-413d-8367-60380535ae67', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f7327eae-8334-44db-98c6-7dfc1f699632', 'enforce_multipath': True} {{(pid=87169) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 04 12:15:52 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-7d13c622-5002-499a-a30a-2233e6e96b96 req-1424ae69-738a-4c6f-9271-395f10ddd029 tempest-AttachVolumeNegativeTest-1447430610 None] attachment_update completed successfully.
Nov 04 12:16:02 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:UPDATE=14,cinder:SELECT=16,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:16:06 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-acd57e32-41fe-4af7-b04c-66b6af42b601 tempest-VolumesActionsTest-1453472894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:16:06 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-acd57e32-41fe-4af7-b04c-66b6af42b601 tempest-VolumesActionsTest-1453472894 None] Flow 'volume_create_manager' (efdc3275-fb66-478a-ae33-2f0a05865b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:16:06 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-acd57e32-41fe-4af7-b04c-66b6af42b601 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b52d71b5-66df-41f9-ae8d-3e717724d8b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:06 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-acd57e32-41fe-4af7-b04c-66b6af42b601 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b52d71b5-66df-41f9-ae8d-3e717724d8b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-772458842',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60353589-cb4a-43b8-868f-de65b2ef76a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee013ffa34794b8c98cfceccde6a0ae7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:16:06Z,use_quota=True,user_id='260254844b1949b4a0eaafcd6028debb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:06 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-acd57e32-41fe-4af7-b04c-66b6af42b601 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cad7e1b8-be14-4998-abb3-f80d6ed5d366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:06 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-acd57e32-41fe-4af7-b04c-66b6af42b601 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cad7e1b8-be14-4998-abb3-f80d6ed5d366) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:06 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-acd57e32-41fe-4af7-b04c-66b6af42b601 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7794c554-e678-4f0d-b422-fba43658cd02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:06 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-acd57e32-41fe-4af7-b04c-66b6af42b601 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7794c554-e678-4f0d-b422-fba43658cd02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60353589-cb4a-43b8-868f-de65b2ef76a5', 'volume_name': 'volume-60353589-cb4a-43b8-868f-de65b2ef76a5', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:06 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-acd57e32-41fe-4af7-b04c-66b6af42b601 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d280205b-2e5e-48f0-8c36-2528bb80a57a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:06 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-acd57e32-41fe-4af7-b04c-66b6af42b601 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d280205b-2e5e-48f0-8c36-2528bb80a57a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:06 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-acd57e32-41fe-4af7-b04c-66b6af42b601 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c813313-b8ec-4ca3-82c3-d5e86b3ff134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:06 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-acd57e32-41fe-4af7-b04c-66b6af42b601 tempest-VolumesActionsTest-1453472894 None] Volume 60353589-cb4a-43b8-868f-de65b2ef76a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60353589-cb4a-43b8-868f-de65b2ef76a5', 'volume_size': 1}
Nov 04 12:16:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-acd57e32-41fe-4af7-b04c-66b6af42b601 tempest-VolumesActionsTest-1453472894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:16:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-acd57e32-41fe-4af7-b04c-66b6af42b601 tempest-VolumesActionsTest-1453472894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:16:06 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-acd57e32-41fe-4af7-b04c-66b6af42b601 tempest-VolumesActionsTest-1453472894 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:16:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-772458842',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60353589-cb4a-43b8-868f-de65b2ef76a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee013ffa34794b8c98cfceccde6a0ae7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:16:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:16:06Z,use_quota=True,user_id='260254844b1949b4a0eaafcd6028debb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:16:06 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-acd57e32-41fe-4af7-b04c-66b6af42b601 tempest-VolumesActionsTest-1453472894 None] Creating volume 60353589-cb4a-43b8-868f-de65b2ef76a5 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:16:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-acd57e32-41fe-4af7-b04c-66b6af42b601 tempest-VolumesActionsTest-1453472894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:16:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-acd57e32-41fe-4af7-b04c-66b6af42b601 tempest-VolumesActionsTest-1453472894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:16:06 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-acd57e32-41fe-4af7-b04c-66b6af42b601 tempest-VolumesActionsTest-1453472894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:16:06 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-acd57e32-41fe-4af7-b04c-66b6af42b601 tempest-VolumesActionsTest-1453472894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:16:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-acd57e32-41fe-4af7-b04c-66b6af42b601 tempest-VolumesActionsTest-1453472894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:16:06 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-acd57e32-41fe-4af7-b04c-66b6af42b601 tempest-VolumesActionsTest-1453472894 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:16:06 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-acd57e32-41fe-4af7-b04c-66b6af42b601 tempest-VolumesActionsTest-1453472894 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:16:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-acd57e32-41fe-4af7-b04c-66b6af42b601 tempest-VolumesActionsTest-1453472894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-60353589-cb4a-43b8-868f-de65b2ef76a5 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:06 devstack sudo[96035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-60353589-cb4a-43b8-868f-de65b2ef76a5 1073741824
Nov 04 12:16:06 devstack sudo[96035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:07 devstack sudo[96035]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-acd57e32-41fe-4af7-b04c-66b6af42b601 tempest-VolumesActionsTest-1453472894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-60353589-cb4a-43b8-868f-de65b2ef76a5 1073741824" returned: 0 in 0.582s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-acd57e32-41fe-4af7-b04c-66b6af42b601 tempest-VolumesActionsTest-1453472894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-60353589-cb4a-43b8-868f-de65b2ef76a5 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:07 devstack sudo[96041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-60353589-cb4a-43b8-868f-de65b2ef76a5
Nov 04 12:16:07 devstack sudo[96041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:08 devstack sudo[96041]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-acd57e32-41fe-4af7-b04c-66b6af42b601 tempest-VolumesActionsTest-1453472894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-60353589-cb4a-43b8-868f-de65b2ef76a5" returned: 0 in 0.352s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:08 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-acd57e32-41fe-4af7-b04c-66b6af42b601 tempest-VolumesActionsTest-1453472894 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:16:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-acd57e32-41fe-4af7-b04c-66b6af42b601 tempest-VolumesActionsTest-1453472894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:16:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-acd57e32-41fe-4af7-b04c-66b6af42b601 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c813313-b8ec-4ca3-82c3-d5e86b3ff134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60353589-cb4a-43b8-868f-de65b2ef76a5', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-acd57e32-41fe-4af7-b04c-66b6af42b601 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c79af0c1-cb6d-4729-8583-cbe1872e0c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:08 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-acd57e32-41fe-4af7-b04c-66b6af42b601 tempest-VolumesActionsTest-1453472894 None] Volume volume-60353589-cb4a-43b8-868f-de65b2ef76a5 (60353589-cb4a-43b8-868f-de65b2ef76a5): created successfully
Nov 04 12:16:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-acd57e32-41fe-4af7-b04c-66b6af42b601 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c79af0c1-cb6d-4729-8583-cbe1872e0c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-acd57e32-41fe-4af7-b04c-66b6af42b601 tempest-VolumesActionsTest-1453472894 None] Flow 'volume_create_manager' (efdc3275-fb66-478a-ae33-2f0a05865b1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:16:08 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-acd57e32-41fe-4af7-b04c-66b6af42b601 tempest-VolumesActionsTest-1453472894 None] Created volume successfully.
Nov 04 12:16:09 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a17b0ee-d480-42dc-8d1a-7d4925912abc tempest-VolumesCloneNegativeTest-1516112713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:16:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7a17b0ee-d480-42dc-8d1a-7d4925912abc tempest-VolumesCloneNegativeTest-1516112713 None] Flow 'volume_create_manager' (4cd266c3-74fb-4432-aa3d-8f62fe890f50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:16:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7a17b0ee-d480-42dc-8d1a-7d4925912abc tempest-VolumesCloneNegativeTest-1516112713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb6970ee-cee9-48cd-8b30-44e53bf01bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7a17b0ee-d480-42dc-8d1a-7d4925912abc tempest-VolumesCloneNegativeTest-1516112713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb6970ee-cee9-48cd-8b30-44e53bf01bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-438979965',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe309eab-e4ca-4897-a242-5506f97c5e12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ce63f0569a045898c46acbf324f4a9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:16:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:16:09Z,use_quota=True,user_id='30e546dcbfe34a5ebe51a9ec745d113e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7a17b0ee-d480-42dc-8d1a-7d4925912abc tempest-VolumesCloneNegativeTest-1516112713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aa5e81a-1d83-413d-a6f5-566c5afbdb07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7a17b0ee-d480-42dc-8d1a-7d4925912abc tempest-VolumesCloneNegativeTest-1516112713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3aa5e81a-1d83-413d-a6f5-566c5afbdb07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7a17b0ee-d480-42dc-8d1a-7d4925912abc tempest-VolumesCloneNegativeTest-1516112713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63369432-e164-4dff-a2da-2a738f0f0ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7a17b0ee-d480-42dc-8d1a-7d4925912abc tempest-VolumesCloneNegativeTest-1516112713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63369432-e164-4dff-a2da-2a738f0f0ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe309eab-e4ca-4897-a242-5506f97c5e12', 'volume_name': 'volume-fe309eab-e4ca-4897-a242-5506f97c5e12', 'volume_size': 2}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7a17b0ee-d480-42dc-8d1a-7d4925912abc tempest-VolumesCloneNegativeTest-1516112713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c38349f9-a04b-4e78-87aa-451bff88a046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7a17b0ee-d480-42dc-8d1a-7d4925912abc tempest-VolumesCloneNegativeTest-1516112713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c38349f9-a04b-4e78-87aa-451bff88a046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7a17b0ee-d480-42dc-8d1a-7d4925912abc tempest-VolumesCloneNegativeTest-1516112713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0d4f398-3bd8-4669-b28b-1e1d1cb2726f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:09 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-7a17b0ee-d480-42dc-8d1a-7d4925912abc tempest-VolumesCloneNegativeTest-1516112713 None] Volume fe309eab-e4ca-4897-a242-5506f97c5e12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe309eab-e4ca-4897-a242-5506f97c5e12', 'volume_size': 2}
Nov 04 12:16:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7a17b0ee-d480-42dc-8d1a-7d4925912abc tempest-VolumesCloneNegativeTest-1516112713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:16:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7a17b0ee-d480-42dc-8d1a-7d4925912abc tempest-VolumesCloneNegativeTest-1516112713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:16:09 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-7a17b0ee-d480-42dc-8d1a-7d4925912abc tempest-VolumesCloneNegativeTest-1516112713 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-438979965',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe309eab-e4ca-4897-a242-5506f97c5e12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ce63f0569a045898c46acbf324f4a9f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:16:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:16:09Z,use_quota=True,user_id='30e546dcbfe34a5ebe51a9ec745d113e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:16:09 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-7a17b0ee-d480-42dc-8d1a-7d4925912abc tempest-VolumesCloneNegativeTest-1516112713 None] Creating volume fe309eab-e4ca-4897-a242-5506f97c5e12 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:16:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7a17b0ee-d480-42dc-8d1a-7d4925912abc tempest-VolumesCloneNegativeTest-1516112713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:16:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7a17b0ee-d480-42dc-8d1a-7d4925912abc tempest-VolumesCloneNegativeTest-1516112713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:16:09 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-7a17b0ee-d480-42dc-8d1a-7d4925912abc tempest-VolumesCloneNegativeTest-1516112713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:16:09 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-7a17b0ee-d480-42dc-8d1a-7d4925912abc tempest-VolumesCloneNegativeTest-1516112713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:16:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7a17b0ee-d480-42dc-8d1a-7d4925912abc tempest-VolumesCloneNegativeTest-1516112713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:16:09 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-7a17b0ee-d480-42dc-8d1a-7d4925912abc tempest-VolumesCloneNegativeTest-1516112713 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:16:09 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-7a17b0ee-d480-42dc-8d1a-7d4925912abc tempest-VolumesCloneNegativeTest-1516112713 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:16:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7a17b0ee-d480-42dc-8d1a-7d4925912abc tempest-VolumesCloneNegativeTest-1516112713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fe309eab-e4ca-4897-a242-5506f97c5e12 2147483648 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:09 devstack sudo[96055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fe309eab-e4ca-4897-a242-5506f97c5e12 2147483648
Nov 04 12:16:09 devstack sudo[96055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:09 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3ce16d0f-665c-40c5-b665-61fe855f086d tempest-VolumesActionsTest-1453472894 None] Acquiring lock "cinder-60353589-cb4a-43b8-868f-de65b2ef76a5" by "attach_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:16:09 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3ce16d0f-665c-40c5-b665-61fe855f086d tempest-VolumesActionsTest-1453472894 None] Lock "cinder-60353589-cb4a-43b8-868f-de65b2ef76a5" acquired by "attach_volume" :: waited 0.055s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:16:09 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-3ce16d0f-665c-40c5-b665-61fe855f086d tempest-VolumesActionsTest-1453472894 None] Attaching volume 60353589-cb4a-43b8-868f-de65b2ef76a5 to instance 5cf8386b-35a6-4544-bff8-18616f94fcb9 at mountpoint /dev/vdb on host None.
Nov 04 12:16:09 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-3ce16d0f-665c-40c5-b665-61fe855f086d tempest-VolumesActionsTest-1453472894 None] Attach volume completed successfully.
Nov 04 12:16:09 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3ce16d0f-665c-40c5-b665-61fe855f086d tempest-VolumesActionsTest-1453472894 None] Lock "cinder-60353589-cb4a-43b8-868f-de65b2ef76a5" released by "attach_volume" :: held 0.267s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:16:10 devstack sudo[96055]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7a17b0ee-d480-42dc-8d1a-7d4925912abc tempest-VolumesCloneNegativeTest-1516112713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fe309eab-e4ca-4897-a242-5506f97c5e12 2147483648" returned: 0 in 1.164s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7a17b0ee-d480-42dc-8d1a-7d4925912abc tempest-VolumesCloneNegativeTest-1516112713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fe309eab-e4ca-4897-a242-5506f97c5e12 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:10 devstack sudo[96068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fe309eab-e4ca-4897-a242-5506f97c5e12
Nov 04 12:16:10 devstack sudo[96068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:11 devstack sudo[96068]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7a17b0ee-d480-42dc-8d1a-7d4925912abc tempest-VolumesCloneNegativeTest-1516112713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fe309eab-e4ca-4897-a242-5506f97c5e12" returned: 0 in 0.529s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:11 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-7a17b0ee-d480-42dc-8d1a-7d4925912abc tempest-VolumesCloneNegativeTest-1516112713 None] <== create_volume: return (1782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:16:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7a17b0ee-d480-42dc-8d1a-7d4925912abc tempest-VolumesCloneNegativeTest-1516112713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.791s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:16:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7a17b0ee-d480-42dc-8d1a-7d4925912abc tempest-VolumesCloneNegativeTest-1516112713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0d4f398-3bd8-4669-b28b-1e1d1cb2726f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe309eab-e4ca-4897-a242-5506f97c5e12', 'volume_size': 2}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7a17b0ee-d480-42dc-8d1a-7d4925912abc tempest-VolumesCloneNegativeTest-1516112713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eab93046-163a-4e2e-b554-225a83e9a164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:11 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-7a17b0ee-d480-42dc-8d1a-7d4925912abc tempest-VolumesCloneNegativeTest-1516112713 None] Volume volume-fe309eab-e4ca-4897-a242-5506f97c5e12 (fe309eab-e4ca-4897-a242-5506f97c5e12): created successfully
Nov 04 12:16:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7a17b0ee-d480-42dc-8d1a-7d4925912abc tempest-VolumesCloneNegativeTest-1516112713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eab93046-163a-4e2e-b554-225a83e9a164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7a17b0ee-d480-42dc-8d1a-7d4925912abc tempest-VolumesCloneNegativeTest-1516112713 None] Flow 'volume_create_manager' (4cd266c3-74fb-4432-aa3d-8f62fe890f50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:16:11 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-7a17b0ee-d480-42dc-8d1a-7d4925912abc tempest-VolumesCloneNegativeTest-1516112713 None] Created volume successfully.
Nov 04 12:16:11 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-fe943e6d-4ce5-4efd-9b29-fa3c74eda563 tempest-VolumesActionsTest-1934871858 None] Terminate volume connection completed successfully.
Nov 04 12:16:11 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fe943e6d-4ce5-4efd-9b29-fa3c74eda563 tempest-VolumesActionsTest-1934871858 None] Acquiring lock "cinder-60353589-cb4a-43b8-868f-de65b2ef76a5-detach_volume" by "detach_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:16:11 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fe943e6d-4ce5-4efd-9b29-fa3c74eda563 tempest-VolumesActionsTest-1934871858 None] Lock "cinder-60353589-cb4a-43b8-868f-de65b2ef76a5-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:16:11 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-fe943e6d-4ce5-4efd-9b29-fa3c74eda563 tempest-VolumesActionsTest-1934871858 None] Detaching volume 60353589-cb4a-43b8-868f-de65b2ef76a5 from instance 5cf8386b-35a6-4544-bff8-18616f94fcb9.
Nov 04 12:16:11 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-fe943e6d-4ce5-4efd-9b29-fa3c74eda563 tempest-VolumesActionsTest-1934871858 None] Detach volume completed successfully.
Nov 04 12:16:11 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fe943e6d-4ce5-4efd-9b29-fa3c74eda563 tempest-VolumesActionsTest-1934871858 None] Lock "cinder-60353589-cb4a-43b8-868f-de65b2ef76a5-detach_volume" released by "detach_volume" :: held 0.107s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:16:11 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f91bae4e-ecd7-411a-a073-25d01859d8ec tempest-VolumesActionsTest-1453472894 None] Acquiring lock "cinder-60353589-cb4a-43b8-868f-de65b2ef76a5-detach_volume" by "detach_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:16:11 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f91bae4e-ecd7-411a-a073-25d01859d8ec tempest-VolumesActionsTest-1453472894 None] Lock "cinder-60353589-cb4a-43b8-868f-de65b2ef76a5-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:16:11 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-f91bae4e-ecd7-411a-a073-25d01859d8ec tempest-VolumesActionsTest-1453472894 None] Volume detach called, but volume not attached.
Nov 04 12:16:11 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f91bae4e-ecd7-411a-a073-25d01859d8ec tempest-VolumesActionsTest-1453472894 None] Lock "cinder-60353589-cb4a-43b8-868f-de65b2ef76a5-detach_volume" released by "detach_volume" :: held 0.031s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:16:12 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-b8c933cb-452f-432e-ad44-26af0bbf3b38 tempest-VolumesActionsTest-1453472894 None] Acquiring lock "cinder-60353589-cb4a-43b8-868f-de65b2ef76a5-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:16:12 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-b8c933cb-452f-432e-ad44-26af0bbf3b38 tempest-VolumesActionsTest-1453472894 None] Lock "cinder-60353589-cb4a-43b8-868f-de65b2ef76a5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:16:12 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-b8c933cb-452f-432e-ad44-26af0bbf3b38 tempest-VolumesActionsTest-1453472894 None] Acquiring lock "cinder-quobyte-60353589-cb4a-43b8-868f-de65b2ef76a5" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:16:12 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-b8c933cb-452f-432e-ad44-26af0bbf3b38 tempest-VolumesActionsTest-1453472894 None] Lock "cinder-quobyte-60353589-cb4a-43b8-868f-de65b2ef76a5" acquired by "delete_volume" :: waited 0.033s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:16:12 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2bc1b9e-5f3e-4126-9d64-8b49c4930fb0]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:16:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b8c933cb-452f-432e-ad44-26af0bbf3b38 tempest-VolumesActionsTest-1453472894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-60353589-cb4a-43b8-868f-de65b2ef76a5 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:12 devstack sudo[96073]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-60353589-cb4a-43b8-868f-de65b2ef76a5
Nov 04 12:16:12 devstack sudo[96073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:12 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f03c726e-8c00-4435-b8d9-6378b6787dd5 tempest-VolumesCloneNegativeTest-1516112713 None] Acquiring lock "cinder-fe309eab-e4ca-4897-a242-5506f97c5e12-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:16:12 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f03c726e-8c00-4435-b8d9-6378b6787dd5 tempest-VolumesCloneNegativeTest-1516112713 None] Lock "cinder-fe309eab-e4ca-4897-a242-5506f97c5e12-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:16:12 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f03c726e-8c00-4435-b8d9-6378b6787dd5 tempest-VolumesCloneNegativeTest-1516112713 None] Acquiring lock "cinder-quobyte-fe309eab-e4ca-4897-a242-5506f97c5e12" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:16:12 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f03c726e-8c00-4435-b8d9-6378b6787dd5 tempest-VolumesCloneNegativeTest-1516112713 None] Lock "cinder-quobyte-fe309eab-e4ca-4897-a242-5506f97c5e12" acquired by "delete_volume" :: waited 0.036s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:16:12 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[69eaaadc-3971-433a-a57d-72f3c156ca28]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:16:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f03c726e-8c00-4435-b8d9-6378b6787dd5 tempest-VolumesCloneNegativeTest-1516112713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fe309eab-e4ca-4897-a242-5506f97c5e12 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:13 devstack sudo[96095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fe309eab-e4ca-4897-a242-5506f97c5e12
Nov 04 12:16:13 devstack sudo[96095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:13 devstack sudo[96073]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b8c933cb-452f-432e-ad44-26af0bbf3b38 tempest-VolumesActionsTest-1453472894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-60353589-cb4a-43b8-868f-de65b2ef76a5" returned: 0 in 1.073s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b8c933cb-452f-432e-ad44-26af0bbf3b38 tempest-VolumesActionsTest-1453472894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-60353589-cb4a-43b8-868f-de65b2ef76a5 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:13 devstack sudo[96135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-60353589-cb4a-43b8-868f-de65b2ef76a5
Nov 04 12:16:13 devstack sudo[96135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:13 devstack sudo[96095]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f03c726e-8c00-4435-b8d9-6378b6787dd5 tempest-VolumesCloneNegativeTest-1516112713 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fe309eab-e4ca-4897-a242-5506f97c5e12" returned: 0 in 0.697s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f03c726e-8c00-4435-b8d9-6378b6787dd5 tempest-VolumesCloneNegativeTest-1516112713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fe309eab-e4ca-4897-a242-5506f97c5e12 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:13 devstack sudo[96150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fe309eab-e4ca-4897-a242-5506f97c5e12
Nov 04 12:16:13 devstack sudo[96150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:13 devstack sudo[96135]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b8c933cb-452f-432e-ad44-26af0bbf3b38 tempest-VolumesActionsTest-1453472894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-60353589-cb4a-43b8-868f-de65b2ef76a5" returned: 0 in 0.582s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:13 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-b8c933cb-452f-432e-ad44-26af0bbf3b38 tempest-VolumesActionsTest-1453472894 None] Lock "cinder-quobyte-60353589-cb4a-43b8-868f-de65b2ef76a5" released by "delete_volume" :: held 1.768s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:16:14 devstack sudo[96150]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f03c726e-8c00-4435-b8d9-6378b6787dd5 tempest-VolumesCloneNegativeTest-1516112713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fe309eab-e4ca-4897-a242-5506f97c5e12" returned: 0 in 0.462s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:14 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f03c726e-8c00-4435-b8d9-6378b6787dd5 tempest-VolumesCloneNegativeTest-1516112713 None] Lock "cinder-quobyte-fe309eab-e4ca-4897-a242-5506f97c5e12" released by "delete_volume" :: held 1.254s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:16:14 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-b8c933cb-452f-432e-ad44-26af0bbf3b38 tempest-VolumesActionsTest-1453472894 None] Created reservations ['f0d3dbca-6f10-418c-ac77-c9da25dd5cfb', 'bb7a2763-9b2c-44a0-b128-d98626b8f879', '539ab31f-90c1-42a2-bf47-45bee2ee1405', '60f97c9f-be63-4854-9ef7-1d6804a9f48b'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:16:14 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-f03c726e-8c00-4435-b8d9-6378b6787dd5 tempest-VolumesCloneNegativeTest-1516112713 None] Created reservations ['5c3f36c7-d15c-4890-8fdc-3f14c5871670', '0dc17d2f-aa42-4fa3-a552-a14f8cf2d0c3', '0bdc7fb4-1835-4803-a9b5-5b9d9b820a7d', '8bcaafdb-61cf-43d8-bab9-7d919d36f67c'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:16:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b8c933cb-452f-432e-ad44-26af0bbf3b38 tempest-VolumesActionsTest-1453472894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:16:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b8c933cb-452f-432e-ad44-26af0bbf3b38 tempest-VolumesActionsTest-1453472894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:16:14 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-b8c933cb-452f-432e-ad44-26af0bbf3b38 tempest-VolumesActionsTest-1453472894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:16:14 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-b8c933cb-452f-432e-ad44-26af0bbf3b38 tempest-VolumesActionsTest-1453472894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:16:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b8c933cb-452f-432e-ad44-26af0bbf3b38 tempest-VolumesActionsTest-1453472894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:16:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b8c933cb-452f-432e-ad44-26af0bbf3b38 tempest-VolumesActionsTest-1453472894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:14 devstack sudo[96173]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:16:14 devstack sudo[96173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f03c726e-8c00-4435-b8d9-6378b6787dd5 tempest-VolumesCloneNegativeTest-1516112713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:16:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f03c726e-8c00-4435-b8d9-6378b6787dd5 tempest-VolumesCloneNegativeTest-1516112713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:16:14 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f03c726e-8c00-4435-b8d9-6378b6787dd5 tempest-VolumesCloneNegativeTest-1516112713 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:16:14 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f03c726e-8c00-4435-b8d9-6378b6787dd5 tempest-VolumesCloneNegativeTest-1516112713 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:16:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f03c726e-8c00-4435-b8d9-6378b6787dd5 tempest-VolumesCloneNegativeTest-1516112713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:16:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f03c726e-8c00-4435-b8d9-6378b6787dd5 tempest-VolumesCloneNegativeTest-1516112713 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:14 devstack sudo[96175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:16:14 devstack sudo[96175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:14 devstack sudo[96173]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b8c933cb-452f-432e-ad44-26af0bbf3b38 tempest-VolumesActionsTest-1453472894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.463s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:14 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-b8c933cb-452f-432e-ad44-26af0bbf3b38 tempest-VolumesActionsTest-1453472894 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:16:14 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-b8c933cb-452f-432e-ad44-26af0bbf3b38 tempest-VolumesActionsTest-1453472894 None] Deleted volume successfully.
Nov 04 12:16:14 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-b8c933cb-452f-432e-ad44-26af0bbf3b38 tempest-VolumesActionsTest-1453472894 None] Lock "cinder-60353589-cb4a-43b8-868f-de65b2ef76a5-delete_volume" released by "delete_volume" :: held 2.660s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:16:14 devstack sudo[96175]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f03c726e-8c00-4435-b8d9-6378b6787dd5 tempest-VolumesCloneNegativeTest-1516112713 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.446s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:14 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-f03c726e-8c00-4435-b8d9-6378b6787dd5 tempest-VolumesCloneNegativeTest-1516112713 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:16:14 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-f03c726e-8c00-4435-b8d9-6378b6787dd5 tempest-VolumesCloneNegativeTest-1516112713 None] Deleted volume successfully.
Nov 04 12:16:14 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f03c726e-8c00-4435-b8d9-6378b6787dd5 tempest-VolumesCloneNegativeTest-1516112713 None] Lock "cinder-fe309eab-e4ca-4897-a242-5506f97c5e12-delete_volume" released by "delete_volume" :: held 2.120s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:16:22 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-eba0c85e-6232-4a2e-87b6-601805b85549 tempest-VolumesNegativeTest-109160212 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:16:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-eba0c85e-6232-4a2e-87b6-601805b85549 tempest-VolumesNegativeTest-109160212 None] Flow 'volume_create_manager' (5201244c-436a-4f79-b2a3-7093c4417f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:16:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-eba0c85e-6232-4a2e-87b6-601805b85549 tempest-VolumesNegativeTest-109160212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b2f2d14-ec34-4906-8e91-72302e2866b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-eba0c85e-6232-4a2e-87b6-601805b85549 tempest-VolumesNegativeTest-109160212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b2f2d14-ec34-4906-8e91-72302e2866b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1817849038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3a96c28-c047-49bc-9fe5-106f18917d99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80f9272e12b148f0992dfba6e2017179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:16:23Z,use_quota=True,user_id='deefa9809bf44406b4fa718d032aa4b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-eba0c85e-6232-4a2e-87b6-601805b85549 tempest-VolumesNegativeTest-109160212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8564be7d-55cf-4205-b9f5-e5ac7af0e48f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-eba0c85e-6232-4a2e-87b6-601805b85549 tempest-VolumesNegativeTest-109160212 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8564be7d-55cf-4205-b9f5-e5ac7af0e48f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-eba0c85e-6232-4a2e-87b6-601805b85549 tempest-VolumesNegativeTest-109160212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91ca3555-8fbb-48ae-bf8e-8f09ce523bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-eba0c85e-6232-4a2e-87b6-601805b85549 tempest-VolumesNegativeTest-109160212 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91ca3555-8fbb-48ae-bf8e-8f09ce523bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3a96c28-c047-49bc-9fe5-106f18917d99', 'volume_name': 'volume-d3a96c28-c047-49bc-9fe5-106f18917d99', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-eba0c85e-6232-4a2e-87b6-601805b85549 tempest-VolumesNegativeTest-109160212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7d9b896-953f-437c-b118-0f835bad2368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-eba0c85e-6232-4a2e-87b6-601805b85549 tempest-VolumesNegativeTest-109160212 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7d9b896-953f-437c-b118-0f835bad2368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-eba0c85e-6232-4a2e-87b6-601805b85549 tempest-VolumesNegativeTest-109160212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b89f767-9e09-4f82-97b4-d025ca1c5794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:22 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-eba0c85e-6232-4a2e-87b6-601805b85549 tempest-VolumesNegativeTest-109160212 None] Volume d3a96c28-c047-49bc-9fe5-106f18917d99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3a96c28-c047-49bc-9fe5-106f18917d99', 'volume_size': 1}
Nov 04 12:16:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-eba0c85e-6232-4a2e-87b6-601805b85549 tempest-VolumesNegativeTest-109160212 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:16:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-eba0c85e-6232-4a2e-87b6-601805b85549 tempest-VolumesNegativeTest-109160212 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:16:22 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-eba0c85e-6232-4a2e-87b6-601805b85549 tempest-VolumesNegativeTest-109160212 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1817849038',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3a96c28-c047-49bc-9fe5-106f18917d99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='80f9272e12b148f0992dfba6e2017179',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:16:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:16:23Z,use_quota=True,user_id='deefa9809bf44406b4fa718d032aa4b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:16:22 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-eba0c85e-6232-4a2e-87b6-601805b85549 tempest-VolumesNegativeTest-109160212 None] Creating volume d3a96c28-c047-49bc-9fe5-106f18917d99 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:16:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-eba0c85e-6232-4a2e-87b6-601805b85549 tempest-VolumesNegativeTest-109160212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:16:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-eba0c85e-6232-4a2e-87b6-601805b85549 tempest-VolumesNegativeTest-109160212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:16:22 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-eba0c85e-6232-4a2e-87b6-601805b85549 tempest-VolumesNegativeTest-109160212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:16:22 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-eba0c85e-6232-4a2e-87b6-601805b85549 tempest-VolumesNegativeTest-109160212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:16:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-eba0c85e-6232-4a2e-87b6-601805b85549 tempest-VolumesNegativeTest-109160212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:16:22 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-eba0c85e-6232-4a2e-87b6-601805b85549 tempest-VolumesNegativeTest-109160212 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:16:22 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-eba0c85e-6232-4a2e-87b6-601805b85549 tempest-VolumesNegativeTest-109160212 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:16:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-eba0c85e-6232-4a2e-87b6-601805b85549 tempest-VolumesNegativeTest-109160212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d3a96c28-c047-49bc-9fe5-106f18917d99 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:22 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0935a61-7257-4a53-b77b-f67bf4478c69 tempest-VolumesActionsTest-1453472894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:16:22 devstack sudo[96230]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d3a96c28-c047-49bc-9fe5-106f18917d99 1073741824
Nov 04 12:16:22 devstack sudo[96230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c0935a61-7257-4a53-b77b-f67bf4478c69 tempest-VolumesActionsTest-1453472894 None] Flow 'volume_create_manager' (9a8ed9a0-9b33-4841-a34c-cf54da79aa32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:16:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c0935a61-7257-4a53-b77b-f67bf4478c69 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3be64252-09ce-494a-806f-47fc5902cf31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c0935a61-7257-4a53-b77b-f67bf4478c69 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3be64252-09ce-494a-806f-47fc5902cf31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1474000052',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32db9f6b-14a6-4c22-85d6-a27eee0915cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee013ffa34794b8c98cfceccde6a0ae7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:16:23Z,use_quota=True,user_id='260254844b1949b4a0eaafcd6028debb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c0935a61-7257-4a53-b77b-f67bf4478c69 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfb3c4ce-66d3-4f7b-bfe1-c918bb4a72ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c0935a61-7257-4a53-b77b-f67bf4478c69 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfb3c4ce-66d3-4f7b-bfe1-c918bb4a72ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c0935a61-7257-4a53-b77b-f67bf4478c69 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74cb2498-62ae-4e17-90a8-cb4ebf1cf8ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c0935a61-7257-4a53-b77b-f67bf4478c69 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74cb2498-62ae-4e17-90a8-cb4ebf1cf8ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32db9f6b-14a6-4c22-85d6-a27eee0915cc', 'volume_name': 'volume-32db9f6b-14a6-4c22-85d6-a27eee0915cc', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c0935a61-7257-4a53-b77b-f67bf4478c69 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1895d1d1-6001-4e8c-af0e-28d39ab60493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c0935a61-7257-4a53-b77b-f67bf4478c69 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1895d1d1-6001-4e8c-af0e-28d39ab60493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c0935a61-7257-4a53-b77b-f67bf4478c69 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (003e64c7-e932-4259-a289-1ca29fdbe9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:22 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-c0935a61-7257-4a53-b77b-f67bf4478c69 tempest-VolumesActionsTest-1453472894 None] Volume 32db9f6b-14a6-4c22-85d6-a27eee0915cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32db9f6b-14a6-4c22-85d6-a27eee0915cc', 'volume_size': 1}
Nov 04 12:16:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c0935a61-7257-4a53-b77b-f67bf4478c69 tempest-VolumesActionsTest-1453472894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:16:23 devstack sudo[96230]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-eba0c85e-6232-4a2e-87b6-601805b85549 tempest-VolumesNegativeTest-109160212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d3a96c28-c047-49bc-9fe5-106f18917d99 1073741824" returned: 0 in 1.156s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-eba0c85e-6232-4a2e-87b6-601805b85549 tempest-VolumesNegativeTest-109160212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d3a96c28-c047-49bc-9fe5-106f18917d99 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:24 devstack sudo[96292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d3a96c28-c047-49bc-9fe5-106f18917d99
Nov 04 12:16:24 devstack sudo[96292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:24 devstack sudo[96292]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-eba0c85e-6232-4a2e-87b6-601805b85549 tempest-VolumesNegativeTest-109160212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d3a96c28-c047-49bc-9fe5-106f18917d99" returned: 0 in 0.522s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:24 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-eba0c85e-6232-4a2e-87b6-601805b85549 tempest-VolumesNegativeTest-109160212 None] <== create_volume: return (1770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:16:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-eba0c85e-6232-4a2e-87b6-601805b85549 tempest-VolumesNegativeTest-109160212 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.773s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:16:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c0935a61-7257-4a53-b77b-f67bf4478c69 tempest-VolumesActionsTest-1453472894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.585s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:16:24 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c0935a61-7257-4a53-b77b-f67bf4478c69 tempest-VolumesActionsTest-1453472894 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:16:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1474000052',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32db9f6b-14a6-4c22-85d6-a27eee0915cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee013ffa34794b8c98cfceccde6a0ae7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:16:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:16:23Z,use_quota=True,user_id='260254844b1949b4a0eaafcd6028debb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:16:24 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-c0935a61-7257-4a53-b77b-f67bf4478c69 tempest-VolumesActionsTest-1453472894 None] Creating volume 32db9f6b-14a6-4c22-85d6-a27eee0915cc {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:16:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c0935a61-7257-4a53-b77b-f67bf4478c69 tempest-VolumesActionsTest-1453472894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:16:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c0935a61-7257-4a53-b77b-f67bf4478c69 tempest-VolumesActionsTest-1453472894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:16:24 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c0935a61-7257-4a53-b77b-f67bf4478c69 tempest-VolumesActionsTest-1453472894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:16:24 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c0935a61-7257-4a53-b77b-f67bf4478c69 tempest-VolumesActionsTest-1453472894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:16:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c0935a61-7257-4a53-b77b-f67bf4478c69 tempest-VolumesActionsTest-1453472894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:16:24 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c0935a61-7257-4a53-b77b-f67bf4478c69 tempest-VolumesActionsTest-1453472894 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:16:24 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-c0935a61-7257-4a53-b77b-f67bf4478c69 tempest-VolumesActionsTest-1453472894 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:16:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c0935a61-7257-4a53-b77b-f67bf4478c69 tempest-VolumesActionsTest-1453472894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-32db9f6b-14a6-4c22-85d6-a27eee0915cc 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:24 devstack sudo[96303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-32db9f6b-14a6-4c22-85d6-a27eee0915cc 1073741824
Nov 04 12:16:24 devstack sudo[96303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:24 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-eba0c85e-6232-4a2e-87b6-601805b85549 tempest-VolumesNegativeTest-109160212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b89f767-9e09-4f82-97b4-d025ca1c5794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3a96c28-c047-49bc-9fe5-106f18917d99', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:24 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-eba0c85e-6232-4a2e-87b6-601805b85549 tempest-VolumesNegativeTest-109160212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01b3cc70-7663-4452-a0fb-70b64a7b4cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:24 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-eba0c85e-6232-4a2e-87b6-601805b85549 tempest-VolumesNegativeTest-109160212 None] Volume volume-d3a96c28-c047-49bc-9fe5-106f18917d99 (d3a96c28-c047-49bc-9fe5-106f18917d99): created successfully
Nov 04 12:16:24 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-eba0c85e-6232-4a2e-87b6-601805b85549 tempest-VolumesNegativeTest-109160212 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01b3cc70-7663-4452-a0fb-70b64a7b4cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:24 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-eba0c85e-6232-4a2e-87b6-601805b85549 tempest-VolumesNegativeTest-109160212 None] Flow 'volume_create_manager' (5201244c-436a-4f79-b2a3-7093c4417f82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:16:24 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-eba0c85e-6232-4a2e-87b6-601805b85549 tempest-VolumesNegativeTest-109160212 None] Created volume successfully.
Nov 04 12:16:25 devstack sudo[96303]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c0935a61-7257-4a53-b77b-f67bf4478c69 tempest-VolumesActionsTest-1453472894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-32db9f6b-14a6-4c22-85d6-a27eee0915cc 1073741824" returned: 0 in 0.754s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c0935a61-7257-4a53-b77b-f67bf4478c69 tempest-VolumesActionsTest-1453472894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-32db9f6b-14a6-4c22-85d6-a27eee0915cc {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:25 devstack sudo[96313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-32db9f6b-14a6-4c22-85d6-a27eee0915cc
Nov 04 12:16:25 devstack sudo[96313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:25 devstack sudo[96313]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c0935a61-7257-4a53-b77b-f67bf4478c69 tempest-VolumesActionsTest-1453472894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-32db9f6b-14a6-4c22-85d6-a27eee0915cc" returned: 0 in 0.542s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:25 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c0935a61-7257-4a53-b77b-f67bf4478c69 tempest-VolumesActionsTest-1453472894 None] <== create_volume: return (1368ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:16:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c0935a61-7257-4a53-b77b-f67bf4478c69 tempest-VolumesActionsTest-1453472894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.372s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:16:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c0935a61-7257-4a53-b77b-f67bf4478c69 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (003e64c7-e932-4259-a289-1ca29fdbe9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32db9f6b-14a6-4c22-85d6-a27eee0915cc', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c0935a61-7257-4a53-b77b-f67bf4478c69 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbf7ee51-f222-4ea5-b507-2b3d2d06e9f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:25 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-c0935a61-7257-4a53-b77b-f67bf4478c69 tempest-VolumesActionsTest-1453472894 None] Volume volume-32db9f6b-14a6-4c22-85d6-a27eee0915cc (32db9f6b-14a6-4c22-85d6-a27eee0915cc): created successfully
Nov 04 12:16:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c0935a61-7257-4a53-b77b-f67bf4478c69 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbf7ee51-f222-4ea5-b507-2b3d2d06e9f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c0935a61-7257-4a53-b77b-f67bf4478c69 tempest-VolumesActionsTest-1453472894 None] Flow 'volume_create_manager' (9a8ed9a0-9b33-4841-a34c-cf54da79aa32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:16:25 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-c0935a61-7257-4a53-b77b-f67bf4478c69 tempest-VolumesActionsTest-1453472894 None] Created volume successfully.
Nov 04 12:16:27 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-691d115f-f02e-430b-9ba8-bde9118e148e tempest-VolumesActionsTest-1934871858 None] Acquiring lock "cinder-32db9f6b-14a6-4c22-85d6-a27eee0915cc-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:16:27 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-691d115f-f02e-430b-9ba8-bde9118e148e tempest-VolumesActionsTest-1934871858 None] Lock "cinder-32db9f6b-14a6-4c22-85d6-a27eee0915cc-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:16:27 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-691d115f-f02e-430b-9ba8-bde9118e148e tempest-VolumesActionsTest-1934871858 None] Acquiring lock "cinder-quobyte-32db9f6b-14a6-4c22-85d6-a27eee0915cc" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:16:27 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-691d115f-f02e-430b-9ba8-bde9118e148e tempest-VolumesActionsTest-1934871858 None] Lock "cinder-quobyte-32db9f6b-14a6-4c22-85d6-a27eee0915cc" acquired by "delete_volume" :: waited 0.025s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:16:27 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19b9bd6-b496-4f2e-b520-ac908e5e60fe]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:16:27 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-691d115f-f02e-430b-9ba8-bde9118e148e tempest-VolumesActionsTest-1934871858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-32db9f6b-14a6-4c22-85d6-a27eee0915cc {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:27 devstack sudo[96320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-32db9f6b-14a6-4c22-85d6-a27eee0915cc
Nov 04 12:16:27 devstack sudo[96320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:28 devstack sudo[96320]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-691d115f-f02e-430b-9ba8-bde9118e148e tempest-VolumesActionsTest-1934871858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-32db9f6b-14a6-4c22-85d6-a27eee0915cc" returned: 0 in 0.773s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-691d115f-f02e-430b-9ba8-bde9118e148e tempest-VolumesActionsTest-1934871858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-32db9f6b-14a6-4c22-85d6-a27eee0915cc {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:28 devstack sudo[96341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-32db9f6b-14a6-4c22-85d6-a27eee0915cc
Nov 04 12:16:28 devstack sudo[96341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:28 devstack sudo[96341]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-691d115f-f02e-430b-9ba8-bde9118e148e tempest-VolumesActionsTest-1934871858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-32db9f6b-14a6-4c22-85d6-a27eee0915cc" returned: 0 in 0.537s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:28 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-691d115f-f02e-430b-9ba8-bde9118e148e tempest-VolumesActionsTest-1934871858 None] Lock "cinder-quobyte-32db9f6b-14a6-4c22-85d6-a27eee0915cc" released by "delete_volume" :: held 1.411s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:16:29 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-691d115f-f02e-430b-9ba8-bde9118e148e tempest-VolumesActionsTest-1934871858 None] Created reservations ['dc594935-0b55-4ce9-bcf2-5be8b28f1169', '1b4b916b-f6d8-4459-b39a-0efb9c539548', 'de4160cc-dd9f-4b87-bd38-4997154b57b2', '3502277c-36aa-48c7-b3bb-3729f37d602b'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:16:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-691d115f-f02e-430b-9ba8-bde9118e148e tempest-VolumesActionsTest-1934871858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:16:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-691d115f-f02e-430b-9ba8-bde9118e148e tempest-VolumesActionsTest-1934871858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:16:29 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-691d115f-f02e-430b-9ba8-bde9118e148e tempest-VolumesActionsTest-1934871858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:16:29 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-691d115f-f02e-430b-9ba8-bde9118e148e tempest-VolumesActionsTest-1934871858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:16:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-691d115f-f02e-430b-9ba8-bde9118e148e tempest-VolumesActionsTest-1934871858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:16:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-691d115f-f02e-430b-9ba8-bde9118e148e tempest-VolumesActionsTest-1934871858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:29 devstack sudo[96360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:16:29 devstack sudo[96360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:29 devstack sudo[96360]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-691d115f-f02e-430b-9ba8-bde9118e148e tempest-VolumesActionsTest-1934871858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.645s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:29 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-691d115f-f02e-430b-9ba8-bde9118e148e tempest-VolumesActionsTest-1934871858 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:16:29 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-691d115f-f02e-430b-9ba8-bde9118e148e tempest-VolumesActionsTest-1934871858 None] Deleted volume successfully.
Nov 04 12:16:29 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=47,cinder:UPDATE=61,cinder:INSERT=12,cinder:DELETE=5 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:16:30 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-691d115f-f02e-430b-9ba8-bde9118e148e tempest-VolumesActionsTest-1934871858 None] Lock "cinder-32db9f6b-14a6-4c22-85d6-a27eee0915cc-delete_volume" released by "delete_volume" :: held 2.610s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:16:30 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-14d3dc35-f214-4cf4-9619-70233c44afdf tempest-VolumesActionsTest-1453472894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:16:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-14d3dc35-f214-4cf4-9619-70233c44afdf tempest-VolumesActionsTest-1453472894 None] Flow 'volume_create_manager' (89ee9b31-d571-44f0-a913-39f86ca96c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:16:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-14d3dc35-f214-4cf4-9619-70233c44afdf tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbdecd66-5c86-445a-bb1e-d78f2b3771cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-14d3dc35-f214-4cf4-9619-70233c44afdf tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbdecd66-5c86-445a-bb1e-d78f2b3771cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-555513703',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7911fc1-997c-46f2-bedc-ac60fe18ca8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee013ffa34794b8c98cfceccde6a0ae7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:16:31Z,use_quota=True,user_id='260254844b1949b4a0eaafcd6028debb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-14d3dc35-f214-4cf4-9619-70233c44afdf tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c83a50d6-cef0-4e6f-b2c2-1e1273231280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-14d3dc35-f214-4cf4-9619-70233c44afdf tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c83a50d6-cef0-4e6f-b2c2-1e1273231280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-14d3dc35-f214-4cf4-9619-70233c44afdf tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5a3d4f8-2727-4a8d-b5e3-7101052320e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-14d3dc35-f214-4cf4-9619-70233c44afdf tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5a3d4f8-2727-4a8d-b5e3-7101052320e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7911fc1-997c-46f2-bedc-ac60fe18ca8c', 'volume_name': 'volume-e7911fc1-997c-46f2-bedc-ac60fe18ca8c', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-14d3dc35-f214-4cf4-9619-70233c44afdf tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04003bca-e37f-4a5a-a69b-80897c6bac79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-14d3dc35-f214-4cf4-9619-70233c44afdf tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04003bca-e37f-4a5a-a69b-80897c6bac79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-14d3dc35-f214-4cf4-9619-70233c44afdf tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (074be254-6028-4b32-8de8-341ef32762c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:30 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-14d3dc35-f214-4cf4-9619-70233c44afdf tempest-VolumesActionsTest-1453472894 None] Volume e7911fc1-997c-46f2-bedc-ac60fe18ca8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7911fc1-997c-46f2-bedc-ac60fe18ca8c', 'volume_size': 1}
Nov 04 12:16:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-14d3dc35-f214-4cf4-9619-70233c44afdf tempest-VolumesActionsTest-1453472894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:16:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-14d3dc35-f214-4cf4-9619-70233c44afdf tempest-VolumesActionsTest-1453472894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:16:30 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-14d3dc35-f214-4cf4-9619-70233c44afdf tempest-VolumesActionsTest-1453472894 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:16:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-555513703',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7911fc1-997c-46f2-bedc-ac60fe18ca8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee013ffa34794b8c98cfceccde6a0ae7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:16:31Z,use_quota=True,user_id='260254844b1949b4a0eaafcd6028debb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:16:30 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-14d3dc35-f214-4cf4-9619-70233c44afdf tempest-VolumesActionsTest-1453472894 None] Creating volume e7911fc1-997c-46f2-bedc-ac60fe18ca8c {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:16:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-14d3dc35-f214-4cf4-9619-70233c44afdf tempest-VolumesActionsTest-1453472894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:16:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-14d3dc35-f214-4cf4-9619-70233c44afdf tempest-VolumesActionsTest-1453472894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:16:30 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-14d3dc35-f214-4cf4-9619-70233c44afdf tempest-VolumesActionsTest-1453472894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:16:30 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-14d3dc35-f214-4cf4-9619-70233c44afdf tempest-VolumesActionsTest-1453472894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:16:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-14d3dc35-f214-4cf4-9619-70233c44afdf tempest-VolumesActionsTest-1453472894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:16:30 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-14d3dc35-f214-4cf4-9619-70233c44afdf tempest-VolumesActionsTest-1453472894 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:16:30 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-14d3dc35-f214-4cf4-9619-70233c44afdf tempest-VolumesActionsTest-1453472894 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:16:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-14d3dc35-f214-4cf4-9619-70233c44afdf tempest-VolumesActionsTest-1453472894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e7911fc1-997c-46f2-bedc-ac60fe18ca8c 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:31 devstack sudo[96402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e7911fc1-997c-46f2-bedc-ac60fe18ca8c 1073741824
Nov 04 12:16:31 devstack sudo[96402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:31 devstack sudo[96402]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-14d3dc35-f214-4cf4-9619-70233c44afdf tempest-VolumesActionsTest-1453472894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e7911fc1-997c-46f2-bedc-ac60fe18ca8c 1073741824" returned: 0 in 0.973s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-14d3dc35-f214-4cf4-9619-70233c44afdf tempest-VolumesActionsTest-1453472894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e7911fc1-997c-46f2-bedc-ac60fe18ca8c {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:32 devstack sudo[96413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e7911fc1-997c-46f2-bedc-ac60fe18ca8c
Nov 04 12:16:32 devstack sudo[96413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:32 devstack sudo[96413]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-14d3dc35-f214-4cf4-9619-70233c44afdf tempest-VolumesActionsTest-1453472894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e7911fc1-997c-46f2-bedc-ac60fe18ca8c" returned: 0 in 0.287s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:32 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-14d3dc35-f214-4cf4-9619-70233c44afdf tempest-VolumesActionsTest-1453472894 None] <== create_volume: return (1329ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:16:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-14d3dc35-f214-4cf4-9619-70233c44afdf tempest-VolumesActionsTest-1453472894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.333s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:16:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-14d3dc35-f214-4cf4-9619-70233c44afdf tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (074be254-6028-4b32-8de8-341ef32762c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7911fc1-997c-46f2-bedc-ac60fe18ca8c', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-14d3dc35-f214-4cf4-9619-70233c44afdf tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e149090f-a5be-48f2-8597-74cc2193b114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:32 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-14d3dc35-f214-4cf4-9619-70233c44afdf tempest-VolumesActionsTest-1453472894 None] Volume volume-e7911fc1-997c-46f2-bedc-ac60fe18ca8c (e7911fc1-997c-46f2-bedc-ac60fe18ca8c): created successfully
Nov 04 12:16:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-14d3dc35-f214-4cf4-9619-70233c44afdf tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e149090f-a5be-48f2-8597-74cc2193b114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-14d3dc35-f214-4cf4-9619-70233c44afdf tempest-VolumesActionsTest-1453472894 None] Flow 'volume_create_manager' (89ee9b31-d571-44f0-a913-39f86ca96c31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:16:32 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-14d3dc35-f214-4cf4-9619-70233c44afdf tempest-VolumesActionsTest-1453472894 None] Created volume successfully.
Nov 04 12:16:33 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-0161a1d6-555e-493a-9604-c52d89c931b6 tempest-VolumesActionsTest-1934871858 None] Acquiring lock "cinder-e7911fc1-997c-46f2-bedc-ac60fe18ca8c-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:16:33 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-0161a1d6-555e-493a-9604-c52d89c931b6 tempest-VolumesActionsTest-1934871858 None] Lock "cinder-e7911fc1-997c-46f2-bedc-ac60fe18ca8c-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:16:33 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-0161a1d6-555e-493a-9604-c52d89c931b6 tempest-VolumesActionsTest-1934871858 None] Acquiring lock "cinder-quobyte-e7911fc1-997c-46f2-bedc-ac60fe18ca8c" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:16:33 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-0161a1d6-555e-493a-9604-c52d89c931b6 tempest-VolumesActionsTest-1934871858 None] Lock "cinder-quobyte-e7911fc1-997c-46f2-bedc-ac60fe18ca8c" acquired by "delete_volume" :: waited 0.019s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:16:33 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[18752746-fdb2-4739-82e8-5fe7eb11a504]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:16:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0161a1d6-555e-493a-9604-c52d89c931b6 tempest-VolumesActionsTest-1934871858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e7911fc1-997c-46f2-bedc-ac60fe18ca8c {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:33 devstack sudo[96417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e7911fc1-997c-46f2-bedc-ac60fe18ca8c
Nov 04 12:16:33 devstack sudo[96417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:34 devstack sudo[96417]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0161a1d6-555e-493a-9604-c52d89c931b6 tempest-VolumesActionsTest-1934871858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e7911fc1-997c-46f2-bedc-ac60fe18ca8c" returned: 0 in 0.493s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0161a1d6-555e-493a-9604-c52d89c931b6 tempest-VolumesActionsTest-1934871858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e7911fc1-997c-46f2-bedc-ac60fe18ca8c {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:34 devstack sudo[96422]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e7911fc1-997c-46f2-bedc-ac60fe18ca8c
Nov 04 12:16:34 devstack sudo[96422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:34 devstack sudo[96422]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0161a1d6-555e-493a-9604-c52d89c931b6 tempest-VolumesActionsTest-1934871858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e7911fc1-997c-46f2-bedc-ac60fe18ca8c" returned: 0 in 0.605s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:34 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-0161a1d6-555e-493a-9604-c52d89c931b6 tempest-VolumesActionsTest-1934871858 None] Lock "cinder-quobyte-e7911fc1-997c-46f2-bedc-ac60fe18ca8c" released by "delete_volume" :: held 1.187s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:16:34 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-0161a1d6-555e-493a-9604-c52d89c931b6 tempest-VolumesActionsTest-1934871858 None] Created reservations ['c0e899dc-1ad9-4dd7-8292-bd21b108d945', 'fbd5ca49-7d1e-4819-a79b-f84b181f25d8', '38db9d62-0069-44a1-9cfb-2d5294859db0', '7d21bcc4-260e-4594-b41b-bdeec972f6db'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:16:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-0161a1d6-555e-493a-9604-c52d89c931b6 tempest-VolumesActionsTest-1934871858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:16:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-0161a1d6-555e-493a-9604-c52d89c931b6 tempest-VolumesActionsTest-1934871858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:16:35 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-0161a1d6-555e-493a-9604-c52d89c931b6 tempest-VolumesActionsTest-1934871858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:16:35 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-0161a1d6-555e-493a-9604-c52d89c931b6 tempest-VolumesActionsTest-1934871858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:16:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-0161a1d6-555e-493a-9604-c52d89c931b6 tempest-VolumesActionsTest-1934871858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:16:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0161a1d6-555e-493a-9604-c52d89c931b6 tempest-VolumesActionsTest-1934871858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:35 devstack sudo[96468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:16:35 devstack sudo[96468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:35 devstack sudo[96468]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0161a1d6-555e-493a-9604-c52d89c931b6 tempest-VolumesActionsTest-1934871858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.671s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:35 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-0161a1d6-555e-493a-9604-c52d89c931b6 tempest-VolumesActionsTest-1934871858 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:16:35 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-0161a1d6-555e-493a-9604-c52d89c931b6 tempest-VolumesActionsTest-1934871858 None] Deleted volume successfully.
Nov 04 12:16:36 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-0161a1d6-555e-493a-9604-c52d89c931b6 tempest-VolumesActionsTest-1934871858 None] Lock "cinder-e7911fc1-997c-46f2-bedc-ac60fe18ca8c-delete_volume" released by "delete_volume" :: held 2.582s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:16:37 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef83e8ac-b3a2-4cc1-9ecc-c6bb987676e8 tempest-VolumesActionsTest-1453472894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:16:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ef83e8ac-b3a2-4cc1-9ecc-c6bb987676e8 tempest-VolumesActionsTest-1453472894 None] Flow 'volume_create_manager' (ed886c8a-32a0-46ab-bc37-c2c19276eed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:16:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ef83e8ac-b3a2-4cc1-9ecc-c6bb987676e8 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc586235-e7d8-4ff6-9873-168016f4ba1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ef83e8ac-b3a2-4cc1-9ecc-c6bb987676e8 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc586235-e7d8-4ff6-9873-168016f4ba1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1992523547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bccaa69-2ad1-4505-bfc7-ea8c8d2e8f25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee013ffa34794b8c98cfceccde6a0ae7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:16:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:16:37Z,use_quota=True,user_id='260254844b1949b4a0eaafcd6028debb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ef83e8ac-b3a2-4cc1-9ecc-c6bb987676e8 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4562eddc-38d6-496f-b9b0-6eb199dff7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ef83e8ac-b3a2-4cc1-9ecc-c6bb987676e8 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4562eddc-38d6-496f-b9b0-6eb199dff7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ef83e8ac-b3a2-4cc1-9ecc-c6bb987676e8 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa5e127f-1bd8-44ca-9bbe-fd258bd8c7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ef83e8ac-b3a2-4cc1-9ecc-c6bb987676e8 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa5e127f-1bd8-44ca-9bbe-fd258bd8c7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bccaa69-2ad1-4505-bfc7-ea8c8d2e8f25', 'volume_name': 'volume-3bccaa69-2ad1-4505-bfc7-ea8c8d2e8f25', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ef83e8ac-b3a2-4cc1-9ecc-c6bb987676e8 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a246d897-2439-4c8c-ab21-ff581832ceb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ef83e8ac-b3a2-4cc1-9ecc-c6bb987676e8 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a246d897-2439-4c8c-ab21-ff581832ceb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ef83e8ac-b3a2-4cc1-9ecc-c6bb987676e8 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8386d5d5-8be0-47fb-9fc7-09143109528b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:37 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-ef83e8ac-b3a2-4cc1-9ecc-c6bb987676e8 tempest-VolumesActionsTest-1453472894 None] Volume 3bccaa69-2ad1-4505-bfc7-ea8c8d2e8f25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bccaa69-2ad1-4505-bfc7-ea8c8d2e8f25', 'volume_size': 1}
Nov 04 12:16:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ef83e8ac-b3a2-4cc1-9ecc-c6bb987676e8 tempest-VolumesActionsTest-1453472894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:16:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ef83e8ac-b3a2-4cc1-9ecc-c6bb987676e8 tempest-VolumesActionsTest-1453472894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:16:37 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ef83e8ac-b3a2-4cc1-9ecc-c6bb987676e8 tempest-VolumesActionsTest-1453472894 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:16:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1992523547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bccaa69-2ad1-4505-bfc7-ea8c8d2e8f25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee013ffa34794b8c98cfceccde6a0ae7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:16:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:16:37Z,use_quota=True,user_id='260254844b1949b4a0eaafcd6028debb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:16:37 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-ef83e8ac-b3a2-4cc1-9ecc-c6bb987676e8 tempest-VolumesActionsTest-1453472894 None] Creating volume 3bccaa69-2ad1-4505-bfc7-ea8c8d2e8f25 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:16:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ef83e8ac-b3a2-4cc1-9ecc-c6bb987676e8 tempest-VolumesActionsTest-1453472894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:16:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ef83e8ac-b3a2-4cc1-9ecc-c6bb987676e8 tempest-VolumesActionsTest-1453472894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:16:37 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ef83e8ac-b3a2-4cc1-9ecc-c6bb987676e8 tempest-VolumesActionsTest-1453472894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:16:37 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ef83e8ac-b3a2-4cc1-9ecc-c6bb987676e8 tempest-VolumesActionsTest-1453472894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:16:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ef83e8ac-b3a2-4cc1-9ecc-c6bb987676e8 tempest-VolumesActionsTest-1453472894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:16:37 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ef83e8ac-b3a2-4cc1-9ecc-c6bb987676e8 tempest-VolumesActionsTest-1453472894 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:16:37 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-ef83e8ac-b3a2-4cc1-9ecc-c6bb987676e8 tempest-VolumesActionsTest-1453472894 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:16:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ef83e8ac-b3a2-4cc1-9ecc-c6bb987676e8 tempest-VolumesActionsTest-1453472894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3bccaa69-2ad1-4505-bfc7-ea8c8d2e8f25 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:37 devstack sudo[96497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3bccaa69-2ad1-4505-bfc7-ea8c8d2e8f25 1073741824
Nov 04 12:16:37 devstack sudo[96497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:38 devstack sudo[96497]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ef83e8ac-b3a2-4cc1-9ecc-c6bb987676e8 tempest-VolumesActionsTest-1453472894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3bccaa69-2ad1-4505-bfc7-ea8c8d2e8f25 1073741824" returned: 0 in 0.548s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ef83e8ac-b3a2-4cc1-9ecc-c6bb987676e8 tempest-VolumesActionsTest-1453472894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3bccaa69-2ad1-4505-bfc7-ea8c8d2e8f25 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:38 devstack sudo[96503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3bccaa69-2ad1-4505-bfc7-ea8c8d2e8f25
Nov 04 12:16:38 devstack sudo[96503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:38 devstack sudo[96503]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ef83e8ac-b3a2-4cc1-9ecc-c6bb987676e8 tempest-VolumesActionsTest-1453472894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3bccaa69-2ad1-4505-bfc7-ea8c8d2e8f25" returned: 0 in 0.314s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:38 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ef83e8ac-b3a2-4cc1-9ecc-c6bb987676e8 tempest-VolumesActionsTest-1453472894 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:16:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ef83e8ac-b3a2-4cc1-9ecc-c6bb987676e8 tempest-VolumesActionsTest-1453472894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:16:38 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ef83e8ac-b3a2-4cc1-9ecc-c6bb987676e8 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8386d5d5-8be0-47fb-9fc7-09143109528b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bccaa69-2ad1-4505-bfc7-ea8c8d2e8f25', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:38 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ef83e8ac-b3a2-4cc1-9ecc-c6bb987676e8 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a1bb072-0e75-4399-979f-8c5c42c0e233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:38 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-ef83e8ac-b3a2-4cc1-9ecc-c6bb987676e8 tempest-VolumesActionsTest-1453472894 None] Volume volume-3bccaa69-2ad1-4505-bfc7-ea8c8d2e8f25 (3bccaa69-2ad1-4505-bfc7-ea8c8d2e8f25): created successfully
Nov 04 12:16:38 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ef83e8ac-b3a2-4cc1-9ecc-c6bb987676e8 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a1bb072-0e75-4399-979f-8c5c42c0e233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:38 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ef83e8ac-b3a2-4cc1-9ecc-c6bb987676e8 tempest-VolumesActionsTest-1453472894 None] Flow 'volume_create_manager' (ed886c8a-32a0-46ab-bc37-c2c19276eed5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:16:38 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-ef83e8ac-b3a2-4cc1-9ecc-c6bb987676e8 tempest-VolumesActionsTest-1453472894 None] Created volume successfully.
Nov 04 12:16:39 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-db6fc2cf-a40d-4ae2-824b-0e857f2cbfb2 tempest-VolumesActionsTest-1934871858 None] Acquiring lock "cinder-3bccaa69-2ad1-4505-bfc7-ea8c8d2e8f25-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:16:39 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-db6fc2cf-a40d-4ae2-824b-0e857f2cbfb2 tempest-VolumesActionsTest-1934871858 None] Lock "cinder-3bccaa69-2ad1-4505-bfc7-ea8c8d2e8f25-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:16:39 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-db6fc2cf-a40d-4ae2-824b-0e857f2cbfb2 tempest-VolumesActionsTest-1934871858 None] Acquiring lock "cinder-quobyte-3bccaa69-2ad1-4505-bfc7-ea8c8d2e8f25" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:16:39 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-db6fc2cf-a40d-4ae2-824b-0e857f2cbfb2 tempest-VolumesActionsTest-1934871858 None] Lock "cinder-quobyte-3bccaa69-2ad1-4505-bfc7-ea8c8d2e8f25" acquired by "delete_volume" :: waited 0.015s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:16:39 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e775389-2a16-4aec-a713-af1a9462e8aa]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:16:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-db6fc2cf-a40d-4ae2-824b-0e857f2cbfb2 tempest-VolumesActionsTest-1934871858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3bccaa69-2ad1-4505-bfc7-ea8c8d2e8f25 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:40 devstack sudo[96555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3bccaa69-2ad1-4505-bfc7-ea8c8d2e8f25
Nov 04 12:16:40 devstack sudo[96555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:40 devstack sudo[96555]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-db6fc2cf-a40d-4ae2-824b-0e857f2cbfb2 tempest-VolumesActionsTest-1934871858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3bccaa69-2ad1-4505-bfc7-ea8c8d2e8f25" returned: 0 in 0.388s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-db6fc2cf-a40d-4ae2-824b-0e857f2cbfb2 tempest-VolumesActionsTest-1934871858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3bccaa69-2ad1-4505-bfc7-ea8c8d2e8f25 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:40 devstack sudo[96561]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3bccaa69-2ad1-4505-bfc7-ea8c8d2e8f25
Nov 04 12:16:40 devstack sudo[96561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:40 devstack sudo[96561]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-db6fc2cf-a40d-4ae2-824b-0e857f2cbfb2 tempest-VolumesActionsTest-1934871858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3bccaa69-2ad1-4505-bfc7-ea8c8d2e8f25" returned: 0 in 0.282s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:40 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-db6fc2cf-a40d-4ae2-824b-0e857f2cbfb2 tempest-VolumesActionsTest-1934871858 None] Lock "cinder-quobyte-3bccaa69-2ad1-4505-bfc7-ea8c8d2e8f25" released by "delete_volume" :: held 0.721s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:16:40 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-db6fc2cf-a40d-4ae2-824b-0e857f2cbfb2 tempest-VolumesActionsTest-1934871858 None] Created reservations ['1d2a9597-e213-4da6-98b6-2c183f881583', '13faf502-b5fa-4f77-a76d-2806c7c2456f', 'bdad2853-f2bf-4e3c-8d5e-058099929cb1', '759bc35d-4b54-45dd-84db-652dc6eefa07'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:16:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-db6fc2cf-a40d-4ae2-824b-0e857f2cbfb2 tempest-VolumesActionsTest-1934871858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:16:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-db6fc2cf-a40d-4ae2-824b-0e857f2cbfb2 tempest-VolumesActionsTest-1934871858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:16:40 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-db6fc2cf-a40d-4ae2-824b-0e857f2cbfb2 tempest-VolumesActionsTest-1934871858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:16:40 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-db6fc2cf-a40d-4ae2-824b-0e857f2cbfb2 tempest-VolumesActionsTest-1934871858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:16:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-db6fc2cf-a40d-4ae2-824b-0e857f2cbfb2 tempest-VolumesActionsTest-1934871858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:16:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-db6fc2cf-a40d-4ae2-824b-0e857f2cbfb2 tempest-VolumesActionsTest-1934871858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:40 devstack sudo[96581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:16:40 devstack sudo[96581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:41 devstack sudo[96581]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-db6fc2cf-a40d-4ae2-824b-0e857f2cbfb2 tempest-VolumesActionsTest-1934871858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.311s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:41 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-db6fc2cf-a40d-4ae2-824b-0e857f2cbfb2 tempest-VolumesActionsTest-1934871858 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:16:41 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-db6fc2cf-a40d-4ae2-824b-0e857f2cbfb2 tempest-VolumesActionsTest-1934871858 None] Deleted volume successfully.
Nov 04 12:16:41 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-db6fc2cf-a40d-4ae2-824b-0e857f2cbfb2 tempest-VolumesActionsTest-1934871858 None] Lock "cinder-3bccaa69-2ad1-4505-bfc7-ea8c8d2e8f25-delete_volume" released by "delete_volume" :: held 1.324s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:16:41 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-05ed0115-fbc2-4021-a747-c63bb55d8ee4 tempest-VolumesActionsTest-1453472894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:16:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-05ed0115-fbc2-4021-a747-c63bb55d8ee4 tempest-VolumesActionsTest-1453472894 None] Flow 'volume_create_manager' (4dd8329d-da88-4bb1-aa94-ec84fec0f8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:16:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-05ed0115-fbc2-4021-a747-c63bb55d8ee4 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86e520ad-c287-44da-8336-dd2b014bc8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-05ed0115-fbc2-4021-a747-c63bb55d8ee4 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86e520ad-c287-44da-8336-dd2b014bc8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-19997165',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32f3ecd9-3998-44f9-84d9-33232d273acf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee013ffa34794b8c98cfceccde6a0ae7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:16:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:16:42Z,use_quota=True,user_id='260254844b1949b4a0eaafcd6028debb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-05ed0115-fbc2-4021-a747-c63bb55d8ee4 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41601031-5475-435f-9a4f-a09702a88579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-05ed0115-fbc2-4021-a747-c63bb55d8ee4 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41601031-5475-435f-9a4f-a09702a88579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-05ed0115-fbc2-4021-a747-c63bb55d8ee4 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (819382cb-e261-4f40-b073-7051d9733813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-05ed0115-fbc2-4021-a747-c63bb55d8ee4 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (819382cb-e261-4f40-b073-7051d9733813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32f3ecd9-3998-44f9-84d9-33232d273acf', 'volume_name': 'volume-32f3ecd9-3998-44f9-84d9-33232d273acf', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-05ed0115-fbc2-4021-a747-c63bb55d8ee4 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f56c8dc7-4820-42c4-9b92-d09748557886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-05ed0115-fbc2-4021-a747-c63bb55d8ee4 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f56c8dc7-4820-42c4-9b92-d09748557886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-05ed0115-fbc2-4021-a747-c63bb55d8ee4 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcb54e68-f450-420b-b1e8-fb4c8b03b6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:41 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-05ed0115-fbc2-4021-a747-c63bb55d8ee4 tempest-VolumesActionsTest-1453472894 None] Volume 32f3ecd9-3998-44f9-84d9-33232d273acf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32f3ecd9-3998-44f9-84d9-33232d273acf', 'volume_size': 1}
Nov 04 12:16:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-05ed0115-fbc2-4021-a747-c63bb55d8ee4 tempest-VolumesActionsTest-1453472894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:16:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-05ed0115-fbc2-4021-a747-c63bb55d8ee4 tempest-VolumesActionsTest-1453472894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:16:41 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-05ed0115-fbc2-4021-a747-c63bb55d8ee4 tempest-VolumesActionsTest-1453472894 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:16:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-19997165',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32f3ecd9-3998-44f9-84d9-33232d273acf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee013ffa34794b8c98cfceccde6a0ae7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:16:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:16:42Z,use_quota=True,user_id='260254844b1949b4a0eaafcd6028debb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:16:41 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-05ed0115-fbc2-4021-a747-c63bb55d8ee4 tempest-VolumesActionsTest-1453472894 None] Creating volume 32f3ecd9-3998-44f9-84d9-33232d273acf {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:16:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-05ed0115-fbc2-4021-a747-c63bb55d8ee4 tempest-VolumesActionsTest-1453472894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:16:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-05ed0115-fbc2-4021-a747-c63bb55d8ee4 tempest-VolumesActionsTest-1453472894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:16:41 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-05ed0115-fbc2-4021-a747-c63bb55d8ee4 tempest-VolumesActionsTest-1453472894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:16:41 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-05ed0115-fbc2-4021-a747-c63bb55d8ee4 tempest-VolumesActionsTest-1453472894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:16:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-05ed0115-fbc2-4021-a747-c63bb55d8ee4 tempest-VolumesActionsTest-1453472894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:16:41 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-05ed0115-fbc2-4021-a747-c63bb55d8ee4 tempest-VolumesActionsTest-1453472894 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:16:41 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-05ed0115-fbc2-4021-a747-c63bb55d8ee4 tempest-VolumesActionsTest-1453472894 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:16:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-05ed0115-fbc2-4021-a747-c63bb55d8ee4 tempest-VolumesActionsTest-1453472894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-32f3ecd9-3998-44f9-84d9-33232d273acf 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:42 devstack sudo[96609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-32f3ecd9-3998-44f9-84d9-33232d273acf 1073741824
Nov 04 12:16:42 devstack sudo[96609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:42 devstack sudo[96609]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-05ed0115-fbc2-4021-a747-c63bb55d8ee4 tempest-VolumesActionsTest-1453472894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-32f3ecd9-3998-44f9-84d9-33232d273acf 1073741824" returned: 0 in 0.587s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-05ed0115-fbc2-4021-a747-c63bb55d8ee4 tempest-VolumesActionsTest-1453472894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-32f3ecd9-3998-44f9-84d9-33232d273acf {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:42 devstack sudo[96616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-32f3ecd9-3998-44f9-84d9-33232d273acf
Nov 04 12:16:42 devstack sudo[96616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:42 devstack sudo[96616]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-05ed0115-fbc2-4021-a747-c63bb55d8ee4 tempest-VolumesActionsTest-1453472894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-32f3ecd9-3998-44f9-84d9-33232d273acf" returned: 0 in 0.296s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:42 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-05ed0115-fbc2-4021-a747-c63bb55d8ee4 tempest-VolumesActionsTest-1453472894 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:16:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-05ed0115-fbc2-4021-a747-c63bb55d8ee4 tempest-VolumesActionsTest-1453472894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:16:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-05ed0115-fbc2-4021-a747-c63bb55d8ee4 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcb54e68-f450-420b-b1e8-fb4c8b03b6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32f3ecd9-3998-44f9-84d9-33232d273acf', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-05ed0115-fbc2-4021-a747-c63bb55d8ee4 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f894d843-b17e-45bb-b060-35c945a8c45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:42 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-05ed0115-fbc2-4021-a747-c63bb55d8ee4 tempest-VolumesActionsTest-1453472894 None] Volume volume-32f3ecd9-3998-44f9-84d9-33232d273acf (32f3ecd9-3998-44f9-84d9-33232d273acf): created successfully
Nov 04 12:16:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-05ed0115-fbc2-4021-a747-c63bb55d8ee4 tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f894d843-b17e-45bb-b060-35c945a8c45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-05ed0115-fbc2-4021-a747-c63bb55d8ee4 tempest-VolumesActionsTest-1453472894 None] Flow 'volume_create_manager' (4dd8329d-da88-4bb1-aa94-ec84fec0f8a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:16:42 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-05ed0115-fbc2-4021-a747-c63bb55d8ee4 tempest-VolumesActionsTest-1453472894 None] Created volume successfully.
Nov 04 12:16:43 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d6ad08bf-ecdf-41f2-806a-6af614629fea tempest-VolumesActionsTest-1934871858 None] Acquiring lock "cinder-32f3ecd9-3998-44f9-84d9-33232d273acf-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:16:43 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d6ad08bf-ecdf-41f2-806a-6af614629fea tempest-VolumesActionsTest-1934871858 None] Lock "cinder-32f3ecd9-3998-44f9-84d9-33232d273acf-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:16:43 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d6ad08bf-ecdf-41f2-806a-6af614629fea tempest-VolumesActionsTest-1934871858 None] Acquiring lock "cinder-quobyte-32f3ecd9-3998-44f9-84d9-33232d273acf" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:16:44 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d6ad08bf-ecdf-41f2-806a-6af614629fea tempest-VolumesActionsTest-1934871858 None] Lock "cinder-quobyte-32f3ecd9-3998-44f9-84d9-33232d273acf" acquired by "delete_volume" :: waited 0.019s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:16:44 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[e608ea50-7453-4e0a-a74c-0f87e8ba9602]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:16:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d6ad08bf-ecdf-41f2-806a-6af614629fea tempest-VolumesActionsTest-1934871858 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-32f3ecd9-3998-44f9-84d9-33232d273acf {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:44 devstack sudo[96621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-32f3ecd9-3998-44f9-84d9-33232d273acf
Nov 04 12:16:44 devstack sudo[96621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:44 devstack sudo[96621]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d6ad08bf-ecdf-41f2-806a-6af614629fea tempest-VolumesActionsTest-1934871858 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-32f3ecd9-3998-44f9-84d9-33232d273acf" returned: 0 in 0.491s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d6ad08bf-ecdf-41f2-806a-6af614629fea tempest-VolumesActionsTest-1934871858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-32f3ecd9-3998-44f9-84d9-33232d273acf {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:44 devstack sudo[96626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-32f3ecd9-3998-44f9-84d9-33232d273acf
Nov 04 12:16:44 devstack sudo[96626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:44 devstack sudo[96626]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d6ad08bf-ecdf-41f2-806a-6af614629fea tempest-VolumesActionsTest-1934871858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-32f3ecd9-3998-44f9-84d9-33232d273acf" returned: 0 in 0.296s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:44 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d6ad08bf-ecdf-41f2-806a-6af614629fea tempest-VolumesActionsTest-1934871858 None] Lock "cinder-quobyte-32f3ecd9-3998-44f9-84d9-33232d273acf" released by "delete_volume" :: held 0.855s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:16:44 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-d6ad08bf-ecdf-41f2-806a-6af614629fea tempest-VolumesActionsTest-1934871858 None] Created reservations ['a50b4c49-3819-40a3-ad1f-e1480bd48911', '6cbe0ef3-476a-4d01-ac1d-efd9c6fa9614', 'b5a18fb6-f3a0-4baf-9bde-1987e6471c9e', '833c30c4-83cf-44ed-8af2-3770893ba1bd'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:16:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d6ad08bf-ecdf-41f2-806a-6af614629fea tempest-VolumesActionsTest-1934871858 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:16:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d6ad08bf-ecdf-41f2-806a-6af614629fea tempest-VolumesActionsTest-1934871858 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:16:45 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d6ad08bf-ecdf-41f2-806a-6af614629fea tempest-VolumesActionsTest-1934871858 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:16:45 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d6ad08bf-ecdf-41f2-806a-6af614629fea tempest-VolumesActionsTest-1934871858 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:16:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d6ad08bf-ecdf-41f2-806a-6af614629fea tempest-VolumesActionsTest-1934871858 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:16:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d6ad08bf-ecdf-41f2-806a-6af614629fea tempest-VolumesActionsTest-1934871858 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:45 devstack sudo[96629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:16:45 devstack sudo[96629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:45 devstack sudo[96629]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d6ad08bf-ecdf-41f2-806a-6af614629fea tempest-VolumesActionsTest-1934871858 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.286s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:45 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-d6ad08bf-ecdf-41f2-806a-6af614629fea tempest-VolumesActionsTest-1934871858 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:16:45 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-d6ad08bf-ecdf-41f2-806a-6af614629fea tempest-VolumesActionsTest-1934871858 None] Deleted volume successfully.
Nov 04 12:16:45 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d6ad08bf-ecdf-41f2-806a-6af614629fea tempest-VolumesActionsTest-1934871858 None] Lock "cinder-32f3ecd9-3998-44f9-84d9-33232d273acf-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:16:45 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc5a959c-e654-40a7-98df-2c789c31dedf tempest-VolumesActionsTest-1453472894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:16:45 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-cc5a959c-e654-40a7-98df-2c789c31dedf tempest-VolumesActionsTest-1453472894 None] Flow 'volume_create_manager' (52976f21-1df3-4a06-9f42-4792987ce416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:16:45 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-cc5a959c-e654-40a7-98df-2c789c31dedf tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cbd30ab-3268-429b-a86c-95ca397c5c9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:45 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-cc5a959c-e654-40a7-98df-2c789c31dedf tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cbd30ab-3268-429b-a86c-95ca397c5c9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-322182247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fb794fa-f4cc-4f7c-b651-838e8df76472,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee013ffa34794b8c98cfceccde6a0ae7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:16:46Z,use_quota=True,user_id='260254844b1949b4a0eaafcd6028debb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:45 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-cc5a959c-e654-40a7-98df-2c789c31dedf tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (982c44a4-9092-4283-95d6-e95a841cc0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:45 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-cc5a959c-e654-40a7-98df-2c789c31dedf tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (982c44a4-9092-4283-95d6-e95a841cc0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:45 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-cc5a959c-e654-40a7-98df-2c789c31dedf tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c468f4eb-1709-4a0f-94fa-6da0e3c7e81c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:45 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-cc5a959c-e654-40a7-98df-2c789c31dedf tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c468f4eb-1709-4a0f-94fa-6da0e3c7e81c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fb794fa-f4cc-4f7c-b651-838e8df76472', 'volume_name': 'volume-0fb794fa-f4cc-4f7c-b651-838e8df76472', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:45 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-cc5a959c-e654-40a7-98df-2c789c31dedf tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e7f91b0-f547-49cb-b6f0-c622fcf4e41c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:45 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-cc5a959c-e654-40a7-98df-2c789c31dedf tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e7f91b0-f547-49cb-b6f0-c622fcf4e41c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:45 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-cc5a959c-e654-40a7-98df-2c789c31dedf tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b393563-a473-432f-927c-439899fcecdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:45 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-cc5a959c-e654-40a7-98df-2c789c31dedf tempest-VolumesActionsTest-1453472894 None] Volume 0fb794fa-f4cc-4f7c-b651-838e8df76472: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fb794fa-f4cc-4f7c-b651-838e8df76472', 'volume_size': 1}
Nov 04 12:16:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-cc5a959c-e654-40a7-98df-2c789c31dedf tempest-VolumesActionsTest-1453472894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:16:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-cc5a959c-e654-40a7-98df-2c789c31dedf tempest-VolumesActionsTest-1453472894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:16:45 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-cc5a959c-e654-40a7-98df-2c789c31dedf tempest-VolumesActionsTest-1453472894 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:16:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-322182247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fb794fa-f4cc-4f7c-b651-838e8df76472,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee013ffa34794b8c98cfceccde6a0ae7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:16:46Z,use_quota=True,user_id='260254844b1949b4a0eaafcd6028debb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:16:45 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-cc5a959c-e654-40a7-98df-2c789c31dedf tempest-VolumesActionsTest-1453472894 None] Creating volume 0fb794fa-f4cc-4f7c-b651-838e8df76472 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:16:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-cc5a959c-e654-40a7-98df-2c789c31dedf tempest-VolumesActionsTest-1453472894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:16:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-cc5a959c-e654-40a7-98df-2c789c31dedf tempest-VolumesActionsTest-1453472894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:16:45 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-cc5a959c-e654-40a7-98df-2c789c31dedf tempest-VolumesActionsTest-1453472894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:16:45 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-cc5a959c-e654-40a7-98df-2c789c31dedf tempest-VolumesActionsTest-1453472894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:16:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-cc5a959c-e654-40a7-98df-2c789c31dedf tempest-VolumesActionsTest-1453472894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:16:45 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-cc5a959c-e654-40a7-98df-2c789c31dedf tempest-VolumesActionsTest-1453472894 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:16:45 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-cc5a959c-e654-40a7-98df-2c789c31dedf tempest-VolumesActionsTest-1453472894 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:16:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-cc5a959c-e654-40a7-98df-2c789c31dedf tempest-VolumesActionsTest-1453472894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0fb794fa-f4cc-4f7c-b651-838e8df76472 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:45 devstack sudo[96636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0fb794fa-f4cc-4f7c-b651-838e8df76472 1073741824
Nov 04 12:16:45 devstack sudo[96636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:45 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-1508e276-12fc-478f-8b43-88a8227f9203 req-6fca6a7a-90c6-41b4-91e0-25d58f7929ba tempest-AttachVolumeNegativeTest-1447430610 None] Terminate volume connection completed successfully.
Nov 04 12:16:45 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-1508e276-12fc-478f-8b43-88a8227f9203 req-6fca6a7a-90c6-41b4-91e0-25d58f7929ba tempest-AttachVolumeNegativeTest-1447430610 None] Deleting attachment f7327eae-8334-44db-98c6-7dfc1f699632. {{(pid=87169) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 12:16:46 devstack sudo[96636]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-cc5a959c-e654-40a7-98df-2c789c31dedf tempest-VolumesActionsTest-1453472894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0fb794fa-f4cc-4f7c-b651-838e8df76472 1073741824" returned: 0 in 0.586s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-cc5a959c-e654-40a7-98df-2c789c31dedf tempest-VolumesActionsTest-1453472894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0fb794fa-f4cc-4f7c-b651-838e8df76472 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:46 devstack sudo[96642]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0fb794fa-f4cc-4f7c-b651-838e8df76472
Nov 04 12:16:46 devstack sudo[96642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:46 devstack sudo[96642]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-cc5a959c-e654-40a7-98df-2c789c31dedf tempest-VolumesActionsTest-1453472894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0fb794fa-f4cc-4f7c-b651-838e8df76472" returned: 0 in 0.349s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:46 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-cc5a959c-e654-40a7-98df-2c789c31dedf tempest-VolumesActionsTest-1453472894 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:16:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-cc5a959c-e654-40a7-98df-2c789c31dedf tempest-VolumesActionsTest-1453472894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:16:46 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-cc5a959c-e654-40a7-98df-2c789c31dedf tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b393563-a473-432f-927c-439899fcecdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fb794fa-f4cc-4f7c-b651-838e8df76472', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:46 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-cc5a959c-e654-40a7-98df-2c789c31dedf tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (114794e5-d834-404e-96fc-d4d9a6a00422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:47 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-cc5a959c-e654-40a7-98df-2c789c31dedf tempest-VolumesActionsTest-1453472894 None] Volume volume-0fb794fa-f4cc-4f7c-b651-838e8df76472 (0fb794fa-f4cc-4f7c-b651-838e8df76472): created successfully
Nov 04 12:16:47 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-cc5a959c-e654-40a7-98df-2c789c31dedf tempest-VolumesActionsTest-1453472894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (114794e5-d834-404e-96fc-d4d9a6a00422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:47 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-cc5a959c-e654-40a7-98df-2c789c31dedf tempest-VolumesActionsTest-1453472894 None] Flow 'volume_create_manager' (52976f21-1df3-4a06-9f42-4792987ce416) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:16:47 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-cc5a959c-e654-40a7-98df-2c789c31dedf tempest-VolumesActionsTest-1453472894 None] Created volume successfully.
Nov 04 12:16:48 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e5d51707-8668-4610-a2e3-d92164a75bd9 tempest-VolumesActionsTest-1453472894 None] Acquiring lock "cinder-0fb794fa-f4cc-4f7c-b651-838e8df76472-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:16:48 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e5d51707-8668-4610-a2e3-d92164a75bd9 tempest-VolumesActionsTest-1453472894 None] Lock "cinder-0fb794fa-f4cc-4f7c-b651-838e8df76472-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:16:48 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e5d51707-8668-4610-a2e3-d92164a75bd9 tempest-VolumesActionsTest-1453472894 None] Acquiring lock "cinder-quobyte-0fb794fa-f4cc-4f7c-b651-838e8df76472" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:16:48 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e5d51707-8668-4610-a2e3-d92164a75bd9 tempest-VolumesActionsTest-1453472894 None] Lock "cinder-quobyte-0fb794fa-f4cc-4f7c-b651-838e8df76472" acquired by "delete_volume" :: waited 0.018s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:16:48 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[e298fe42-e983-4dc0-aac5-185212184860]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:16:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e5d51707-8668-4610-a2e3-d92164a75bd9 tempest-VolumesActionsTest-1453472894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0fb794fa-f4cc-4f7c-b651-838e8df76472 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:49 devstack sudo[96667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0fb794fa-f4cc-4f7c-b651-838e8df76472
Nov 04 12:16:49 devstack sudo[96667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:49 devstack sudo[96667]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e5d51707-8668-4610-a2e3-d92164a75bd9 tempest-VolumesActionsTest-1453472894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0fb794fa-f4cc-4f7c-b651-838e8df76472" returned: 0 in 0.452s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e5d51707-8668-4610-a2e3-d92164a75bd9 tempest-VolumesActionsTest-1453472894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0fb794fa-f4cc-4f7c-b651-838e8df76472 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:49 devstack sudo[96673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0fb794fa-f4cc-4f7c-b651-838e8df76472
Nov 04 12:16:49 devstack sudo[96673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:49 devstack sudo[96673]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e5d51707-8668-4610-a2e3-d92164a75bd9 tempest-VolumesActionsTest-1453472894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0fb794fa-f4cc-4f7c-b651-838e8df76472" returned: 0 in 0.320s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:49 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e5d51707-8668-4610-a2e3-d92164a75bd9 tempest-VolumesActionsTest-1453472894 None] Lock "cinder-quobyte-0fb794fa-f4cc-4f7c-b651-838e8df76472" released by "delete_volume" :: held 0.831s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:16:49 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:16:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:16:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:16:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:16:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:16:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:16:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:49 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-e5d51707-8668-4610-a2e3-d92164a75bd9 tempest-VolumesActionsTest-1453472894 None] Created reservations ['882c13cb-54cd-4852-8199-7dbdeef1700f', 'ddb0adf7-1720-4c71-97a1-54f960f9b7bc', 'd8083381-4383-4b50-a3a6-76414b8b58a1', 'f0150ce8-794f-4e66-af6f-23eb203828e3'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:16:49 devstack sudo[96678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:16:49 devstack sudo[96678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e5d51707-8668-4610-a2e3-d92164a75bd9 tempest-VolumesActionsTest-1453472894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:16:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e5d51707-8668-4610-a2e3-d92164a75bd9 tempest-VolumesActionsTest-1453472894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:16:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e5d51707-8668-4610-a2e3-d92164a75bd9 tempest-VolumesActionsTest-1453472894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:16:50 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e5d51707-8668-4610-a2e3-d92164a75bd9 tempest-VolumesActionsTest-1453472894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:16:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e5d51707-8668-4610-a2e3-d92164a75bd9 tempest-VolumesActionsTest-1453472894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:16:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e5d51707-8668-4610-a2e3-d92164a75bd9 tempest-VolumesActionsTest-1453472894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:50 devstack sudo[96680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:16:50 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:50 devstack sudo[96678]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.472s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:50 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:16:50 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager._thread_info {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:16:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread count: 28 {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 12:16:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread info: [<_MainThread(MainThread, started 137165867425920)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137165754678912)>, <Thread(Thread-3 (stat_writer), started daemon 137165754130752)>, <Thread(Rabbit-heartbeat, started daemon 137165752997504)>, <Thread(Thread-5 (_runner), started daemon 137165753227712)>, <Thread(Thread-7 (_runner), started daemon 137165751273856)>, <Thread(fd_logger, started daemon 137165755322048)>, <Thread(privsep_reader, started daemon 137165748896704)>, <Thread(tpool_thread_0, started daemon 137165742520000)>, <Thread(tpool_thread_1, started daemon 137165734127296)>, <Thread(tpool_thread_2, started daemon 137165725734592)>, <Thread(tpool_thread_3, started daemon 137165717341888)>, <Thread(tpool_thread_4, started daemon 137165708949184)>, <Thread(tpool_thread_5, started daemon 137165700556480)>, <Thread(tpool_thread_6, started daemon 137165692163776)>, <Thread(tpool_thread_7, started daemon 137165683771072)>, <Thread(tpool_thread_8, started daemon 137165675378368)>, <Thread(tpool_thread_9, started daemon 137165666985664)>, <Thread(tpool_thread_10, started daemon 137165658592960)>, <Thread(tpool_thread_11, started daemon 137165650183872)>, <Thread(tpool_thread_12, started daemon 137165641774784)>, <Thread(tpool_thread_13, started daemon 137165633365696)>, <Thread(tpool_thread_14, started daemon 137165624956608)>, <Thread(tpool_thread_15, started daemon 137165616547520)>, <Thread(tpool_thread_16, started daemon 137165608138432)>, <Thread(tpool_thread_17, started daemon 137165599729344)>, <Thread(tpool_thread_18, started daemon 137165591320256)>, <Thread(tpool_thread_19, started daemon 137165582911168)>] {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 12:16:50 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e5d51707-8668-4610-a2e3-d92164a75bd9 tempest-VolumesActionsTest-1453472894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.389s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:50 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-e5d51707-8668-4610-a2e3-d92164a75bd9 tempest-VolumesActionsTest-1453472894 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:16:50 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-e5d51707-8668-4610-a2e3-d92164a75bd9 tempest-VolumesActionsTest-1453472894 None] Deleted volume successfully.
Nov 04 12:16:50 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e5d51707-8668-4610-a2e3-d92164a75bd9 tempest-VolumesActionsTest-1453472894 None] Lock "cinder-0fb794fa-f4cc-4f7c-b651-838e8df76472-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:16:50 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0f365e8-a770-4d03-8ae4-6df6864e2458 tempest-AttachVolumeTestJSON-852332315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:16:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f0f365e8-a770-4d03-8ae4-6df6864e2458 tempest-AttachVolumeTestJSON-852332315 None] Flow 'volume_create_manager' (87a50761-385c-4cd5-b246-80e6604b07e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:16:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f0f365e8-a770-4d03-8ae4-6df6864e2458 tempest-AttachVolumeTestJSON-852332315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4a2516a-db3f-4b04-a38f-c707108e9753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f0f365e8-a770-4d03-8ae4-6df6864e2458 tempest-AttachVolumeTestJSON-852332315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4a2516a-db3f-4b04-a38f-c707108e9753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-216788953',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9633b41e-4d71-4c06-bd9d-e79fb7a416ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6848a83209f4bdd8542c9f37acedb7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:16:51Z,use_quota=True,user_id='e17ff439a08249cdb11b401f10815922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f0f365e8-a770-4d03-8ae4-6df6864e2458 tempest-AttachVolumeTestJSON-852332315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdc4404d-29c8-4b1b-b34b-dbc47f2336d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f0f365e8-a770-4d03-8ae4-6df6864e2458 tempest-AttachVolumeTestJSON-852332315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdc4404d-29c8-4b1b-b34b-dbc47f2336d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f0f365e8-a770-4d03-8ae4-6df6864e2458 tempest-AttachVolumeTestJSON-852332315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6540ef93-07c6-4eb9-835c-57d884095a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f0f365e8-a770-4d03-8ae4-6df6864e2458 tempest-AttachVolumeTestJSON-852332315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6540ef93-07c6-4eb9-835c-57d884095a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9633b41e-4d71-4c06-bd9d-e79fb7a416ee', 'volume_name': 'volume-9633b41e-4d71-4c06-bd9d-e79fb7a416ee', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f0f365e8-a770-4d03-8ae4-6df6864e2458 tempest-AttachVolumeTestJSON-852332315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6b52489-1d7a-4036-9b7b-19a49b4e9e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f0f365e8-a770-4d03-8ae4-6df6864e2458 tempest-AttachVolumeTestJSON-852332315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6b52489-1d7a-4036-9b7b-19a49b4e9e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f0f365e8-a770-4d03-8ae4-6df6864e2458 tempest-AttachVolumeTestJSON-852332315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eef4b624-30ae-421b-a938-ffda08395f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:50 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-f0f365e8-a770-4d03-8ae4-6df6864e2458 tempest-AttachVolumeTestJSON-852332315 None] Volume 9633b41e-4d71-4c06-bd9d-e79fb7a416ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9633b41e-4d71-4c06-bd9d-e79fb7a416ee', 'volume_size': 1}
Nov 04 12:16:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f0f365e8-a770-4d03-8ae4-6df6864e2458 tempest-AttachVolumeTestJSON-852332315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:16:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f0f365e8-a770-4d03-8ae4-6df6864e2458 tempest-AttachVolumeTestJSON-852332315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:16:50 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f0f365e8-a770-4d03-8ae4-6df6864e2458 tempest-AttachVolumeTestJSON-852332315 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:16:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-216788953',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9633b41e-4d71-4c06-bd9d-e79fb7a416ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6848a83209f4bdd8542c9f37acedb7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:16:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:16:51Z,use_quota=True,user_id='e17ff439a08249cdb11b401f10815922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:16:50 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-f0f365e8-a770-4d03-8ae4-6df6864e2458 tempest-AttachVolumeTestJSON-852332315 None] Creating volume 9633b41e-4d71-4c06-bd9d-e79fb7a416ee {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:16:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f0f365e8-a770-4d03-8ae4-6df6864e2458 tempest-AttachVolumeTestJSON-852332315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:16:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f0f365e8-a770-4d03-8ae4-6df6864e2458 tempest-AttachVolumeTestJSON-852332315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:16:50 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f0f365e8-a770-4d03-8ae4-6df6864e2458 tempest-AttachVolumeTestJSON-852332315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:16:50 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f0f365e8-a770-4d03-8ae4-6df6864e2458 tempest-AttachVolumeTestJSON-852332315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:16:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f0f365e8-a770-4d03-8ae4-6df6864e2458 tempest-AttachVolumeTestJSON-852332315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:16:50 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f0f365e8-a770-4d03-8ae4-6df6864e2458 tempest-AttachVolumeTestJSON-852332315 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:16:50 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-f0f365e8-a770-4d03-8ae4-6df6864e2458 tempest-AttachVolumeTestJSON-852332315 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:16:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f0f365e8-a770-4d03-8ae4-6df6864e2458 tempest-AttachVolumeTestJSON-852332315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9633b41e-4d71-4c06-bd9d-e79fb7a416ee 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:50 devstack sudo[96685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9633b41e-4d71-4c06-bd9d-e79fb7a416ee 1073741824
Nov 04 12:16:50 devstack sudo[96685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:51 devstack sudo[96685]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f0f365e8-a770-4d03-8ae4-6df6864e2458 tempest-AttachVolumeTestJSON-852332315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9633b41e-4d71-4c06-bd9d-e79fb7a416ee 1073741824" returned: 0 in 0.684s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f0f365e8-a770-4d03-8ae4-6df6864e2458 tempest-AttachVolumeTestJSON-852332315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9633b41e-4d71-4c06-bd9d-e79fb7a416ee {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:51 devstack sudo[96691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9633b41e-4d71-4c06-bd9d-e79fb7a416ee
Nov 04 12:16:51 devstack sudo[96691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:51 devstack sudo[96691]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f0f365e8-a770-4d03-8ae4-6df6864e2458 tempest-AttachVolumeTestJSON-852332315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9633b41e-4d71-4c06-bd9d-e79fb7a416ee" returned: 0 in 0.324s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:51 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f0f365e8-a770-4d03-8ae4-6df6864e2458 tempest-AttachVolumeTestJSON-852332315 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:16:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f0f365e8-a770-4d03-8ae4-6df6864e2458 tempest-AttachVolumeTestJSON-852332315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:16:51 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f0f365e8-a770-4d03-8ae4-6df6864e2458 tempest-AttachVolumeTestJSON-852332315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eef4b624-30ae-421b-a938-ffda08395f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9633b41e-4d71-4c06-bd9d-e79fb7a416ee', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:52 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f0f365e8-a770-4d03-8ae4-6df6864e2458 tempest-AttachVolumeTestJSON-852332315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d8f999b-61d6-4e85-b24e-7dabe2acd756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:52 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-f0f365e8-a770-4d03-8ae4-6df6864e2458 tempest-AttachVolumeTestJSON-852332315 None] Volume volume-9633b41e-4d71-4c06-bd9d-e79fb7a416ee (9633b41e-4d71-4c06-bd9d-e79fb7a416ee): created successfully
Nov 04 12:16:52 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f0f365e8-a770-4d03-8ae4-6df6864e2458 tempest-AttachVolumeTestJSON-852332315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d8f999b-61d6-4e85-b24e-7dabe2acd756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:52 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f0f365e8-a770-4d03-8ae4-6df6864e2458 tempest-AttachVolumeTestJSON-852332315 None] Flow 'volume_create_manager' (87a50761-385c-4cd5-b246-80e6604b07e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:16:52 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-f0f365e8-a770-4d03-8ae4-6df6864e2458 tempest-AttachVolumeTestJSON-852332315 None] Created volume successfully.
Nov 04 12:16:52 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c9b207e8-ab34-4d1f-8852-cc47638097c1 tempest-VolumesNegativeTest-109160212 None] Acquiring lock "cinder-d3a96c28-c047-49bc-9fe5-106f18917d99-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:16:52 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c9b207e8-ab34-4d1f-8852-cc47638097c1 tempest-VolumesNegativeTest-109160212 None] Lock "cinder-d3a96c28-c047-49bc-9fe5-106f18917d99-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:16:52 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c9b207e8-ab34-4d1f-8852-cc47638097c1 tempest-VolumesNegativeTest-109160212 None] Acquiring lock "cinder-quobyte-d3a96c28-c047-49bc-9fe5-106f18917d99" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:16:52 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c9b207e8-ab34-4d1f-8852-cc47638097c1 tempest-VolumesNegativeTest-109160212 None] Lock "cinder-quobyte-d3a96c28-c047-49bc-9fe5-106f18917d99" acquired by "delete_volume" :: waited 0.022s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:16:52 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae60468-0a5c-421d-99b6-d19f27b65045]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:16:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c9b207e8-ab34-4d1f-8852-cc47638097c1 tempest-VolumesNegativeTest-109160212 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d3a96c28-c047-49bc-9fe5-106f18917d99 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:52 devstack sudo[96694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d3a96c28-c047-49bc-9fe5-106f18917d99
Nov 04 12:16:52 devstack sudo[96694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:52 devstack sudo[96694]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c9b207e8-ab34-4d1f-8852-cc47638097c1 tempest-VolumesNegativeTest-109160212 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d3a96c28-c047-49bc-9fe5-106f18917d99" returned: 0 in 0.425s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c9b207e8-ab34-4d1f-8852-cc47638097c1 tempest-VolumesNegativeTest-109160212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d3a96c28-c047-49bc-9fe5-106f18917d99 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:52 devstack sudo[96700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d3a96c28-c047-49bc-9fe5-106f18917d99
Nov 04 12:16:52 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:52 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c9b207e8-ab34-4d1f-8852-cc47638097c1 tempest-VolumesNegativeTest-109160212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d3a96c28-c047-49bc-9fe5-106f18917d99" returned: 0 in 0.283s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:52 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c9b207e8-ab34-4d1f-8852-cc47638097c1 tempest-VolumesNegativeTest-109160212 None] Lock "cinder-quobyte-d3a96c28-c047-49bc-9fe5-106f18917d99" released by "delete_volume" :: held 0.759s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:16:52 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-c9b207e8-ab34-4d1f-8852-cc47638097c1 tempest-VolumesNegativeTest-109160212 None] Created reservations ['896a37eb-1b6b-4450-ba11-02e73474cc2d', '7f91e34e-12da-46ff-a1b4-dbebaede5918', 'e7a9f1c6-f361-4623-a185-bed474b18dea', '4984f3e9-6dc7-46b6-9584-27172de07c12'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:16:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c9b207e8-ab34-4d1f-8852-cc47638097c1 tempest-VolumesNegativeTest-109160212 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:16:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c9b207e8-ab34-4d1f-8852-cc47638097c1 tempest-VolumesNegativeTest-109160212 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:16:53 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c9b207e8-ab34-4d1f-8852-cc47638097c1 tempest-VolumesNegativeTest-109160212 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:16:53 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c9b207e8-ab34-4d1f-8852-cc47638097c1 tempest-VolumesNegativeTest-109160212 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:16:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c9b207e8-ab34-4d1f-8852-cc47638097c1 tempest-VolumesNegativeTest-109160212 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:16:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c9b207e8-ab34-4d1f-8852-cc47638097c1 tempest-VolumesNegativeTest-109160212 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:53 devstack sudo[96707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:16:53 devstack sudo[96707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:53 devstack sudo[96707]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c9b207e8-ab34-4d1f-8852-cc47638097c1 tempest-VolumesNegativeTest-109160212 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.361s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:53 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-c9b207e8-ab34-4d1f-8852-cc47638097c1 tempest-VolumesNegativeTest-109160212 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:16:53 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-c9b207e8-ab34-4d1f-8852-cc47638097c1 tempest-VolumesNegativeTest-109160212 None] Deleted volume successfully.
Nov 04 12:16:53 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c9b207e8-ab34-4d1f-8852-cc47638097c1 tempest-VolumesNegativeTest-109160212 None] Lock "cinder-d3a96c28-c047-49bc-9fe5-106f18917d99-delete_volume" released by "delete_volume" :: held 1.399s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:16:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-e6992bcf-524f-4e37-8f9d-676db9b38423 req-2481350d-8d6c-4140-935a-136eeb9ec079 tempest-AttachVolumeTestJSON-852332315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:16:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-e6992bcf-524f-4e37-8f9d-676db9b38423 req-2481350d-8d6c-4140-935a-136eeb9ec079 tempest-AttachVolumeTestJSON-852332315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:16:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-e6992bcf-524f-4e37-8f9d-676db9b38423 req-2481350d-8d6c-4140-935a-136eeb9ec079 tempest-AttachVolumeTestJSON-852332315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:16:53 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-e6992bcf-524f-4e37-8f9d-676db9b38423 req-2481350d-8d6c-4140-935a-136eeb9ec079 tempest-AttachVolumeTestJSON-852332315 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79', 'name': 'volume-9633b41e-4d71-4c06-bd9d-e79fb7a416ee', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e36177f4-b717-492b-a598-e48adcf3905b', 'enforce_multipath': True} {{(pid=87169) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 04 12:16:53 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-e6992bcf-524f-4e37-8f9d-676db9b38423 req-2481350d-8d6c-4140-935a-136eeb9ec079 tempest-AttachVolumeTestJSON-852332315 None] attachment_update completed successfully.
Nov 04 12:16:56 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c3747ff-7e56-44f2-8bf8-fc26c862fc38 tempest-AttachVolumeTestJSON-852332315 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:16:56 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8c3747ff-7e56-44f2-8bf8-fc26c862fc38 tempest-AttachVolumeTestJSON-852332315 None] Flow 'volume_create_manager' (75a09c40-7cfa-49da-b528-55161d7c0c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:16:56 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8c3747ff-7e56-44f2-8bf8-fc26c862fc38 tempest-AttachVolumeTestJSON-852332315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45fed398-f42a-4e7a-9e9d-25fa526a23f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:56 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8c3747ff-7e56-44f2-8bf8-fc26c862fc38 tempest-AttachVolumeTestJSON-852332315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45fed398-f42a-4e7a-9e9d-25fa526a23f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-453530311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b855e58-4c5f-49c9-a994-8fdc45661f5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6848a83209f4bdd8542c9f37acedb7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:16:57Z,use_quota=True,user_id='e17ff439a08249cdb11b401f10815922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:56 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8c3747ff-7e56-44f2-8bf8-fc26c862fc38 tempest-AttachVolumeTestJSON-852332315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3621a991-9802-4feb-ac03-00a9f6d535d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:56 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8c3747ff-7e56-44f2-8bf8-fc26c862fc38 tempest-AttachVolumeTestJSON-852332315 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3621a991-9802-4feb-ac03-00a9f6d535d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:56 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8c3747ff-7e56-44f2-8bf8-fc26c862fc38 tempest-AttachVolumeTestJSON-852332315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7feb1f6-4bf2-40f7-bf06-6577210f7a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:56 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8c3747ff-7e56-44f2-8bf8-fc26c862fc38 tempest-AttachVolumeTestJSON-852332315 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7feb1f6-4bf2-40f7-bf06-6577210f7a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b855e58-4c5f-49c9-a994-8fdc45661f5b', 'volume_name': 'volume-1b855e58-4c5f-49c9-a994-8fdc45661f5b', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:56 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8c3747ff-7e56-44f2-8bf8-fc26c862fc38 tempest-AttachVolumeTestJSON-852332315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (096c9c5e-b1ff-4338-b5da-3bb24ef53cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:56 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8c3747ff-7e56-44f2-8bf8-fc26c862fc38 tempest-AttachVolumeTestJSON-852332315 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (096c9c5e-b1ff-4338-b5da-3bb24ef53cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:56 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8c3747ff-7e56-44f2-8bf8-fc26c862fc38 tempest-AttachVolumeTestJSON-852332315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a40abf3e-8eac-48c7-8646-ab297a1fc102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:56 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-8c3747ff-7e56-44f2-8bf8-fc26c862fc38 tempest-AttachVolumeTestJSON-852332315 None] Volume 1b855e58-4c5f-49c9-a994-8fdc45661f5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b855e58-4c5f-49c9-a994-8fdc45661f5b', 'volume_size': 1}
Nov 04 12:16:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8c3747ff-7e56-44f2-8bf8-fc26c862fc38 tempest-AttachVolumeTestJSON-852332315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:16:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8c3747ff-7e56-44f2-8bf8-fc26c862fc38 tempest-AttachVolumeTestJSON-852332315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:16:56 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-8c3747ff-7e56-44f2-8bf8-fc26c862fc38 tempest-AttachVolumeTestJSON-852332315 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:16:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-453530311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b855e58-4c5f-49c9-a994-8fdc45661f5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6848a83209f4bdd8542c9f37acedb7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:16:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:16:57Z,use_quota=True,user_id='e17ff439a08249cdb11b401f10815922',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:16:56 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-8c3747ff-7e56-44f2-8bf8-fc26c862fc38 tempest-AttachVolumeTestJSON-852332315 None] Creating volume 1b855e58-4c5f-49c9-a994-8fdc45661f5b {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:16:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8c3747ff-7e56-44f2-8bf8-fc26c862fc38 tempest-AttachVolumeTestJSON-852332315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:16:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8c3747ff-7e56-44f2-8bf8-fc26c862fc38 tempest-AttachVolumeTestJSON-852332315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:16:56 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-8c3747ff-7e56-44f2-8bf8-fc26c862fc38 tempest-AttachVolumeTestJSON-852332315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:16:56 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-8c3747ff-7e56-44f2-8bf8-fc26c862fc38 tempest-AttachVolumeTestJSON-852332315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:16:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8c3747ff-7e56-44f2-8bf8-fc26c862fc38 tempest-AttachVolumeTestJSON-852332315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:16:56 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-8c3747ff-7e56-44f2-8bf8-fc26c862fc38 tempest-AttachVolumeTestJSON-852332315 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:16:56 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-8c3747ff-7e56-44f2-8bf8-fc26c862fc38 tempest-AttachVolumeTestJSON-852332315 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:16:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8c3747ff-7e56-44f2-8bf8-fc26c862fc38 tempest-AttachVolumeTestJSON-852332315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1b855e58-4c5f-49c9-a994-8fdc45661f5b 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:56 devstack sudo[97140]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1b855e58-4c5f-49c9-a994-8fdc45661f5b 1073741824
Nov 04 12:16:56 devstack sudo[97140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:57 devstack sudo[97140]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8c3747ff-7e56-44f2-8bf8-fc26c862fc38 tempest-AttachVolumeTestJSON-852332315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1b855e58-4c5f-49c9-a994-8fdc45661f5b 1073741824" returned: 0 in 0.693s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:57 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b0e110e-dbff-4055-9574-ba8c28cd9654 tempest-CreateVolumesFromImageTest-84867816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:16:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-4b0e110e-dbff-4055-9574-ba8c28cd9654 tempest-CreateVolumesFromImageTest-84867816 None] Flow 'volume_create_manager' (5db80360-f9aa-4249-b498-ba93c06c6c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:16:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-4b0e110e-dbff-4055-9574-ba8c28cd9654 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e7a4d20-9189-432d-9d44-ad91936994df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-4b0e110e-dbff-4055-9574-ba8c28cd9654 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e7a4d20-9189-432d-9d44-ad91936994df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-113315186',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97a1d3e7-2c6b-47cd-ad0c-b83b91c1a157,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0399c683598a4579aa980343a1232e05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:16:58Z,use_quota=True,user_id='7812a57a2bf8475aadd848e43ba9641a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-4b0e110e-dbff-4055-9574-ba8c28cd9654 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c4411a0-09fa-4b7d-a9fa-71f1e232738a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-4b0e110e-dbff-4055-9574-ba8c28cd9654 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c4411a0-09fa-4b7d-a9fa-71f1e232738a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-4b0e110e-dbff-4055-9574-ba8c28cd9654 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b26d28e-4b7a-4fda-8548-c2f564a32924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-4b0e110e-dbff-4055-9574-ba8c28cd9654 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b26d28e-4b7a-4fda-8548-c2f564a32924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97a1d3e7-2c6b-47cd-ad0c-b83b91c1a157', 'volume_name': 'volume-97a1d3e7-2c6b-47cd-ad0c-b83b91c1a157', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-4b0e110e-dbff-4055-9574-ba8c28cd9654 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c68ac50d-5710-4405-8570-0fac35b14824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-4b0e110e-dbff-4055-9574-ba8c28cd9654 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c68ac50d-5710-4405-8570-0fac35b14824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-4b0e110e-dbff-4055-9574-ba8c28cd9654 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (527b2ec6-850b-464d-8b86-bbc4dccc56d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:57 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-4b0e110e-dbff-4055-9574-ba8c28cd9654 tempest-CreateVolumesFromImageTest-84867816 None] Volume 97a1d3e7-2c6b-47cd-ad0c-b83b91c1a157: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97a1d3e7-2c6b-47cd-ad0c-b83b91c1a157', 'volume_size': 1}
Nov 04 12:16:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-4b0e110e-dbff-4055-9574-ba8c28cd9654 tempest-CreateVolumesFromImageTest-84867816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:16:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8c3747ff-7e56-44f2-8bf8-fc26c862fc38 tempest-AttachVolumeTestJSON-852332315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1b855e58-4c5f-49c9-a994-8fdc45661f5b {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:57 devstack sudo[97146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1b855e58-4c5f-49c9-a994-8fdc45661f5b
Nov 04 12:16:57 devstack sudo[97146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:58 devstack sudo[97146]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8c3747ff-7e56-44f2-8bf8-fc26c862fc38 tempest-AttachVolumeTestJSON-852332315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1b855e58-4c5f-49c9-a994-8fdc45661f5b" returned: 0 in 0.361s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:58 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-8c3747ff-7e56-44f2-8bf8-fc26c862fc38 tempest-AttachVolumeTestJSON-852332315 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:16:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8c3747ff-7e56-44f2-8bf8-fc26c862fc38 tempest-AttachVolumeTestJSON-852332315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:16:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-4b0e110e-dbff-4055-9574-ba8c28cd9654 tempest-CreateVolumesFromImageTest-84867816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.391s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:16:58 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-4b0e110e-dbff-4055-9574-ba8c28cd9654 tempest-CreateVolumesFromImageTest-84867816 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:16:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-113315186',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97a1d3e7-2c6b-47cd-ad0c-b83b91c1a157,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0399c683598a4579aa980343a1232e05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:16:58Z,use_quota=True,user_id='7812a57a2bf8475aadd848e43ba9641a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:16:58 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-4b0e110e-dbff-4055-9574-ba8c28cd9654 tempest-CreateVolumesFromImageTest-84867816 None] Creating volume 97a1d3e7-2c6b-47cd-ad0c-b83b91c1a157 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:16:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-4b0e110e-dbff-4055-9574-ba8c28cd9654 tempest-CreateVolumesFromImageTest-84867816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:16:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-4b0e110e-dbff-4055-9574-ba8c28cd9654 tempest-CreateVolumesFromImageTest-84867816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:16:58 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-4b0e110e-dbff-4055-9574-ba8c28cd9654 tempest-CreateVolumesFromImageTest-84867816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:16:58 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-4b0e110e-dbff-4055-9574-ba8c28cd9654 tempest-CreateVolumesFromImageTest-84867816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:16:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-4b0e110e-dbff-4055-9574-ba8c28cd9654 tempest-CreateVolumesFromImageTest-84867816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:16:58 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-4b0e110e-dbff-4055-9574-ba8c28cd9654 tempest-CreateVolumesFromImageTest-84867816 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:16:58 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-4b0e110e-dbff-4055-9574-ba8c28cd9654 tempest-CreateVolumesFromImageTest-84867816 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:16:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4b0e110e-dbff-4055-9574-ba8c28cd9654 tempest-CreateVolumesFromImageTest-84867816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-97a1d3e7-2c6b-47cd-ad0c-b83b91c1a157 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:58 devstack sudo[97150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-97a1d3e7-2c6b-47cd-ad0c-b83b91c1a157 1073741824
Nov 04 12:16:58 devstack sudo[97150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8c3747ff-7e56-44f2-8bf8-fc26c862fc38 tempest-AttachVolumeTestJSON-852332315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a40abf3e-8eac-48c7-8646-ab297a1fc102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b855e58-4c5f-49c9-a994-8fdc45661f5b', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8c3747ff-7e56-44f2-8bf8-fc26c862fc38 tempest-AttachVolumeTestJSON-852332315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b370d0d-e9df-4ef1-868a-a3496590ab5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:58 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-8c3747ff-7e56-44f2-8bf8-fc26c862fc38 tempest-AttachVolumeTestJSON-852332315 None] Volume volume-1b855e58-4c5f-49c9-a994-8fdc45661f5b (1b855e58-4c5f-49c9-a994-8fdc45661f5b): created successfully
Nov 04 12:16:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8c3747ff-7e56-44f2-8bf8-fc26c862fc38 tempest-AttachVolumeTestJSON-852332315 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b370d0d-e9df-4ef1-868a-a3496590ab5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8c3747ff-7e56-44f2-8bf8-fc26c862fc38 tempest-AttachVolumeTestJSON-852332315 None] Flow 'volume_create_manager' (75a09c40-7cfa-49da-b528-55161d7c0c08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:16:58 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-097b778d-bd48-4b82-8a97-21caff260133 tempest-CreateVolumesFromImageTest-84867816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:16:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-097b778d-bd48-4b82-8a97-21caff260133 tempest-CreateVolumesFromImageTest-84867816 None] Flow 'volume_create_manager' (e24694bb-2a32-4263-9b5e-1ba06149966c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:16:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-097b778d-bd48-4b82-8a97-21caff260133 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65181644-dd1a-411a-84f6-80dd657d31ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:58 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-8c3747ff-7e56-44f2-8bf8-fc26c862fc38 tempest-AttachVolumeTestJSON-852332315 None] Created volume successfully.
Nov 04 12:16:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-097b778d-bd48-4b82-8a97-21caff260133 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65181644-dd1a-411a-84f6-80dd657d31ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2055327303',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32d05024-8a17-4749-85ea-16b811e09949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0399c683598a4579aa980343a1232e05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:16:58Z,use_quota=True,user_id='7812a57a2bf8475aadd848e43ba9641a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-097b778d-bd48-4b82-8a97-21caff260133 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e0eb1ec-4e14-46f3-a587-ad2dc7dd565d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-097b778d-bd48-4b82-8a97-21caff260133 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e0eb1ec-4e14-46f3-a587-ad2dc7dd565d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-097b778d-bd48-4b82-8a97-21caff260133 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (badf077d-9341-4c7d-8cee-c4a542b378b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-097b778d-bd48-4b82-8a97-21caff260133 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (badf077d-9341-4c7d-8cee-c4a542b378b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32d05024-8a17-4749-85ea-16b811e09949', 'volume_name': 'volume-32d05024-8a17-4749-85ea-16b811e09949', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-097b778d-bd48-4b82-8a97-21caff260133 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e175f875-20c5-4bc0-bd05-a1d1238f8c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-097b778d-bd48-4b82-8a97-21caff260133 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e175f875-20c5-4bc0-bd05-a1d1238f8c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-097b778d-bd48-4b82-8a97-21caff260133 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ed4d5a9-4859-4a64-91b5-d61865ac1fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:58 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-097b778d-bd48-4b82-8a97-21caff260133 tempest-CreateVolumesFromImageTest-84867816 None] Volume 32d05024-8a17-4749-85ea-16b811e09949: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32d05024-8a17-4749-85ea-16b811e09949', 'volume_size': 1}
Nov 04 12:16:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-097b778d-bd48-4b82-8a97-21caff260133 tempest-CreateVolumesFromImageTest-84867816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:16:58 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2248d05-abfc-46db-9b4c-920cde7d7901 tempest-CreateVolumesFromImageTest-84867816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:16:59 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d2248d05-abfc-46db-9b4c-920cde7d7901 tempest-CreateVolumesFromImageTest-84867816 None] Flow 'volume_create_manager' (d5185b19-d6f9-41fa-b84c-8439f690ffa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:16:59 devstack sudo[97150]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:59 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d2248d05-abfc-46db-9b4c-920cde7d7901 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7b3fe3a-3ab8-41ab-955d-6316ffc504a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4b0e110e-dbff-4055-9574-ba8c28cd9654 tempest-CreateVolumesFromImageTest-84867816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-97a1d3e7-2c6b-47cd-ad0c-b83b91c1a157 1073741824" returned: 0 in 0.927s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:59 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d2248d05-abfc-46db-9b4c-920cde7d7901 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7b3fe3a-3ab8-41ab-955d-6316ffc504a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1740545222',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc6b1884-0425-4ab5-b327-1515abbe6f45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0399c683598a4579aa980343a1232e05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:16:59Z,use_quota=True,user_id='7812a57a2bf8475aadd848e43ba9641a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:59 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d2248d05-abfc-46db-9b4c-920cde7d7901 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89fda0a0-44cb-495d-b460-9ef5d32b2b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:59 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d2248d05-abfc-46db-9b4c-920cde7d7901 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89fda0a0-44cb-495d-b460-9ef5d32b2b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:59 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d2248d05-abfc-46db-9b4c-920cde7d7901 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db5c625d-ecf4-4919-8e90-cfc5ae8a8631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:59 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d2248d05-abfc-46db-9b4c-920cde7d7901 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db5c625d-ecf4-4919-8e90-cfc5ae8a8631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc6b1884-0425-4ab5-b327-1515abbe6f45', 'volume_name': 'volume-bc6b1884-0425-4ab5-b327-1515abbe6f45', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:59 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d2248d05-abfc-46db-9b4c-920cde7d7901 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8486788-ac61-4c19-8246-652c06e070b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:59 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d2248d05-abfc-46db-9b4c-920cde7d7901 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8486788-ac61-4c19-8246-652c06e070b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:16:59 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d2248d05-abfc-46db-9b4c-920cde7d7901 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f36af63-d1f8-4959-a45d-ddeb120c83ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:59 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-d2248d05-abfc-46db-9b4c-920cde7d7901 tempest-CreateVolumesFromImageTest-84867816 None] Volume bc6b1884-0425-4ab5-b327-1515abbe6f45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc6b1884-0425-4ab5-b327-1515abbe6f45', 'volume_size': 1}
Nov 04 12:16:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d2248d05-abfc-46db-9b4c-920cde7d7901 tempest-CreateVolumesFromImageTest-84867816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:16:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4b0e110e-dbff-4055-9574-ba8c28cd9654 tempest-CreateVolumesFromImageTest-84867816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-97a1d3e7-2c6b-47cd-ad0c-b83b91c1a157 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:59 devstack sudo[97175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-97a1d3e7-2c6b-47cd-ad0c-b83b91c1a157
Nov 04 12:16:59 devstack sudo[97175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:16:59 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec7685f7-2992-4dd4-aedc-164a958efd55 tempest-CreateVolumesFromImageTest-84867816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:16:59 devstack sudo[97175]: pam_unix(sudo:session): session closed for user root
Nov 04 12:16:59 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ec7685f7-2992-4dd4-aedc-164a958efd55 tempest-CreateVolumesFromImageTest-84867816 None] Flow 'volume_create_manager' (66d078ea-1990-4f2f-bdd0-74bc97125434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:16:59 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ec7685f7-2992-4dd4-aedc-164a958efd55 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df656828-7bb8-4a55-a3e3-10e36290d18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:16:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4b0e110e-dbff-4055-9574-ba8c28cd9654 tempest-CreateVolumesFromImageTest-84867816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-97a1d3e7-2c6b-47cd-ad0c-b83b91c1a157" returned: 0 in 0.627s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:16:59 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-4b0e110e-dbff-4055-9574-ba8c28cd9654 tempest-CreateVolumesFromImageTest-84867816 None] <== create_volume: return (1760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:16:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-4b0e110e-dbff-4055-9574-ba8c28cd9654 tempest-CreateVolumesFromImageTest-84867816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.766s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:16:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-097b778d-bd48-4b82-8a97-21caff260133 tempest-CreateVolumesFromImageTest-84867816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.414s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:16:59 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-097b778d-bd48-4b82-8a97-21caff260133 tempest-CreateVolumesFromImageTest-84867816 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2055327303',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32d05024-8a17-4749-85ea-16b811e09949,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0399c683598a4579aa980343a1232e05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:16:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:16:58Z,use_quota=True,user_id='7812a57a2bf8475aadd848e43ba9641a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:16:59 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-097b778d-bd48-4b82-8a97-21caff260133 tempest-CreateVolumesFromImageTest-84867816 None] Creating volume 32d05024-8a17-4749-85ea-16b811e09949 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:16:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-097b778d-bd48-4b82-8a97-21caff260133 tempest-CreateVolumesFromImageTest-84867816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:16:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-097b778d-bd48-4b82-8a97-21caff260133 tempest-CreateVolumesFromImageTest-84867816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:16:59 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-097b778d-bd48-4b82-8a97-21caff260133 tempest-CreateVolumesFromImageTest-84867816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:16:59 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-097b778d-bd48-4b82-8a97-21caff260133 tempest-CreateVolumesFromImageTest-84867816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:16:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-097b778d-bd48-4b82-8a97-21caff260133 tempest-CreateVolumesFromImageTest-84867816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:16:59 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-097b778d-bd48-4b82-8a97-21caff260133 tempest-CreateVolumesFromImageTest-84867816 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:16:59 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-097b778d-bd48-4b82-8a97-21caff260133 tempest-CreateVolumesFromImageTest-84867816 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:16:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-097b778d-bd48-4b82-8a97-21caff260133 tempest-CreateVolumesFromImageTest-84867816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-32d05024-8a17-4749-85ea-16b811e09949 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:16:59 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ec7685f7-2992-4dd4-aedc-164a958efd55 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df656828-7bb8-4a55-a3e3-10e36290d18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1214685208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5532428d-30b7-4aa1-9ead-294374d6bb4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0399c683598a4579aa980343a1232e05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:00Z,use_quota=True,user_id='7812a57a2bf8475aadd848e43ba9641a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:00 devstack sudo[97179]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-32d05024-8a17-4749-85ea-16b811e09949 1073741824
Nov 04 12:17:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ec7685f7-2992-4dd4-aedc-164a958efd55 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07538196-06d6-43f2-934d-5300d5bedd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:00 devstack sudo[97179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ec7685f7-2992-4dd4-aedc-164a958efd55 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07538196-06d6-43f2-934d-5300d5bedd94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ec7685f7-2992-4dd4-aedc-164a958efd55 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ee0bf95-9fb1-468e-a879-d3581c351ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ec7685f7-2992-4dd4-aedc-164a958efd55 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ee0bf95-9fb1-468e-a879-d3581c351ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5532428d-30b7-4aa1-9ead-294374d6bb4f', 'volume_name': 'volume-5532428d-30b7-4aa1-9ead-294374d6bb4f', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ec7685f7-2992-4dd4-aedc-164a958efd55 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9d3f8b8-49de-4423-aad3-98b3e109438e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ec7685f7-2992-4dd4-aedc-164a958efd55 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9d3f8b8-49de-4423-aad3-98b3e109438e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ec7685f7-2992-4dd4-aedc-164a958efd55 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8a71c04-fade-4c46-b69d-34438ee27128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:00 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-ec7685f7-2992-4dd4-aedc-164a958efd55 tempest-CreateVolumesFromImageTest-84867816 None] Volume 5532428d-30b7-4aa1-9ead-294374d6bb4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5532428d-30b7-4aa1-9ead-294374d6bb4f', 'volume_size': 1}
Nov 04 12:17:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ec7685f7-2992-4dd4-aedc-164a958efd55 tempest-CreateVolumesFromImageTest-84867816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:17:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-4b0e110e-dbff-4055-9574-ba8c28cd9654 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (527b2ec6-850b-464d-8b86-bbc4dccc56d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97a1d3e7-2c6b-47cd-ad0c-b83b91c1a157', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-4b0e110e-dbff-4055-9574-ba8c28cd9654 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99f4a35f-44af-4862-85fb-50378a77034d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:00 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-4b0e110e-dbff-4055-9574-ba8c28cd9654 tempest-CreateVolumesFromImageTest-84867816 None] Volume volume-97a1d3e7-2c6b-47cd-ad0c-b83b91c1a157 (97a1d3e7-2c6b-47cd-ad0c-b83b91c1a157): created successfully
Nov 04 12:17:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-4b0e110e-dbff-4055-9574-ba8c28cd9654 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99f4a35f-44af-4862-85fb-50378a77034d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-4b0e110e-dbff-4055-9574-ba8c28cd9654 tempest-CreateVolumesFromImageTest-84867816 None] Flow 'volume_create_manager' (5db80360-f9aa-4249-b498-ba93c06c6c7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:17:00 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-4b0e110e-dbff-4055-9574-ba8c28cd9654 tempest-CreateVolumesFromImageTest-84867816 None] Created volume successfully.
Nov 04 12:17:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-2b78e762-495e-4954-b45e-543b88f363c9 req-2fd74866-1a2a-42c9-adf3-9dac7c63bd98 tempest-AttachVolumeTestJSON-852332315 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:17:00 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-c799cbe9-77ed-4a13-90ad-1c8aba14e352 tempest-CreateVolumesFromImageTest-84867816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:17:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c799cbe9-77ed-4a13-90ad-1c8aba14e352 tempest-CreateVolumesFromImageTest-84867816 None] Flow 'volume_create_manager' (bc184955-773b-4ed3-ad6f-c0d10d9d0b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:17:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c799cbe9-77ed-4a13-90ad-1c8aba14e352 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95feace4-1c72-4f70-9cee-d6e3bb6231a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:00 devstack sudo[97179]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c799cbe9-77ed-4a13-90ad-1c8aba14e352 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95feace4-1c72-4f70-9cee-d6e3bb6231a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2098749407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebd80d28-b2de-433b-81d5-4a58be25f52f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0399c683598a4579aa980343a1232e05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:01Z,use_quota=True,user_id='7812a57a2bf8475aadd848e43ba9641a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c799cbe9-77ed-4a13-90ad-1c8aba14e352 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dcfa259-b3de-4a33-b7b6-acd86604dae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c799cbe9-77ed-4a13-90ad-1c8aba14e352 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dcfa259-b3de-4a33-b7b6-acd86604dae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c799cbe9-77ed-4a13-90ad-1c8aba14e352 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f370b6a-db42-4e6d-9a2b-b980cb8090db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c799cbe9-77ed-4a13-90ad-1c8aba14e352 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f370b6a-db42-4e6d-9a2b-b980cb8090db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebd80d28-b2de-433b-81d5-4a58be25f52f', 'volume_name': 'volume-ebd80d28-b2de-433b-81d5-4a58be25f52f', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c799cbe9-77ed-4a13-90ad-1c8aba14e352 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e7272cd-d841-439b-a970-914fa83d899f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c799cbe9-77ed-4a13-90ad-1c8aba14e352 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e7272cd-d841-439b-a970-914fa83d899f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c799cbe9-77ed-4a13-90ad-1c8aba14e352 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4db0312e-e04d-4f36-a917-188724cb4823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:00 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-c799cbe9-77ed-4a13-90ad-1c8aba14e352 tempest-CreateVolumesFromImageTest-84867816 None] Volume ebd80d28-b2de-433b-81d5-4a58be25f52f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebd80d28-b2de-433b-81d5-4a58be25f52f', 'volume_size': 1}
Nov 04 12:17:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c799cbe9-77ed-4a13-90ad-1c8aba14e352 tempest-CreateVolumesFromImageTest-84867816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:17:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-097b778d-bd48-4b82-8a97-21caff260133 tempest-CreateVolumesFromImageTest-84867816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-32d05024-8a17-4749-85ea-16b811e09949 1073741824" returned: 0 in 0.910s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-097b778d-bd48-4b82-8a97-21caff260133 tempest-CreateVolumesFromImageTest-84867816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-32d05024-8a17-4749-85ea-16b811e09949 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:00 devstack sudo[97203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-32d05024-8a17-4749-85ea-16b811e09949
Nov 04 12:17:00 devstack sudo[97203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:01 devstack sudo[97203]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-097b778d-bd48-4b82-8a97-21caff260133 tempest-CreateVolumesFromImageTest-84867816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-32d05024-8a17-4749-85ea-16b811e09949" returned: 0 in 0.309s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:01 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-097b778d-bd48-4b82-8a97-21caff260133 tempest-CreateVolumesFromImageTest-84867816 None] <== create_volume: return (1289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:17:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-097b778d-bd48-4b82-8a97-21caff260133 tempest-CreateVolumesFromImageTest-84867816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d2248d05-abfc-46db-9b4c-920cde7d7901 tempest-CreateVolumesFromImageTest-84867816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.979s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:17:01 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d2248d05-abfc-46db-9b4c-920cde7d7901 tempest-CreateVolumesFromImageTest-84867816 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1740545222',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc6b1884-0425-4ab5-b327-1515abbe6f45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0399c683598a4579aa980343a1232e05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:16:59Z,use_quota=True,user_id='7812a57a2bf8475aadd848e43ba9641a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:17:01 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-d2248d05-abfc-46db-9b4c-920cde7d7901 tempest-CreateVolumesFromImageTest-84867816 None] Creating volume bc6b1884-0425-4ab5-b327-1515abbe6f45 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:17:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d2248d05-abfc-46db-9b4c-920cde7d7901 tempest-CreateVolumesFromImageTest-84867816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:17:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d2248d05-abfc-46db-9b4c-920cde7d7901 tempest-CreateVolumesFromImageTest-84867816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:17:01 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d2248d05-abfc-46db-9b4c-920cde7d7901 tempest-CreateVolumesFromImageTest-84867816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:17:01 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d2248d05-abfc-46db-9b4c-920cde7d7901 tempest-CreateVolumesFromImageTest-84867816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:17:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d2248d05-abfc-46db-9b4c-920cde7d7901 tempest-CreateVolumesFromImageTest-84867816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:01 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d2248d05-abfc-46db-9b4c-920cde7d7901 tempest-CreateVolumesFromImageTest-84867816 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:17:01 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-d2248d05-abfc-46db-9b4c-920cde7d7901 tempest-CreateVolumesFromImageTest-84867816 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:17:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d2248d05-abfc-46db-9b4c-920cde7d7901 tempest-CreateVolumesFromImageTest-84867816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-bc6b1884-0425-4ab5-b327-1515abbe6f45 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:01 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-097b778d-bd48-4b82-8a97-21caff260133 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ed4d5a9-4859-4a64-91b5-d61865ac1fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32d05024-8a17-4749-85ea-16b811e09949', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:01 devstack sudo[97206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-bc6b1884-0425-4ab5-b327-1515abbe6f45 1073741824
Nov 04 12:17:01 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:01 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-097b778d-bd48-4b82-8a97-21caff260133 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbe08f23-b355-4f73-91d2-fd0283b42387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:01 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-097b778d-bd48-4b82-8a97-21caff260133 tempest-CreateVolumesFromImageTest-84867816 None] Volume volume-32d05024-8a17-4749-85ea-16b811e09949 (32d05024-8a17-4749-85ea-16b811e09949): created successfully
Nov 04 12:17:01 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-097b778d-bd48-4b82-8a97-21caff260133 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbe08f23-b355-4f73-91d2-fd0283b42387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:01 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-097b778d-bd48-4b82-8a97-21caff260133 tempest-CreateVolumesFromImageTest-84867816 None] Flow 'volume_create_manager' (e24694bb-2a32-4263-9b5e-1ba06149966c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:17:01 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-097b778d-bd48-4b82-8a97-21caff260133 tempest-CreateVolumesFromImageTest-84867816 None] Created volume successfully.
Nov 04 12:17:01 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d2248d05-abfc-46db-9b4c-920cde7d7901 tempest-CreateVolumesFromImageTest-84867816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-bc6b1884-0425-4ab5-b327-1515abbe6f45 1073741824" returned: 0 in 0.574s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d2248d05-abfc-46db-9b4c-920cde7d7901 tempest-CreateVolumesFromImageTest-84867816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-bc6b1884-0425-4ab5-b327-1515abbe6f45 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:01 devstack sudo[97216]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-bc6b1884-0425-4ab5-b327-1515abbe6f45
Nov 04 12:17:01 devstack sudo[97216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:02 devstack sudo[97216]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d2248d05-abfc-46db-9b4c-920cde7d7901 tempest-CreateVolumesFromImageTest-84867816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-bc6b1884-0425-4ab5-b327-1515abbe6f45" returned: 0 in 0.328s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d2248d05-abfc-46db-9b4c-920cde7d7901 tempest-CreateVolumesFromImageTest-84867816 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:17:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d2248d05-abfc-46db-9b4c-920cde7d7901 tempest-CreateVolumesFromImageTest-84867816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ec7685f7-2992-4dd4-aedc-164a958efd55 tempest-CreateVolumesFromImageTest-84867816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.115s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:17:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ec7685f7-2992-4dd4-aedc-164a958efd55 tempest-CreateVolumesFromImageTest-84867816 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:16:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1214685208',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5532428d-30b7-4aa1-9ead-294374d6bb4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0399c683598a4579aa980343a1232e05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:00Z,use_quota=True,user_id='7812a57a2bf8475aadd848e43ba9641a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:17:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-ec7685f7-2992-4dd4-aedc-164a958efd55 tempest-CreateVolumesFromImageTest-84867816 None] Creating volume 5532428d-30b7-4aa1-9ead-294374d6bb4f {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:17:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ec7685f7-2992-4dd4-aedc-164a958efd55 tempest-CreateVolumesFromImageTest-84867816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:17:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ec7685f7-2992-4dd4-aedc-164a958efd55 tempest-CreateVolumesFromImageTest-84867816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:17:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ec7685f7-2992-4dd4-aedc-164a958efd55 tempest-CreateVolumesFromImageTest-84867816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:17:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ec7685f7-2992-4dd4-aedc-164a958efd55 tempest-CreateVolumesFromImageTest-84867816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:17:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ec7685f7-2992-4dd4-aedc-164a958efd55 tempest-CreateVolumesFromImageTest-84867816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ec7685f7-2992-4dd4-aedc-164a958efd55 tempest-CreateVolumesFromImageTest-84867816 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:17:02 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-ec7685f7-2992-4dd4-aedc-164a958efd55 tempest-CreateVolumesFromImageTest-84867816 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:17:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ec7685f7-2992-4dd4-aedc-164a958efd55 tempest-CreateVolumesFromImageTest-84867816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5532428d-30b7-4aa1-9ead-294374d6bb4f 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d2248d05-abfc-46db-9b4c-920cde7d7901 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f36af63-d1f8-4959-a45d-ddeb120c83ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc6b1884-0425-4ab5-b327-1515abbe6f45', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d2248d05-abfc-46db-9b4c-920cde7d7901 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d957b073-63ae-4307-ba7c-d09a05499b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:02 devstack sudo[97219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5532428d-30b7-4aa1-9ead-294374d6bb4f 1073741824
Nov 04 12:17:02 devstack sudo[97219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:02 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-d2248d05-abfc-46db-9b4c-920cde7d7901 tempest-CreateVolumesFromImageTest-84867816 None] Volume volume-bc6b1884-0425-4ab5-b327-1515abbe6f45 (bc6b1884-0425-4ab5-b327-1515abbe6f45): created successfully
Nov 04 12:17:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d2248d05-abfc-46db-9b4c-920cde7d7901 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d957b073-63ae-4307-ba7c-d09a05499b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d2248d05-abfc-46db-9b4c-920cde7d7901 tempest-CreateVolumesFromImageTest-84867816 None] Flow 'volume_create_manager' (d5185b19-d6f9-41fa-b84c-8439f690ffa7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:17:02 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-d2248d05-abfc-46db-9b4c-920cde7d7901 tempest-CreateVolumesFromImageTest-84867816 None] Created volume successfully.
Nov 04 12:17:03 devstack sudo[97219]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ec7685f7-2992-4dd4-aedc-164a958efd55 tempest-CreateVolumesFromImageTest-84867816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5532428d-30b7-4aa1-9ead-294374d6bb4f 1073741824" returned: 0 in 0.874s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ec7685f7-2992-4dd4-aedc-164a958efd55 tempest-CreateVolumesFromImageTest-84867816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5532428d-30b7-4aa1-9ead-294374d6bb4f {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:03 devstack sudo[97276]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5532428d-30b7-4aa1-9ead-294374d6bb4f
Nov 04 12:17:03 devstack sudo[97276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:03 devstack sudo[97276]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ec7685f7-2992-4dd4-aedc-164a958efd55 tempest-CreateVolumesFromImageTest-84867816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5532428d-30b7-4aa1-9ead-294374d6bb4f" returned: 0 in 0.526s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:03 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ec7685f7-2992-4dd4-aedc-164a958efd55 tempest-CreateVolumesFromImageTest-84867816 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:17:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ec7685f7-2992-4dd4-aedc-164a958efd55 tempest-CreateVolumesFromImageTest-84867816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-2b78e762-495e-4954-b45e-543b88f363c9 req-2fd74866-1a2a-42c9-adf3-9dac7c63bd98 tempest-AttachVolumeTestJSON-852332315 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.990s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:17:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-2b78e762-495e-4954-b45e-543b88f363c9 req-2fd74866-1a2a-42c9-adf3-9dac7c63bd98 tempest-AttachVolumeTestJSON-852332315 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c799cbe9-77ed-4a13-90ad-1c8aba14e352 tempest-CreateVolumesFromImageTest-84867816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.863s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:17:03 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c799cbe9-77ed-4a13-90ad-1c8aba14e352 tempest-CreateVolumesFromImageTest-84867816 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:17:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2098749407',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebd80d28-b2de-433b-81d5-4a58be25f52f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0399c683598a4579aa980343a1232e05',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:01Z,use_quota=True,user_id='7812a57a2bf8475aadd848e43ba9641a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:17:03 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-c799cbe9-77ed-4a13-90ad-1c8aba14e352 tempest-CreateVolumesFromImageTest-84867816 None] Creating volume ebd80d28-b2de-433b-81d5-4a58be25f52f {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:17:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c799cbe9-77ed-4a13-90ad-1c8aba14e352 tempest-CreateVolumesFromImageTest-84867816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:17:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c799cbe9-77ed-4a13-90ad-1c8aba14e352 tempest-CreateVolumesFromImageTest-84867816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:17:03 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c799cbe9-77ed-4a13-90ad-1c8aba14e352 tempest-CreateVolumesFromImageTest-84867816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:17:03 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c799cbe9-77ed-4a13-90ad-1c8aba14e352 tempest-CreateVolumesFromImageTest-84867816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:17:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c799cbe9-77ed-4a13-90ad-1c8aba14e352 tempest-CreateVolumesFromImageTest-84867816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:03 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c799cbe9-77ed-4a13-90ad-1c8aba14e352 tempest-CreateVolumesFromImageTest-84867816 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:17:03 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-c799cbe9-77ed-4a13-90ad-1c8aba14e352 tempest-CreateVolumesFromImageTest-84867816 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:17:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c799cbe9-77ed-4a13-90ad-1c8aba14e352 tempest-CreateVolumesFromImageTest-84867816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebd80d28-b2de-433b-81d5-4a58be25f52f 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ec7685f7-2992-4dd4-aedc-164a958efd55 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8a71c04-fade-4c46-b69d-34438ee27128) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5532428d-30b7-4aa1-9ead-294374d6bb4f', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ec7685f7-2992-4dd4-aedc-164a958efd55 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0336a047-9473-48c9-9ae5-7f9a51d17e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:03 devstack sudo[97290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebd80d28-b2de-433b-81d5-4a58be25f52f 1073741824
Nov 04 12:17:03 devstack sudo[97290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:03 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-ec7685f7-2992-4dd4-aedc-164a958efd55 tempest-CreateVolumesFromImageTest-84867816 None] Volume volume-5532428d-30b7-4aa1-9ead-294374d6bb4f (5532428d-30b7-4aa1-9ead-294374d6bb4f): created successfully
Nov 04 12:17:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ec7685f7-2992-4dd4-aedc-164a958efd55 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0336a047-9473-48c9-9ae5-7f9a51d17e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ec7685f7-2992-4dd4-aedc-164a958efd55 tempest-CreateVolumesFromImageTest-84867816 None] Flow 'volume_create_manager' (66d078ea-1990-4f2f-bdd0-74bc97125434) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:17:03 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-ec7685f7-2992-4dd4-aedc-164a958efd55 tempest-CreateVolumesFromImageTest-84867816 None] Created volume successfully.
Nov 04 12:17:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-2b78e762-495e-4954-b45e-543b88f363c9 req-2fd74866-1a2a-42c9-adf3-9dac7c63bd98 tempest-AttachVolumeTestJSON-852332315 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79', 'name': 'volume-1b855e58-4c5f-49c9-a994-8fdc45661f5b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '71954e2e-90c7-4da8-825e-8545eff4a674', 'enforce_multipath': True} {{(pid=87169) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 04 12:17:03 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-2b78e762-495e-4954-b45e-543b88f363c9 req-2fd74866-1a2a-42c9-adf3-9dac7c63bd98 tempest-AttachVolumeTestJSON-852332315 None] attachment_update completed successfully.
Nov 04 12:17:04 devstack sudo[97290]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c799cbe9-77ed-4a13-90ad-1c8aba14e352 tempest-CreateVolumesFromImageTest-84867816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebd80d28-b2de-433b-81d5-4a58be25f52f 1073741824" returned: 0 in 1.058s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:04 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=83,cinder:UPDATE=106,cinder:INSERT=24,cinder:DELETE=9 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:17:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c799cbe9-77ed-4a13-90ad-1c8aba14e352 tempest-CreateVolumesFromImageTest-84867816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebd80d28-b2de-433b-81d5-4a58be25f52f {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:04 devstack sudo[97303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebd80d28-b2de-433b-81d5-4a58be25f52f
Nov 04 12:17:04 devstack sudo[97303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:05 devstack sudo[97303]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c799cbe9-77ed-4a13-90ad-1c8aba14e352 tempest-CreateVolumesFromImageTest-84867816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebd80d28-b2de-433b-81d5-4a58be25f52f" returned: 0 in 0.427s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:05 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c799cbe9-77ed-4a13-90ad-1c8aba14e352 tempest-CreateVolumesFromImageTest-84867816 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:17:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c799cbe9-77ed-4a13-90ad-1c8aba14e352 tempest-CreateVolumesFromImageTest-84867816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.604s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:05 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c799cbe9-77ed-4a13-90ad-1c8aba14e352 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4db0312e-e04d-4f36-a917-188724cb4823) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebd80d28-b2de-433b-81d5-4a58be25f52f', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:05 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c799cbe9-77ed-4a13-90ad-1c8aba14e352 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f64d4547-076e-4528-8ac0-b9119048064f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:05 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-c799cbe9-77ed-4a13-90ad-1c8aba14e352 tempest-CreateVolumesFromImageTest-84867816 None] Volume volume-ebd80d28-b2de-433b-81d5-4a58be25f52f (ebd80d28-b2de-433b-81d5-4a58be25f52f): created successfully
Nov 04 12:17:05 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c799cbe9-77ed-4a13-90ad-1c8aba14e352 tempest-CreateVolumesFromImageTest-84867816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f64d4547-076e-4528-8ac0-b9119048064f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:05 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c799cbe9-77ed-4a13-90ad-1c8aba14e352 tempest-CreateVolumesFromImageTest-84867816 None] Flow 'volume_create_manager' (bc184955-773b-4ed3-ad6f-c0d10d9d0b4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:17:05 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-c799cbe9-77ed-4a13-90ad-1c8aba14e352 tempest-CreateVolumesFromImageTest-84867816 None] Created volume successfully.
Nov 04 12:17:06 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fb5f061b-a87d-4611-b1c2-627b4138ccfc tempest-CreateVolumesFromImageTest-84867816 None] Acquiring lock "cinder-ebd80d28-b2de-433b-81d5-4a58be25f52f-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:17:06 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fb5f061b-a87d-4611-b1c2-627b4138ccfc tempest-CreateVolumesFromImageTest-84867816 None] Lock "cinder-ebd80d28-b2de-433b-81d5-4a58be25f52f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:17:06 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fb5f061b-a87d-4611-b1c2-627b4138ccfc tempest-CreateVolumesFromImageTest-84867816 None] Acquiring lock "cinder-quobyte-ebd80d28-b2de-433b-81d5-4a58be25f52f" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:17:06 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fb5f061b-a87d-4611-b1c2-627b4138ccfc tempest-CreateVolumesFromImageTest-84867816 None] Lock "cinder-quobyte-ebd80d28-b2de-433b-81d5-4a58be25f52f" acquired by "delete_volume" :: waited 0.040s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:17:06 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[257c3557-5b02-4cf6-95ce-fa0cdc85e08f]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:17:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fb5f061b-a87d-4611-b1c2-627b4138ccfc tempest-CreateVolumesFromImageTest-84867816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebd80d28-b2de-433b-81d5-4a58be25f52f {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:06 devstack sudo[97308]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebd80d28-b2de-433b-81d5-4a58be25f52f
Nov 04 12:17:06 devstack sudo[97308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:07 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-f30cc240-bb24-454c-8d9d-eff519584117 req-aee4e407-6401-496f-aa72-b33941ce1318 tempest-AttachVolumeTestJSON-852332315 None] Terminate volume connection completed successfully.
Nov 04 12:17:07 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-f30cc240-bb24-454c-8d9d-eff519584117 req-aee4e407-6401-496f-aa72-b33941ce1318 tempest-AttachVolumeTestJSON-852332315 None] Deleting attachment e36177f4-b717-492b-a598-e48adcf3905b. {{(pid=87169) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 12:17:07 devstack sudo[97308]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fb5f061b-a87d-4611-b1c2-627b4138ccfc tempest-CreateVolumesFromImageTest-84867816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebd80d28-b2de-433b-81d5-4a58be25f52f" returned: 0 in 0.557s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fb5f061b-a87d-4611-b1c2-627b4138ccfc tempest-CreateVolumesFromImageTest-84867816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebd80d28-b2de-433b-81d5-4a58be25f52f {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:07 devstack sudo[97315]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebd80d28-b2de-433b-81d5-4a58be25f52f
Nov 04 12:17:07 devstack sudo[97315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:07 devstack sudo[97315]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fb5f061b-a87d-4611-b1c2-627b4138ccfc tempest-CreateVolumesFromImageTest-84867816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebd80d28-b2de-433b-81d5-4a58be25f52f" returned: 0 in 0.471s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:07 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fb5f061b-a87d-4611-b1c2-627b4138ccfc tempest-CreateVolumesFromImageTest-84867816 None] Lock "cinder-quobyte-ebd80d28-b2de-433b-81d5-4a58be25f52f" released by "delete_volume" :: held 1.111s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:17:08 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-fb5f061b-a87d-4611-b1c2-627b4138ccfc tempest-CreateVolumesFromImageTest-84867816 None] Created reservations ['34666f11-672d-4bc2-b598-1dcf19543a99', '884a516e-8fe9-4235-804b-df035f0a595d', '1bc589e0-5fc8-4d1b-8e27-15fe737b039e', '87d9a93b-5f16-4c5a-99d7-e208f4de2f81'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:17:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-fb5f061b-a87d-4611-b1c2-627b4138ccfc tempest-CreateVolumesFromImageTest-84867816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:17:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-fb5f061b-a87d-4611-b1c2-627b4138ccfc tempest-CreateVolumesFromImageTest-84867816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:17:08 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-fb5f061b-a87d-4611-b1c2-627b4138ccfc tempest-CreateVolumesFromImageTest-84867816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:17:08 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-fb5f061b-a87d-4611-b1c2-627b4138ccfc tempest-CreateVolumesFromImageTest-84867816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:17:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-fb5f061b-a87d-4611-b1c2-627b4138ccfc tempest-CreateVolumesFromImageTest-84867816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fb5f061b-a87d-4611-b1c2-627b4138ccfc tempest-CreateVolumesFromImageTest-84867816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:08 devstack sudo[97319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:17:08 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:08 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fb5f061b-a87d-4611-b1c2-627b4138ccfc tempest-CreateVolumesFromImageTest-84867816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.478s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:08 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-fb5f061b-a87d-4611-b1c2-627b4138ccfc tempest-CreateVolumesFromImageTest-84867816 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:17:08 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-fb5f061b-a87d-4611-b1c2-627b4138ccfc tempest-CreateVolumesFromImageTest-84867816 None] Deleted volume successfully.
Nov 04 12:17:08 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fb5f061b-a87d-4611-b1c2-627b4138ccfc tempest-CreateVolumesFromImageTest-84867816 None] Lock "cinder-ebd80d28-b2de-433b-81d5-4a58be25f52f-delete_volume" released by "delete_volume" :: held 2.021s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:17:08 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-d3e35450-9f72-49da-973b-68095ac8b737 req-e9f20b94-2cae-4749-a26e-ba7ddb871910 tempest-AttachVolumeTestJSON-852332315 None] Terminate volume connection completed successfully.
Nov 04 12:17:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-d3e35450-9f72-49da-973b-68095ac8b737 req-e9f20b94-2cae-4749-a26e-ba7ddb871910 tempest-AttachVolumeTestJSON-852332315 None] Deleting attachment 71954e2e-90c7-4da8-825e-8545eff4a674. {{(pid=87169) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 12:17:09 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-54b8deb6-9d29-418c-8934-60d7e87e90ee tempest-CreateVolumesFromImageTest-84867816 None] Acquiring lock "cinder-5532428d-30b7-4aa1-9ead-294374d6bb4f-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:17:09 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-54b8deb6-9d29-418c-8934-60d7e87e90ee tempest-CreateVolumesFromImageTest-84867816 None] Lock "cinder-5532428d-30b7-4aa1-9ead-294374d6bb4f-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:17:09 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-54b8deb6-9d29-418c-8934-60d7e87e90ee tempest-CreateVolumesFromImageTest-84867816 None] Acquiring lock "cinder-quobyte-5532428d-30b7-4aa1-9ead-294374d6bb4f" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:17:09 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-54b8deb6-9d29-418c-8934-60d7e87e90ee tempest-CreateVolumesFromImageTest-84867816 None] Lock "cinder-quobyte-5532428d-30b7-4aa1-9ead-294374d6bb4f" acquired by "delete_volume" :: waited 0.018s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:17:09 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a0082f-1820-479c-9b38-1643b2339ae1]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:17:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-54b8deb6-9d29-418c-8934-60d7e87e90ee tempest-CreateVolumesFromImageTest-84867816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5532428d-30b7-4aa1-9ead-294374d6bb4f {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:09 devstack sudo[97350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5532428d-30b7-4aa1-9ead-294374d6bb4f
Nov 04 12:17:09 devstack sudo[97350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:09 devstack sudo[97350]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-54b8deb6-9d29-418c-8934-60d7e87e90ee tempest-CreateVolumesFromImageTest-84867816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5532428d-30b7-4aa1-9ead-294374d6bb4f" returned: 0 in 0.693s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-54b8deb6-9d29-418c-8934-60d7e87e90ee tempest-CreateVolumesFromImageTest-84867816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5532428d-30b7-4aa1-9ead-294374d6bb4f {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:09 devstack sudo[97355]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5532428d-30b7-4aa1-9ead-294374d6bb4f
Nov 04 12:17:09 devstack sudo[97355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:10 devstack sudo[97355]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-54b8deb6-9d29-418c-8934-60d7e87e90ee tempest-CreateVolumesFromImageTest-84867816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5532428d-30b7-4aa1-9ead-294374d6bb4f" returned: 0 in 0.664s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:10 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-54b8deb6-9d29-418c-8934-60d7e87e90ee tempest-CreateVolumesFromImageTest-84867816 None] Lock "cinder-quobyte-5532428d-30b7-4aa1-9ead-294374d6bb4f" released by "delete_volume" :: held 1.442s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:17:10 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-54b8deb6-9d29-418c-8934-60d7e87e90ee tempest-CreateVolumesFromImageTest-84867816 None] Created reservations ['13073828-9865-4119-8eb6-1770dcedb2b4', '5c38a5ba-405c-4b84-92de-3e78e2e9625a', 'fb85aa6c-e738-45fd-8652-09aff616034f', '54486582-fac3-4861-9bc1-b3d3ecb54134'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:17:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-54b8deb6-9d29-418c-8934-60d7e87e90ee tempest-CreateVolumesFromImageTest-84867816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:17:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-54b8deb6-9d29-418c-8934-60d7e87e90ee tempest-CreateVolumesFromImageTest-84867816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:17:10 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-54b8deb6-9d29-418c-8934-60d7e87e90ee tempest-CreateVolumesFromImageTest-84867816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:17:10 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-54b8deb6-9d29-418c-8934-60d7e87e90ee tempest-CreateVolumesFromImageTest-84867816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:17:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-54b8deb6-9d29-418c-8934-60d7e87e90ee tempest-CreateVolumesFromImageTest-84867816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-54b8deb6-9d29-418c-8934-60d7e87e90ee tempest-CreateVolumesFromImageTest-84867816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:10 devstack sudo[97362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:17:10 devstack sudo[97362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:11 devstack sudo[97362]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:11 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d6afc293-8d06-4701-822f-f2a376ed2cfa tempest-CreateVolumesFromImageTest-84867816 None] Acquiring lock "cinder-bc6b1884-0425-4ab5-b327-1515abbe6f45-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:17:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-54b8deb6-9d29-418c-8934-60d7e87e90ee tempest-CreateVolumesFromImageTest-84867816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.676s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:11 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-54b8deb6-9d29-418c-8934-60d7e87e90ee tempest-CreateVolumesFromImageTest-84867816 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:17:11 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-54b8deb6-9d29-418c-8934-60d7e87e90ee tempest-CreateVolumesFromImageTest-84867816 None] Deleted volume successfully.
Nov 04 12:17:11 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d6afc293-8d06-4701-822f-f2a376ed2cfa tempest-CreateVolumesFromImageTest-84867816 None] Lock "cinder-bc6b1884-0425-4ab5-b327-1515abbe6f45-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:17:11 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-54b8deb6-9d29-418c-8934-60d7e87e90ee tempest-CreateVolumesFromImageTest-84867816 None] Lock "cinder-5532428d-30b7-4aa1-9ead-294374d6bb4f-delete_volume" released by "delete_volume" :: held 2.597s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:17:11 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d6afc293-8d06-4701-822f-f2a376ed2cfa tempest-CreateVolumesFromImageTest-84867816 None] Acquiring lock "cinder-quobyte-bc6b1884-0425-4ab5-b327-1515abbe6f45" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:17:11 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d6afc293-8d06-4701-822f-f2a376ed2cfa tempest-CreateVolumesFromImageTest-84867816 None] Lock "cinder-quobyte-bc6b1884-0425-4ab5-b327-1515abbe6f45" acquired by "delete_volume" :: waited 0.020s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:17:11 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf625bde-8c87-43c9-848d-c561be674152]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:17:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d6afc293-8d06-4701-822f-f2a376ed2cfa tempest-CreateVolumesFromImageTest-84867816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-bc6b1884-0425-4ab5-b327-1515abbe6f45 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:11 devstack sudo[97382]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-bc6b1884-0425-4ab5-b327-1515abbe6f45
Nov 04 12:17:11 devstack sudo[97382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:12 devstack sudo[97382]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d6afc293-8d06-4701-822f-f2a376ed2cfa tempest-CreateVolumesFromImageTest-84867816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-bc6b1884-0425-4ab5-b327-1515abbe6f45" returned: 0 in 0.498s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d6afc293-8d06-4701-822f-f2a376ed2cfa tempest-CreateVolumesFromImageTest-84867816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-bc6b1884-0425-4ab5-b327-1515abbe6f45 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:12 devstack sudo[97389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-bc6b1884-0425-4ab5-b327-1515abbe6f45
Nov 04 12:17:12 devstack sudo[97389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:12 devstack sudo[97389]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d6afc293-8d06-4701-822f-f2a376ed2cfa tempest-CreateVolumesFromImageTest-84867816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-bc6b1884-0425-4ab5-b327-1515abbe6f45" returned: 0 in 0.314s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:12 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d6afc293-8d06-4701-822f-f2a376ed2cfa tempest-CreateVolumesFromImageTest-84867816 None] Lock "cinder-quobyte-bc6b1884-0425-4ab5-b327-1515abbe6f45" released by "delete_volume" :: held 0.897s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:17:12 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-d6afc293-8d06-4701-822f-f2a376ed2cfa tempest-CreateVolumesFromImageTest-84867816 None] Created reservations ['7a597322-8bf4-416b-a1b2-188f1aa8df77', '896c8990-32c7-4b94-abbf-bdb1f4f1db8d', '36ccbbc0-baf3-4367-9c0b-c3dfac65e38e', '287850e7-353f-40b2-a234-e81aba928dc2'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:17:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d6afc293-8d06-4701-822f-f2a376ed2cfa tempest-CreateVolumesFromImageTest-84867816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:17:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d6afc293-8d06-4701-822f-f2a376ed2cfa tempest-CreateVolumesFromImageTest-84867816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:17:12 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d6afc293-8d06-4701-822f-f2a376ed2cfa tempest-CreateVolumesFromImageTest-84867816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:17:12 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d6afc293-8d06-4701-822f-f2a376ed2cfa tempest-CreateVolumesFromImageTest-84867816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:17:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d6afc293-8d06-4701-822f-f2a376ed2cfa tempest-CreateVolumesFromImageTest-84867816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d6afc293-8d06-4701-822f-f2a376ed2cfa tempest-CreateVolumesFromImageTest-84867816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:12 devstack sudo[97393]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:17:12 devstack sudo[97393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:13 devstack sudo[97393]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d6afc293-8d06-4701-822f-f2a376ed2cfa tempest-CreateVolumesFromImageTest-84867816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.358s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:13 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-d6afc293-8d06-4701-822f-f2a376ed2cfa tempest-CreateVolumesFromImageTest-84867816 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:17:13 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-d6afc293-8d06-4701-822f-f2a376ed2cfa tempest-CreateVolumesFromImageTest-84867816 None] Deleted volume successfully.
Nov 04 12:17:13 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d6afc293-8d06-4701-822f-f2a376ed2cfa tempest-CreateVolumesFromImageTest-84867816 None] Lock "cinder-bc6b1884-0425-4ab5-b327-1515abbe6f45-delete_volume" released by "delete_volume" :: held 1.739s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:17:14 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-821dab79-9720-4801-a4fd-6c68db855044 tempest-CreateVolumesFromImageTest-84867816 None] Acquiring lock "cinder-32d05024-8a17-4749-85ea-16b811e09949-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:17:14 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-821dab79-9720-4801-a4fd-6c68db855044 tempest-CreateVolumesFromImageTest-84867816 None] Lock "cinder-32d05024-8a17-4749-85ea-16b811e09949-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:17:14 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-821dab79-9720-4801-a4fd-6c68db855044 tempest-CreateVolumesFromImageTest-84867816 None] Acquiring lock "cinder-quobyte-32d05024-8a17-4749-85ea-16b811e09949" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:17:14 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-821dab79-9720-4801-a4fd-6c68db855044 tempest-CreateVolumesFromImageTest-84867816 None] Lock "cinder-quobyte-32d05024-8a17-4749-85ea-16b811e09949" acquired by "delete_volume" :: waited 0.020s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:17:14 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[34132b83-5a1a-4ba2-8dba-78f063646bd9]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:17:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-821dab79-9720-4801-a4fd-6c68db855044 tempest-CreateVolumesFromImageTest-84867816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-32d05024-8a17-4749-85ea-16b811e09949 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:14 devstack sudo[97398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-32d05024-8a17-4749-85ea-16b811e09949
Nov 04 12:17:14 devstack sudo[97398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:14 devstack sudo[97398]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-821dab79-9720-4801-a4fd-6c68db855044 tempest-CreateVolumesFromImageTest-84867816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-32d05024-8a17-4749-85ea-16b811e09949" returned: 0 in 0.422s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-821dab79-9720-4801-a4fd-6c68db855044 tempest-CreateVolumesFromImageTest-84867816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-32d05024-8a17-4749-85ea-16b811e09949 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:14 devstack sudo[97403]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-32d05024-8a17-4749-85ea-16b811e09949
Nov 04 12:17:14 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:14 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-821dab79-9720-4801-a4fd-6c68db855044 tempest-CreateVolumesFromImageTest-84867816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-32d05024-8a17-4749-85ea-16b811e09949" returned: 0 in 0.417s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:15 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-821dab79-9720-4801-a4fd-6c68db855044 tempest-CreateVolumesFromImageTest-84867816 None] Lock "cinder-quobyte-32d05024-8a17-4749-85ea-16b811e09949" released by "delete_volume" :: held 0.899s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:17:15 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-821dab79-9720-4801-a4fd-6c68db855044 tempest-CreateVolumesFromImageTest-84867816 None] Created reservations ['bb00acfa-ae1e-4aaf-b621-76139b65ef90', '8bc9764c-c3e5-413e-97b6-86b22dee8a62', '0e989795-01e1-44c8-8a29-dff8a1ceb8eb', '109878ba-e30f-4440-a870-127114ce38c1'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:17:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-821dab79-9720-4801-a4fd-6c68db855044 tempest-CreateVolumesFromImageTest-84867816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:17:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-821dab79-9720-4801-a4fd-6c68db855044 tempest-CreateVolumesFromImageTest-84867816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:17:15 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-821dab79-9720-4801-a4fd-6c68db855044 tempest-CreateVolumesFromImageTest-84867816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:17:15 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-821dab79-9720-4801-a4fd-6c68db855044 tempest-CreateVolumesFromImageTest-84867816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:17:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-821dab79-9720-4801-a4fd-6c68db855044 tempest-CreateVolumesFromImageTest-84867816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-821dab79-9720-4801-a4fd-6c68db855044 tempest-CreateVolumesFromImageTest-84867816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:15 devstack sudo[97406]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:17:15 devstack sudo[97406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:15 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-b7388db3-2892-48e8-af18-29451722e600 tempest-CreateVolumesFromImageTest-84867816 None] Acquiring lock "cinder-97a1d3e7-2c6b-47cd-ad0c-b83b91c1a157-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:17:15 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-b7388db3-2892-48e8-af18-29451722e600 tempest-CreateVolumesFromImageTest-84867816 None] Lock "cinder-97a1d3e7-2c6b-47cd-ad0c-b83b91c1a157-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:17:15 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-b7388db3-2892-48e8-af18-29451722e600 tempest-CreateVolumesFromImageTest-84867816 None] Acquiring lock "cinder-quobyte-97a1d3e7-2c6b-47cd-ad0c-b83b91c1a157" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:17:15 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-b7388db3-2892-48e8-af18-29451722e600 tempest-CreateVolumesFromImageTest-84867816 None] Lock "cinder-quobyte-97a1d3e7-2c6b-47cd-ad0c-b83b91c1a157" acquired by "delete_volume" :: waited 0.038s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:17:15 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[02babf0c-99bb-4088-89bd-46c400995bbe]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:17:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b7388db3-2892-48e8-af18-29451722e600 tempest-CreateVolumesFromImageTest-84867816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-97a1d3e7-2c6b-47cd-ad0c-b83b91c1a157 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:15 devstack sudo[97406]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-821dab79-9720-4801-a4fd-6c68db855044 tempest-CreateVolumesFromImageTest-84867816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.480s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:15 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-821dab79-9720-4801-a4fd-6c68db855044 tempest-CreateVolumesFromImageTest-84867816 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:17:15 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-821dab79-9720-4801-a4fd-6c68db855044 tempest-CreateVolumesFromImageTest-84867816 None] Deleted volume successfully.
Nov 04 12:17:15 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-821dab79-9720-4801-a4fd-6c68db855044 tempest-CreateVolumesFromImageTest-84867816 None] Lock "cinder-32d05024-8a17-4749-85ea-16b811e09949-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:17:15 devstack sudo[97408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-97a1d3e7-2c6b-47cd-ad0c-b83b91c1a157
Nov 04 12:17:15 devstack sudo[97408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:15 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-90a716e5-012c-433f-af7c-fc9aa1baa2ba tempest-AttachVolumeTestJSON-852332315 None] Acquiring lock "cinder-1b855e58-4c5f-49c9-a994-8fdc45661f5b-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:17:16 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-90a716e5-012c-433f-af7c-fc9aa1baa2ba tempest-AttachVolumeTestJSON-852332315 None] Lock "cinder-1b855e58-4c5f-49c9-a994-8fdc45661f5b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:17:16 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-90a716e5-012c-433f-af7c-fc9aa1baa2ba tempest-AttachVolumeTestJSON-852332315 None] Acquiring lock "cinder-quobyte-1b855e58-4c5f-49c9-a994-8fdc45661f5b" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:17:16 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-90a716e5-012c-433f-af7c-fc9aa1baa2ba tempest-AttachVolumeTestJSON-852332315 None] Lock "cinder-quobyte-1b855e58-4c5f-49c9-a994-8fdc45661f5b" acquired by "delete_volume" :: waited 0.030s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:17:16 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7aa41b1-b71a-44eb-9b47-402fb05bd348]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:17:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-90a716e5-012c-433f-af7c-fc9aa1baa2ba tempest-AttachVolumeTestJSON-852332315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1b855e58-4c5f-49c9-a994-8fdc45661f5b {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:16 devstack sudo[97408]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b7388db3-2892-48e8-af18-29451722e600 tempest-CreateVolumesFromImageTest-84867816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-97a1d3e7-2c6b-47cd-ad0c-b83b91c1a157" returned: 0 in 0.662s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b7388db3-2892-48e8-af18-29451722e600 tempest-CreateVolumesFromImageTest-84867816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-97a1d3e7-2c6b-47cd-ad0c-b83b91c1a157 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:16 devstack sudo[97416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-97a1d3e7-2c6b-47cd-ad0c-b83b91c1a157
Nov 04 12:17:16 devstack sudo[97416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:16 devstack sudo[97412]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1b855e58-4c5f-49c9-a994-8fdc45661f5b
Nov 04 12:17:16 devstack sudo[97412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:16 devstack sudo[97416]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b7388db3-2892-48e8-af18-29451722e600 tempest-CreateVolumesFromImageTest-84867816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-97a1d3e7-2c6b-47cd-ad0c-b83b91c1a157" returned: 0 in 0.365s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:16 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-b7388db3-2892-48e8-af18-29451722e600 tempest-CreateVolumesFromImageTest-84867816 None] Lock "cinder-quobyte-97a1d3e7-2c6b-47cd-ad0c-b83b91c1a157" released by "delete_volume" :: held 1.125s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:17:16 devstack sudo[97412]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-90a716e5-012c-433f-af7c-fc9aa1baa2ba tempest-AttachVolumeTestJSON-852332315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1b855e58-4c5f-49c9-a994-8fdc45661f5b" returned: 0 in 0.506s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-90a716e5-012c-433f-af7c-fc9aa1baa2ba tempest-AttachVolumeTestJSON-852332315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1b855e58-4c5f-49c9-a994-8fdc45661f5b {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:16 devstack sudo[97423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1b855e58-4c5f-49c9-a994-8fdc45661f5b
Nov 04 12:17:16 devstack sudo[97423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:16 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-b7388db3-2892-48e8-af18-29451722e600 tempest-CreateVolumesFromImageTest-84867816 None] Created reservations ['3bf35c90-5b5e-44a4-8398-e8dd98134417', 'fae3963c-cbf4-4f76-a724-4d2a5a961388', '34452aa1-d150-4777-9ca4-234968b1f14a', '0d1a98f8-2b79-4b20-a431-d728ed0c5a37'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:17:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b7388db3-2892-48e8-af18-29451722e600 tempest-CreateVolumesFromImageTest-84867816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:17:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b7388db3-2892-48e8-af18-29451722e600 tempest-CreateVolumesFromImageTest-84867816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:17:16 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-b7388db3-2892-48e8-af18-29451722e600 tempest-CreateVolumesFromImageTest-84867816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:17:16 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-b7388db3-2892-48e8-af18-29451722e600 tempest-CreateVolumesFromImageTest-84867816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:17:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b7388db3-2892-48e8-af18-29451722e600 tempest-CreateVolumesFromImageTest-84867816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b7388db3-2892-48e8-af18-29451722e600 tempest-CreateVolumesFromImageTest-84867816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:16 devstack sudo[97425]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:17:16 devstack sudo[97425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:16 devstack sudo[97423]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-90a716e5-012c-433f-af7c-fc9aa1baa2ba tempest-AttachVolumeTestJSON-852332315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1b855e58-4c5f-49c9-a994-8fdc45661f5b" returned: 0 in 0.289s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:16 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-90a716e5-012c-433f-af7c-fc9aa1baa2ba tempest-AttachVolumeTestJSON-852332315 None] Lock "cinder-quobyte-1b855e58-4c5f-49c9-a994-8fdc45661f5b" released by "delete_volume" :: held 0.858s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:17:17 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-90a716e5-012c-433f-af7c-fc9aa1baa2ba tempest-AttachVolumeTestJSON-852332315 None] Created reservations ['849b658c-3f24-4703-9998-fa7555e7952e', '40ea3526-3ee5-4b99-8be4-cda05d27f01f', '6137c13b-b8bd-4edc-ad5e-4832d6e45ba3', '29bf1a0a-66b4-475c-81eb-d275f29480f0'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:17:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-90a716e5-012c-433f-af7c-fc9aa1baa2ba tempest-AttachVolumeTestJSON-852332315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:17:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-90a716e5-012c-433f-af7c-fc9aa1baa2ba tempest-AttachVolumeTestJSON-852332315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:17:17 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-90a716e5-012c-433f-af7c-fc9aa1baa2ba tempest-AttachVolumeTestJSON-852332315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:17:17 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-90a716e5-012c-433f-af7c-fc9aa1baa2ba tempest-AttachVolumeTestJSON-852332315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:17:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-90a716e5-012c-433f-af7c-fc9aa1baa2ba tempest-AttachVolumeTestJSON-852332315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-90a716e5-012c-433f-af7c-fc9aa1baa2ba tempest-AttachVolumeTestJSON-852332315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:17 devstack sudo[97425]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b7388db3-2892-48e8-af18-29451722e600 tempest-CreateVolumesFromImageTest-84867816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.352s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:17 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-b7388db3-2892-48e8-af18-29451722e600 tempest-CreateVolumesFromImageTest-84867816 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:17:17 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-b7388db3-2892-48e8-af18-29451722e600 tempest-CreateVolumesFromImageTest-84867816 None] Deleted volume successfully.
Nov 04 12:17:17 devstack sudo[97469]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:17:17 devstack sudo[97469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:17 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-b7388db3-2892-48e8-af18-29451722e600 tempest-CreateVolumesFromImageTest-84867816 None] Lock "cinder-97a1d3e7-2c6b-47cd-ad0c-b83b91c1a157-delete_volume" released by "delete_volume" :: held 1.840s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:17:17 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-46c6a550-599c-4eee-bd9d-4db75a025905 tempest-AttachVolumeTestJSON-852332315 None] Acquiring lock "cinder-9633b41e-4d71-4c06-bd9d-e79fb7a416ee-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:17:17 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-46c6a550-599c-4eee-bd9d-4db75a025905 tempest-AttachVolumeTestJSON-852332315 None] Lock "cinder-9633b41e-4d71-4c06-bd9d-e79fb7a416ee-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:17:17 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-46c6a550-599c-4eee-bd9d-4db75a025905 tempest-AttachVolumeTestJSON-852332315 None] Acquiring lock "cinder-quobyte-9633b41e-4d71-4c06-bd9d-e79fb7a416ee" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:17:17 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-46c6a550-599c-4eee-bd9d-4db75a025905 tempest-AttachVolumeTestJSON-852332315 None] Lock "cinder-quobyte-9633b41e-4d71-4c06-bd9d-e79fb7a416ee" acquired by "delete_volume" :: waited 0.018s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:17:17 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[0192c09a-1803-4eb5-a126-2996a4920ed4]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:17:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-46c6a550-599c-4eee-bd9d-4db75a025905 tempest-AttachVolumeTestJSON-852332315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9633b41e-4d71-4c06-bd9d-e79fb7a416ee {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:17 devstack sudo[97469]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-90a716e5-012c-433f-af7c-fc9aa1baa2ba tempest-AttachVolumeTestJSON-852332315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.374s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:17 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-90a716e5-012c-433f-af7c-fc9aa1baa2ba tempest-AttachVolumeTestJSON-852332315 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:17:17 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-90a716e5-012c-433f-af7c-fc9aa1baa2ba tempest-AttachVolumeTestJSON-852332315 None] Deleted volume successfully.
Nov 04 12:17:17 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-90a716e5-012c-433f-af7c-fc9aa1baa2ba tempest-AttachVolumeTestJSON-852332315 None] Lock "cinder-1b855e58-4c5f-49c9-a994-8fdc45661f5b-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:17:17 devstack sudo[97471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9633b41e-4d71-4c06-bd9d-e79fb7a416ee
Nov 04 12:17:17 devstack sudo[97471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:17 devstack sudo[97471]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-46c6a550-599c-4eee-bd9d-4db75a025905 tempest-AttachVolumeTestJSON-852332315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9633b41e-4d71-4c06-bd9d-e79fb7a416ee" returned: 0 in 0.449s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-46c6a550-599c-4eee-bd9d-4db75a025905 tempest-AttachVolumeTestJSON-852332315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9633b41e-4d71-4c06-bd9d-e79fb7a416ee {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:17 devstack sudo[97477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9633b41e-4d71-4c06-bd9d-e79fb7a416ee
Nov 04 12:17:17 devstack sudo[97477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:18 devstack sudo[97477]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-46c6a550-599c-4eee-bd9d-4db75a025905 tempest-AttachVolumeTestJSON-852332315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9633b41e-4d71-4c06-bd9d-e79fb7a416ee" returned: 0 in 0.288s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:18 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-46c6a550-599c-4eee-bd9d-4db75a025905 tempest-AttachVolumeTestJSON-852332315 None] Lock "cinder-quobyte-9633b41e-4d71-4c06-bd9d-e79fb7a416ee" released by "delete_volume" :: held 0.807s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:17:18 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-46c6a550-599c-4eee-bd9d-4db75a025905 tempest-AttachVolumeTestJSON-852332315 None] Created reservations ['0541a819-7b05-494b-b965-ddaf04ab2b4b', 'e50ed2ef-f216-4834-a827-65cc703559c1', '761de1b2-82cb-464f-955d-02660826c559', '311cce80-9e04-420c-a056-8c7aec8749d0'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:17:18 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-159fe8b2-a6b2-432b-8741-83543a76d2b5 tempest-AbsoluteLimitsTests-1423203935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:17:18 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-159fe8b2-a6b2-432b-8741-83543a76d2b5 tempest-AbsoluteLimitsTests-1423203935 None] Flow 'volume_create_manager' (56cbac7f-4845-4a7b-a046-65d0bdbae8a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:17:18 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-159fe8b2-a6b2-432b-8741-83543a76d2b5 tempest-AbsoluteLimitsTests-1423203935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1633e70-f54a-4f1f-96fc-ca2e88b16748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:18 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-159fe8b2-a6b2-432b-8741-83543a76d2b5 tempest-AbsoluteLimitsTests-1423203935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1633e70-f54a-4f1f-96fc-ca2e88b16748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1490562351',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60ec0165-f7e1-424e-a1e1-bb64a604ac2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47e18acaeb8a4fca8c19cc21fb86a8ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:18Z,use_quota=True,user_id='fa8edbb6626f4ad5bbabf7d35e8b81fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:18 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-159fe8b2-a6b2-432b-8741-83543a76d2b5 tempest-AbsoluteLimitsTests-1423203935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74af0c9c-9a20-43f9-97ee-617bdf7bb94d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:18 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-159fe8b2-a6b2-432b-8741-83543a76d2b5 tempest-AbsoluteLimitsTests-1423203935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74af0c9c-9a20-43f9-97ee-617bdf7bb94d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:18 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-159fe8b2-a6b2-432b-8741-83543a76d2b5 tempest-AbsoluteLimitsTests-1423203935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06af4175-60ad-44d2-99ef-c8a2f947e85c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:18 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-159fe8b2-a6b2-432b-8741-83543a76d2b5 tempest-AbsoluteLimitsTests-1423203935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06af4175-60ad-44d2-99ef-c8a2f947e85c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60ec0165-f7e1-424e-a1e1-bb64a604ac2e', 'volume_name': 'volume-60ec0165-f7e1-424e-a1e1-bb64a604ac2e', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:18 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-159fe8b2-a6b2-432b-8741-83543a76d2b5 tempest-AbsoluteLimitsTests-1423203935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97223949-5d66-4b77-8067-9cb42de016ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:18 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-159fe8b2-a6b2-432b-8741-83543a76d2b5 tempest-AbsoluteLimitsTests-1423203935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97223949-5d66-4b77-8067-9cb42de016ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:18 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-159fe8b2-a6b2-432b-8741-83543a76d2b5 tempest-AbsoluteLimitsTests-1423203935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c9ff58d-ac20-4511-ac4f-e9a0001a71e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:18 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-159fe8b2-a6b2-432b-8741-83543a76d2b5 tempest-AbsoluteLimitsTests-1423203935 None] Volume 60ec0165-f7e1-424e-a1e1-bb64a604ac2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60ec0165-f7e1-424e-a1e1-bb64a604ac2e', 'volume_size': 1}
Nov 04 12:17:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-159fe8b2-a6b2-432b-8741-83543a76d2b5 tempest-AbsoluteLimitsTests-1423203935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:17:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-159fe8b2-a6b2-432b-8741-83543a76d2b5 tempest-AbsoluteLimitsTests-1423203935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:17:18 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-159fe8b2-a6b2-432b-8741-83543a76d2b5 tempest-AbsoluteLimitsTests-1423203935 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:17:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1490562351',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60ec0165-f7e1-424e-a1e1-bb64a604ac2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47e18acaeb8a4fca8c19cc21fb86a8ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:18Z,use_quota=True,user_id='fa8edbb6626f4ad5bbabf7d35e8b81fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:17:18 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-159fe8b2-a6b2-432b-8741-83543a76d2b5 tempest-AbsoluteLimitsTests-1423203935 None] Creating volume 60ec0165-f7e1-424e-a1e1-bb64a604ac2e {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:17:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-159fe8b2-a6b2-432b-8741-83543a76d2b5 tempest-AbsoluteLimitsTests-1423203935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:17:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-159fe8b2-a6b2-432b-8741-83543a76d2b5 tempest-AbsoluteLimitsTests-1423203935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:17:18 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-159fe8b2-a6b2-432b-8741-83543a76d2b5 tempest-AbsoluteLimitsTests-1423203935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:17:18 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-159fe8b2-a6b2-432b-8741-83543a76d2b5 tempest-AbsoluteLimitsTests-1423203935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:17:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-159fe8b2-a6b2-432b-8741-83543a76d2b5 tempest-AbsoluteLimitsTests-1423203935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:18 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-159fe8b2-a6b2-432b-8741-83543a76d2b5 tempest-AbsoluteLimitsTests-1423203935 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:17:18 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-159fe8b2-a6b2-432b-8741-83543a76d2b5 tempest-AbsoluteLimitsTests-1423203935 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:17:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-159fe8b2-a6b2-432b-8741-83543a76d2b5 tempest-AbsoluteLimitsTests-1423203935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-60ec0165-f7e1-424e-a1e1-bb64a604ac2e 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-46c6a550-599c-4eee-bd9d-4db75a025905 tempest-AttachVolumeTestJSON-852332315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:17:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-46c6a550-599c-4eee-bd9d-4db75a025905 tempest-AttachVolumeTestJSON-852332315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:17:18 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-46c6a550-599c-4eee-bd9d-4db75a025905 tempest-AttachVolumeTestJSON-852332315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:17:18 devstack sudo[97480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-60ec0165-f7e1-424e-a1e1-bb64a604ac2e 1073741824
Nov 04 12:17:18 devstack sudo[97480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:18 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-46c6a550-599c-4eee-bd9d-4db75a025905 tempest-AttachVolumeTestJSON-852332315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:17:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-46c6a550-599c-4eee-bd9d-4db75a025905 tempest-AttachVolumeTestJSON-852332315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-46c6a550-599c-4eee-bd9d-4db75a025905 tempest-AttachVolumeTestJSON-852332315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:18 devstack sudo[97482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:17:18 devstack sudo[97482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:18 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5a27fa2c-59c7-4050-8cca-86bff20a9b4b tempest-AttachVolumeTestJSON-852332315 None] Acquiring lock "cinder-cd3ba824-b061-44a7-852f-f28e924bea18-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:17:18 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5a27fa2c-59c7-4050-8cca-86bff20a9b4b tempest-AttachVolumeTestJSON-852332315 None] Lock "cinder-cd3ba824-b061-44a7-852f-f28e924bea18-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:17:18 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5a27fa2c-59c7-4050-8cca-86bff20a9b4b tempest-AttachVolumeTestJSON-852332315 None] Acquiring lock "cinder-quobyte-cd3ba824-b061-44a7-852f-f28e924bea18" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:17:18 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5a27fa2c-59c7-4050-8cca-86bff20a9b4b tempest-AttachVolumeTestJSON-852332315 None] Lock "cinder-quobyte-cd3ba824-b061-44a7-852f-f28e924bea18" acquired by "delete_volume" :: waited 0.026s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:17:18 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[d076f750-1842-44ef-af8d-5f67a701d31c]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:17:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5a27fa2c-59c7-4050-8cca-86bff20a9b4b tempest-AttachVolumeTestJSON-852332315 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cd3ba824-b061-44a7-852f-f28e924bea18 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:18 devstack sudo[97482]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-46c6a550-599c-4eee-bd9d-4db75a025905 tempest-AttachVolumeTestJSON-852332315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.364s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:18 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-46c6a550-599c-4eee-bd9d-4db75a025905 tempest-AttachVolumeTestJSON-852332315 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:17:18 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-46c6a550-599c-4eee-bd9d-4db75a025905 tempest-AttachVolumeTestJSON-852332315 None] Deleted volume successfully.
Nov 04 12:17:18 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-46c6a550-599c-4eee-bd9d-4db75a025905 tempest-AttachVolumeTestJSON-852332315 None] Lock "cinder-9633b41e-4d71-4c06-bd9d-e79fb7a416ee-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:17:18 devstack sudo[97488]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cd3ba824-b061-44a7-852f-f28e924bea18
Nov 04 12:17:18 devstack sudo[97488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:18 devstack sudo[97480]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-159fe8b2-a6b2-432b-8741-83543a76d2b5 tempest-AbsoluteLimitsTests-1423203935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-60ec0165-f7e1-424e-a1e1-bb64a604ac2e 1073741824" returned: 0 in 0.609s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-159fe8b2-a6b2-432b-8741-83543a76d2b5 tempest-AbsoluteLimitsTests-1423203935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-60ec0165-f7e1-424e-a1e1-bb64a604ac2e {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:19 devstack sudo[97491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-60ec0165-f7e1-424e-a1e1-bb64a604ac2e
Nov 04 12:17:19 devstack sudo[97491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:19 devstack sudo[97488]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5a27fa2c-59c7-4050-8cca-86bff20a9b4b tempest-AttachVolumeTestJSON-852332315 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cd3ba824-b061-44a7-852f-f28e924bea18" returned: 0 in 0.480s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5a27fa2c-59c7-4050-8cca-86bff20a9b4b tempest-AttachVolumeTestJSON-852332315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cd3ba824-b061-44a7-852f-f28e924bea18 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:19 devstack sudo[97498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cd3ba824-b061-44a7-852f-f28e924bea18
Nov 04 12:17:19 devstack sudo[97498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:19 devstack sudo[97491]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-159fe8b2-a6b2-432b-8741-83543a76d2b5 tempest-AbsoluteLimitsTests-1423203935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-60ec0165-f7e1-424e-a1e1-bb64a604ac2e" returned: 0 in 0.294s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:19 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-159fe8b2-a6b2-432b-8741-83543a76d2b5 tempest-AbsoluteLimitsTests-1423203935 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:17:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-159fe8b2-a6b2-432b-8741-83543a76d2b5 tempest-AbsoluteLimitsTests-1423203935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:19 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-159fe8b2-a6b2-432b-8741-83543a76d2b5 tempest-AbsoluteLimitsTests-1423203935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c9ff58d-ac20-4511-ac4f-e9a0001a71e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60ec0165-f7e1-424e-a1e1-bb64a604ac2e', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:19 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-159fe8b2-a6b2-432b-8741-83543a76d2b5 tempest-AbsoluteLimitsTests-1423203935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4460f8b3-d6ed-41c5-a348-ce8769c348b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:19 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-159fe8b2-a6b2-432b-8741-83543a76d2b5 tempest-AbsoluteLimitsTests-1423203935 None] Volume volume-60ec0165-f7e1-424e-a1e1-bb64a604ac2e (60ec0165-f7e1-424e-a1e1-bb64a604ac2e): created successfully
Nov 04 12:17:19 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-159fe8b2-a6b2-432b-8741-83543a76d2b5 tempest-AbsoluteLimitsTests-1423203935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4460f8b3-d6ed-41c5-a348-ce8769c348b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:19 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-159fe8b2-a6b2-432b-8741-83543a76d2b5 tempest-AbsoluteLimitsTests-1423203935 None] Flow 'volume_create_manager' (56cbac7f-4845-4a7b-a046-65d0bdbae8a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:17:19 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-159fe8b2-a6b2-432b-8741-83543a76d2b5 tempest-AbsoluteLimitsTests-1423203935 None] Created volume successfully.
Nov 04 12:17:19 devstack sudo[97498]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5a27fa2c-59c7-4050-8cca-86bff20a9b4b tempest-AttachVolumeTestJSON-852332315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cd3ba824-b061-44a7-852f-f28e924bea18" returned: 0 in 0.279s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5a27fa2c-59c7-4050-8cca-86bff20a9b4b tempest-AttachVolumeTestJSON-852332315 None] Lock "cinder-quobyte-cd3ba824-b061-44a7-852f-f28e924bea18" released by "delete_volume" :: held 0.828s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:17:19 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-5a27fa2c-59c7-4050-8cca-86bff20a9b4b tempest-AttachVolumeTestJSON-852332315 None] Created reservations ['c9e7311a-0c33-4bcd-a800-0c4734e19b77', '9a9fa372-35f8-45ed-a1be-123af9761dce', '67186e4f-c97d-4dbe-9cff-a6e207eb74ff', '7d4dece9-0234-4464-a1a6-b140611aa9e0'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:17:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5a27fa2c-59c7-4050-8cca-86bff20a9b4b tempest-AttachVolumeTestJSON-852332315 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:17:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5a27fa2c-59c7-4050-8cca-86bff20a9b4b tempest-AttachVolumeTestJSON-852332315 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:17:19 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5a27fa2c-59c7-4050-8cca-86bff20a9b4b tempest-AttachVolumeTestJSON-852332315 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:17:19 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5a27fa2c-59c7-4050-8cca-86bff20a9b4b tempest-AttachVolumeTestJSON-852332315 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:17:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5a27fa2c-59c7-4050-8cca-86bff20a9b4b tempest-AttachVolumeTestJSON-852332315 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5a27fa2c-59c7-4050-8cca-86bff20a9b4b tempest-AttachVolumeTestJSON-852332315 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:19 devstack sudo[97502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:17:19 devstack sudo[97502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:19 devstack sudo[97502]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5a27fa2c-59c7-4050-8cca-86bff20a9b4b tempest-AttachVolumeTestJSON-852332315 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.278s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:19 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-5a27fa2c-59c7-4050-8cca-86bff20a9b4b tempest-AttachVolumeTestJSON-852332315 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:17:19 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-5a27fa2c-59c7-4050-8cca-86bff20a9b4b tempest-AttachVolumeTestJSON-852332315 None] Deleted volume successfully.
Nov 04 12:17:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5a27fa2c-59c7-4050-8cca-86bff20a9b4b tempest-AttachVolumeTestJSON-852332315 None] Lock "cinder-cd3ba824-b061-44a7-852f-f28e924bea18-delete_volume" released by "delete_volume" :: held 1.343s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:17:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f1297e4d-0a84-443f-8cbf-7f3a7bd89d5c tempest-AbsoluteLimitsTests-1423203935 None] Acquiring lock "cinder-60ec0165-f7e1-424e-a1e1-bb64a604ac2e-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:17:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f1297e4d-0a84-443f-8cbf-7f3a7bd89d5c tempest-AbsoluteLimitsTests-1423203935 None] Lock "cinder-60ec0165-f7e1-424e-a1e1-bb64a604ac2e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:17:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f1297e4d-0a84-443f-8cbf-7f3a7bd89d5c tempest-AbsoluteLimitsTests-1423203935 None] Acquiring lock "cinder-quobyte-60ec0165-f7e1-424e-a1e1-bb64a604ac2e" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:17:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f1297e4d-0a84-443f-8cbf-7f3a7bd89d5c tempest-AbsoluteLimitsTests-1423203935 None] Lock "cinder-quobyte-60ec0165-f7e1-424e-a1e1-bb64a604ac2e" acquired by "delete_volume" :: waited 0.020s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:17:21 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5b2b59-0669-40a6-98c4-2aef9f8e6838]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:17:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f1297e4d-0a84-443f-8cbf-7f3a7bd89d5c tempest-AbsoluteLimitsTests-1423203935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-60ec0165-f7e1-424e-a1e1-bb64a604ac2e {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:21 devstack sudo[97507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-60ec0165-f7e1-424e-a1e1-bb64a604ac2e
Nov 04 12:17:21 devstack sudo[97507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:21 devstack sudo[97507]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f1297e4d-0a84-443f-8cbf-7f3a7bd89d5c tempest-AbsoluteLimitsTests-1423203935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-60ec0165-f7e1-424e-a1e1-bb64a604ac2e" returned: 0 in 0.378s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f1297e4d-0a84-443f-8cbf-7f3a7bd89d5c tempest-AbsoluteLimitsTests-1423203935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-60ec0165-f7e1-424e-a1e1-bb64a604ac2e {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:21 devstack sudo[97512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-60ec0165-f7e1-424e-a1e1-bb64a604ac2e
Nov 04 12:17:21 devstack sudo[97512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:21 devstack sudo[97512]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f1297e4d-0a84-443f-8cbf-7f3a7bd89d5c tempest-AbsoluteLimitsTests-1423203935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-60ec0165-f7e1-424e-a1e1-bb64a604ac2e" returned: 0 in 0.314s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:21 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f1297e4d-0a84-443f-8cbf-7f3a7bd89d5c tempest-AbsoluteLimitsTests-1423203935 None] Lock "cinder-quobyte-60ec0165-f7e1-424e-a1e1-bb64a604ac2e" released by "delete_volume" :: held 0.749s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:17:21 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-f1297e4d-0a84-443f-8cbf-7f3a7bd89d5c tempest-AbsoluteLimitsTests-1423203935 None] Created reservations ['2f78b763-3596-4844-87d1-a75bdc8c0e15', '092c0122-e21c-42af-9ca9-024e53577adf', '4a441792-4a2f-4117-a5fa-7efd4211635e', 'c34ccce5-ccbe-42ca-b0eb-0628b66fe5a1'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:17:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f1297e4d-0a84-443f-8cbf-7f3a7bd89d5c tempest-AbsoluteLimitsTests-1423203935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:17:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f1297e4d-0a84-443f-8cbf-7f3a7bd89d5c tempest-AbsoluteLimitsTests-1423203935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:17:21 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f1297e4d-0a84-443f-8cbf-7f3a7bd89d5c tempest-AbsoluteLimitsTests-1423203935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:17:21 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f1297e4d-0a84-443f-8cbf-7f3a7bd89d5c tempest-AbsoluteLimitsTests-1423203935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:17:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f1297e4d-0a84-443f-8cbf-7f3a7bd89d5c tempest-AbsoluteLimitsTests-1423203935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f1297e4d-0a84-443f-8cbf-7f3a7bd89d5c tempest-AbsoluteLimitsTests-1423203935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:21 devstack sudo[97516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:17:21 devstack sudo[97516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:22 devstack sudo[97516]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f1297e4d-0a84-443f-8cbf-7f3a7bd89d5c tempest-AbsoluteLimitsTests-1423203935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.299s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:22 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-f1297e4d-0a84-443f-8cbf-7f3a7bd89d5c tempest-AbsoluteLimitsTests-1423203935 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:17:22 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-f1297e4d-0a84-443f-8cbf-7f3a7bd89d5c tempest-AbsoluteLimitsTests-1423203935 None] Deleted volume successfully.
Nov 04 12:17:22 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f1297e4d-0a84-443f-8cbf-7f3a7bd89d5c tempest-AbsoluteLimitsTests-1423203935 None] Lock "cinder-60ec0165-f7e1-424e-a1e1-bb64a604ac2e-delete_volume" released by "delete_volume" :: held 1.297s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:17:23 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:17:24 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Flow 'volume_create_manager' (f3da17fc-4bc1-4c37-bc05-439dc2de7507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:17:24 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cabe47e5-a76c-4802-8865-2b9f03c26a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:24 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cabe47e5-a76c-4802-8865-2b9f03c26a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2d6c52c-ac41-4680-b90a-20697faff2db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b281a60a5a0487f9842b609dee6a1ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:24Z,use_quota=True,user_id='afc31113c1b949e489af01b36f432eca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:24 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24ca9fe7-145b-4acf-9101-c1f67fc24261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:24 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24ca9fe7-145b-4acf-9101-c1f67fc24261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:24 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59e1d626-81a4-4f92-a321-39122e2ba4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:24 devstack cinder-volume[87169]: DEBUG cinder.image.glance [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Creating Keystone auth plugin from conf {{(pid=87169) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 04 12:17:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59e1d626-81a4-4f92-a321-39122e2ba4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c2d6c52c-ac41-4680-b90a-20697faff2db', 'volume_name': 'volume-c2d6c52c-ac41-4680-b90a-20697faff2db', 'volume_size': 1, 'image_id': '4843ee03-3eb0-46e8-8f25-c936083c55b5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4843ee03-3eb0-46e8-8f25-c936083c55b5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '84df4fc124c4ec58f01d3cc58123cda8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0b281a60a5a0487f9842b609dee6a1ce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7580cf8fc409458d438f9666caf06ee3f19a6ca5ded131e1dfad978e2d9efc12fdab3b8ebba1c2ba1a1d09f22fa69250b8954fd24b759e6ce5f7a9e2c002006c', 'id': '4843ee03-3eb0-46e8-8f25-c936083c55b5', 'created_at': datetime.datetime(2026, 11, 4, 11, 17, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 17, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4843ee03-3eb0-46e8-8f25-c936083c55b5/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cc0636eff20>}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd4d16ad-10e0-4c52-86f2-3f1e738ffa2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd4d16ad-10e0-4c52-86f2-3f1e738ffa2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e8c71bb-951d-4a60-9107-a2286992929a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:25 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Volume c2d6c52c-ac41-4680-b90a-20697faff2db: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c2d6c52c-ac41-4680-b90a-20697faff2db', 'volume_size': 1, 'image_id': '4843ee03-3eb0-46e8-8f25-c936083c55b5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4843ee03-3eb0-46e8-8f25-c936083c55b5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '84df4fc124c4ec58f01d3cc58123cda8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0b281a60a5a0487f9842b609dee6a1ce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7580cf8fc409458d438f9666caf06ee3f19a6ca5ded131e1dfad978e2d9efc12fdab3b8ebba1c2ba1a1d09f22fa69250b8954fd24b759e6ce5f7a9e2c002006c', 'id': '4843ee03-3eb0-46e8-8f25-c936083c55b5', 'created_at': datetime.datetime(2026, 11, 4, 11, 17, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 17, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4843ee03-3eb0-46e8-8f25-c936083c55b5/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cc0636eff20>}
Nov 04 12:17:25 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Trying to clone c2d6c52c-ac41-4680-b90a-20697faff2db from image 4843ee03-3eb0-46e8-8f25-c936083c55b5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4843ee03-3eb0-46e8-8f25-c936083c55b5', 'metadata': {}}]). {{(pid=87169) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 04 12:17:25 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4843ee03-3eb0-46e8-8f25-c936083c55b5__9c685a7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87169) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 04 12:17:25 devstack cinder-volume[87169]: INFO cinder.image.image_utils [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Image download 0.00 MB at 0.00 MB/s
Nov 04 12:17:25 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3e992a-b6f8-4b45-9d18-5a6d698f0fbe]: (4, 'raw') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:17:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4843ee03-3eb0-46e8-8f25-c936083c55b5__9c685a7devstack@QuobyteHD {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:25 devstack sudo[97520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4843ee03-3eb0-46e8-8f25-c936083c55b5__9c685a7devstack@QuobyteHD
Nov 04 12:17:25 devstack sudo[97520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:25 devstack sudo[97520]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4843ee03-3eb0-46e8-8f25-c936083c55b5__9c685a7devstack@QuobyteHD" returned: 0 in 0.418s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4843ee03-3eb0-46e8-8f25-c936083c55b5__9c685a7devstack@QuobyteHD {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:25 devstack sudo[97524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4843ee03-3eb0-46e8-8f25-c936083c55b5__9c685a7devstack@QuobyteHD
Nov 04 12:17:25 devstack sudo[97524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:26 devstack sudo[97524]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4843ee03-3eb0-46e8-8f25-c936083c55b5__9c685a7devstack@QuobyteHD" returned: 1 in 0.422s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4843ee03-3eb0-46e8-8f25-c936083c55b5__9c685a7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 12:17:26 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Temporary image 4843ee03-3eb0-46e8-8f25-c936083c55b5 is fetched for user afc31113c1b949e489af01b36f432eca. {{(pid=87169) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 04 12:17:26 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[e270e356-a5b6-4dd2-96a9-3851bc4aea1b]: (4, 'raw') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:17:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4843ee03-3eb0-46e8-8f25-c936083c55b5__9c685a7devstack@QuobyteHD {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:26 devstack sudo[97529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4843ee03-3eb0-46e8-8f25-c936083c55b5__9c685a7devstack@QuobyteHD
Nov 04 12:17:26 devstack sudo[97529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:26 devstack sudo[97529]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4843ee03-3eb0-46e8-8f25-c936083c55b5__9c685a7devstack@QuobyteHD" returned: 0 in 0.369s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4843ee03-3eb0-46e8-8f25-c936083c55b5__9c685a7devstack@QuobyteHD {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:26 devstack sudo[97533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4843ee03-3eb0-46e8-8f25-c936083c55b5__9c685a7devstack@QuobyteHD
Nov 04 12:17:26 devstack sudo[97533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:26 devstack sudo[97533]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4843ee03-3eb0-46e8-8f25-c936083c55b5__9c685a7devstack@QuobyteHD" returned: 1 in 0.364s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4843ee03-3eb0-46e8-8f25-c936083c55b5__9c685a7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 12:17:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:17:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:17:26 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2d6c52c-ac41-4680-b90a-20697faff2db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b281a60a5a0487f9842b609dee6a1ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:24Z,use_quota=True,user_id='afc31113c1b949e489af01b36f432eca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:17:26 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Creating volume c2d6c52c-ac41-4680-b90a-20697faff2db {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:17:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:17:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:17:27 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:17:27 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:17:27 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:27 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:17:27 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:17:27 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c2d6c52c-ac41-4680-b90a-20697faff2db 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:27 devstack sudo[97538]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c2d6c52c-ac41-4680-b90a-20697faff2db 1073741824
Nov 04 12:17:27 devstack sudo[97538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:27 devstack sudo[97538]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:27 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c2d6c52c-ac41-4680-b90a-20697faff2db 1073741824" returned: 0 in 0.499s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:27 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c2d6c52c-ac41-4680-b90a-20697faff2db {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:27 devstack sudo[97544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c2d6c52c-ac41-4680-b90a-20697faff2db
Nov 04 12:17:27 devstack sudo[97544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:27 devstack sudo[97544]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:27 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c2d6c52c-ac41-4680-b90a-20697faff2db" returned: 0 in 0.265s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:27 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:17:27 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:27 devstack cinder-volume[87169]: DEBUG cinder.volume.volume_utils [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Attempting download of 4843ee03-3eb0-46e8-8f25-c936083c55b5 ((None, [{'url': 'file:///opt/stack/data/glance/images/4843ee03-3eb0-46e8-8f25-c936083c55b5', 'metadata': {}}])) to volume c2d6c52c-ac41-4680-b90a-20697faff2db. {{(pid=87169) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 04 12:17:27 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[a559c391-fe79-40f5-89d2-b10b04ef4930]: (4, 'raw') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:17:27 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4843ee03-3eb0-46e8-8f25-c936083c55b5_7fmaxcpb {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:28 devstack sudo[97547]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4843ee03-3eb0-46e8-8f25-c936083c55b5_7fmaxcpb
Nov 04 12:17:28 devstack sudo[97547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:28 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccc01a59-0f12-4b87-8604-32b4d324843f tempest-VolumesCloneTest-1338521444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:17:28 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ccc01a59-0f12-4b87-8604-32b4d324843f tempest-VolumesCloneTest-1338521444 None] Flow 'volume_create_manager' (5e76c034-4149-461e-a1c5-7bfd89f41f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:17:28 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ccc01a59-0f12-4b87-8604-32b4d324843f tempest-VolumesCloneTest-1338521444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f12444d5-2065-4747-8429-48e00e26971f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:28 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ccc01a59-0f12-4b87-8604-32b4d324843f tempest-VolumesCloneTest-1338521444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f12444d5-2065-4747-8429-48e00e26971f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1447424597',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=807d13bd-3eee-40bd-a7a7-f327bbca1504,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9577f6b7e1544c3483661e0743ed0fc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:28Z,use_quota=True,user_id='49d380127cf54193b0b477121e230f47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:28 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ccc01a59-0f12-4b87-8604-32b4d324843f tempest-VolumesCloneTest-1338521444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f82e1e8-eed9-46f9-b0cd-651e96d3804c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:28 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ccc01a59-0f12-4b87-8604-32b4d324843f tempest-VolumesCloneTest-1338521444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f82e1e8-eed9-46f9-b0cd-651e96d3804c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:28 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ccc01a59-0f12-4b87-8604-32b4d324843f tempest-VolumesCloneTest-1338521444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (280411c9-238f-438b-9739-ad9a0d27f987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:28 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ccc01a59-0f12-4b87-8604-32b4d324843f tempest-VolumesCloneTest-1338521444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (280411c9-238f-438b-9739-ad9a0d27f987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '807d13bd-3eee-40bd-a7a7-f327bbca1504', 'volume_name': 'volume-807d13bd-3eee-40bd-a7a7-f327bbca1504', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:28 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ccc01a59-0f12-4b87-8604-32b4d324843f tempest-VolumesCloneTest-1338521444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e777596-5093-441d-8e87-e0af4008d3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:28 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ccc01a59-0f12-4b87-8604-32b4d324843f tempest-VolumesCloneTest-1338521444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e777596-5093-441d-8e87-e0af4008d3f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:28 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ccc01a59-0f12-4b87-8604-32b4d324843f tempest-VolumesCloneTest-1338521444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a98527d0-f36a-4ee1-a653-de3c8cf9d607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:28 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-ccc01a59-0f12-4b87-8604-32b4d324843f tempest-VolumesCloneTest-1338521444 None] Volume 807d13bd-3eee-40bd-a7a7-f327bbca1504: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-807d13bd-3eee-40bd-a7a7-f327bbca1504', 'volume_size': 1}
Nov 04 12:17:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ccc01a59-0f12-4b87-8604-32b4d324843f tempest-VolumesCloneTest-1338521444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:17:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ccc01a59-0f12-4b87-8604-32b4d324843f tempest-VolumesCloneTest-1338521444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:17:28 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ccc01a59-0f12-4b87-8604-32b4d324843f tempest-VolumesCloneTest-1338521444 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:17:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1447424597',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=807d13bd-3eee-40bd-a7a7-f327bbca1504,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9577f6b7e1544c3483661e0743ed0fc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:28Z,use_quota=True,user_id='49d380127cf54193b0b477121e230f47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:17:28 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-ccc01a59-0f12-4b87-8604-32b4d324843f tempest-VolumesCloneTest-1338521444 None] Creating volume 807d13bd-3eee-40bd-a7a7-f327bbca1504 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:17:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ccc01a59-0f12-4b87-8604-32b4d324843f tempest-VolumesCloneTest-1338521444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:17:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ccc01a59-0f12-4b87-8604-32b4d324843f tempest-VolumesCloneTest-1338521444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:17:28 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ccc01a59-0f12-4b87-8604-32b4d324843f tempest-VolumesCloneTest-1338521444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:17:28 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ccc01a59-0f12-4b87-8604-32b4d324843f tempest-VolumesCloneTest-1338521444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:17:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ccc01a59-0f12-4b87-8604-32b4d324843f tempest-VolumesCloneTest-1338521444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:28 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ccc01a59-0f12-4b87-8604-32b4d324843f tempest-VolumesCloneTest-1338521444 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:17:28 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-ccc01a59-0f12-4b87-8604-32b4d324843f tempest-VolumesCloneTest-1338521444 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:17:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ccc01a59-0f12-4b87-8604-32b4d324843f tempest-VolumesCloneTest-1338521444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:28 devstack sudo[97551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504 1073741824
Nov 04 12:17:28 devstack sudo[97551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:28 devstack sudo[97547]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4843ee03-3eb0-46e8-8f25-c936083c55b5_7fmaxcpb" returned: 0 in 0.366s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4843ee03-3eb0-46e8-8f25-c936083c55b5_7fmaxcpb {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:28 devstack sudo[97555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4843ee03-3eb0-46e8-8f25-c936083c55b5_7fmaxcpb
Nov 04 12:17:28 devstack sudo[97555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:28 devstack sudo[97551]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ccc01a59-0f12-4b87-8604-32b4d324843f tempest-VolumesCloneTest-1338521444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504 1073741824" returned: 0 in 0.522s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:28 devstack sudo[97555]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4843ee03-3eb0-46e8-8f25-c936083c55b5_7fmaxcpb" returned: 1 in 0.428s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4843ee03-3eb0-46e8-8f25-c936083c55b5_7fmaxcpb' failed. Not Retrying. {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 12:17:28 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c03c8f-d986-40b2-b29d-e65a51ad70e5]: (4, 'raw') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:17:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4843ee03-3eb0-46e8-8f25-c936083c55b5__9c685a7devstack@QuobyteHD {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ccc01a59-0f12-4b87-8604-32b4d324843f tempest-VolumesCloneTest-1338521444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:28 devstack sudo[97564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504
Nov 04 12:17:28 devstack sudo[97564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:28 devstack sudo[97563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4843ee03-3eb0-46e8-8f25-c936083c55b5__9c685a7devstack@QuobyteHD
Nov 04 12:17:28 devstack sudo[97563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:29 devstack sudo[97564]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ccc01a59-0f12-4b87-8604-32b4d324843f tempest-VolumesCloneTest-1338521444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504" returned: 0 in 0.368s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ccc01a59-0f12-4b87-8604-32b4d324843f tempest-VolumesCloneTest-1338521444 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ccc01a59-0f12-4b87-8604-32b4d324843f tempest-VolumesCloneTest-1338521444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ccc01a59-0f12-4b87-8604-32b4d324843f tempest-VolumesCloneTest-1338521444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a98527d0-f36a-4ee1-a653-de3c8cf9d607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-807d13bd-3eee-40bd-a7a7-f327bbca1504', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ccc01a59-0f12-4b87-8604-32b4d324843f tempest-VolumesCloneTest-1338521444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34704929-8ed8-4d7a-86f1-66c195b7b0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:29 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-ccc01a59-0f12-4b87-8604-32b4d324843f tempest-VolumesCloneTest-1338521444 None] Volume volume-807d13bd-3eee-40bd-a7a7-f327bbca1504 (807d13bd-3eee-40bd-a7a7-f327bbca1504): created successfully
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ccc01a59-0f12-4b87-8604-32b4d324843f tempest-VolumesCloneTest-1338521444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34704929-8ed8-4d7a-86f1-66c195b7b0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ccc01a59-0f12-4b87-8604-32b4d324843f tempest-VolumesCloneTest-1338521444 None] Flow 'volume_create_manager' (5e76c034-4149-461e-a1c5-7bfd89f41f8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:17:29 devstack sudo[97563]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4843ee03-3eb0-46e8-8f25-c936083c55b5__9c685a7devstack@QuobyteHD" returned: 0 in 0.545s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4843ee03-3eb0-46e8-8f25-c936083c55b5__9c685a7devstack@QuobyteHD {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-547567e7-50c1-4156-acdf-cbce896f1c90 tempest-AttachVolumeNegativeTest-1447430610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-547567e7-50c1-4156-acdf-cbce896f1c90 tempest-AttachVolumeNegativeTest-1447430610 None] Flow 'volume_create_manager' (1e5a42da-cb71-46b5-9731-6532d0f01b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-547567e7-50c1-4156-acdf-cbce896f1c90 tempest-AttachVolumeNegativeTest-1447430610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22878c6c-e3d3-437a-8e3c-c19f7ceacfc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:29 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-ccc01a59-0f12-4b87-8604-32b4d324843f tempest-VolumesCloneTest-1338521444 None] Created volume successfully.
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-547567e7-50c1-4156-acdf-cbce896f1c90 tempest-AttachVolumeNegativeTest-1447430610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22878c6c-e3d3-437a-8e3c-c19f7ceacfc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-281538286',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9b3a6c6-a1a0-41e4-95d2-0a48273d0ab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c984da2769343719eed28765103c79e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:29Z,use_quota=True,user_id='952c91a30ef946e08ee0498a11ff1a91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-547567e7-50c1-4156-acdf-cbce896f1c90 tempest-AttachVolumeNegativeTest-1447430610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b6f0897-73b5-4c7f-a4e0-c4a8c65feba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-547567e7-50c1-4156-acdf-cbce896f1c90 tempest-AttachVolumeNegativeTest-1447430610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b6f0897-73b5-4c7f-a4e0-c4a8c65feba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-547567e7-50c1-4156-acdf-cbce896f1c90 tempest-AttachVolumeNegativeTest-1447430610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a96cf20-03d5-4fd2-b0c8-3f586e4cc4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-547567e7-50c1-4156-acdf-cbce896f1c90 tempest-AttachVolumeNegativeTest-1447430610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a96cf20-03d5-4fd2-b0c8-3f586e4cc4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9b3a6c6-a1a0-41e4-95d2-0a48273d0ab7', 'volume_name': 'volume-d9b3a6c6-a1a0-41e4-95d2-0a48273d0ab7', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-547567e7-50c1-4156-acdf-cbce896f1c90 tempest-AttachVolumeNegativeTest-1447430610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d615a392-e3c8-4979-959b-c8f318084563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-547567e7-50c1-4156-acdf-cbce896f1c90 tempest-AttachVolumeNegativeTest-1447430610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d615a392-e3c8-4979-959b-c8f318084563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-547567e7-50c1-4156-acdf-cbce896f1c90 tempest-AttachVolumeNegativeTest-1447430610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e101fa8d-645b-4964-ba43-fdea13254bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:29 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-547567e7-50c1-4156-acdf-cbce896f1c90 tempest-AttachVolumeNegativeTest-1447430610 None] Volume d9b3a6c6-a1a0-41e4-95d2-0a48273d0ab7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9b3a6c6-a1a0-41e4-95d2-0a48273d0ab7', 'volume_size': 1}
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-547567e7-50c1-4156-acdf-cbce896f1c90 tempest-AttachVolumeNegativeTest-1447430610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-547567e7-50c1-4156-acdf-cbce896f1c90 tempest-AttachVolumeNegativeTest-1447430610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-547567e7-50c1-4156-acdf-cbce896f1c90 tempest-AttachVolumeNegativeTest-1447430610 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-281538286',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9b3a6c6-a1a0-41e4-95d2-0a48273d0ab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c984da2769343719eed28765103c79e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:29Z,use_quota=True,user_id='952c91a30ef946e08ee0498a11ff1a91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-547567e7-50c1-4156-acdf-cbce896f1c90 tempest-AttachVolumeNegativeTest-1447430610 None] Creating volume d9b3a6c6-a1a0-41e4-95d2-0a48273d0ab7 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-547567e7-50c1-4156-acdf-cbce896f1c90 tempest-AttachVolumeNegativeTest-1447430610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-547567e7-50c1-4156-acdf-cbce896f1c90 tempest-AttachVolumeNegativeTest-1447430610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-547567e7-50c1-4156-acdf-cbce896f1c90 tempest-AttachVolumeNegativeTest-1447430610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-547567e7-50c1-4156-acdf-cbce896f1c90 tempest-AttachVolumeNegativeTest-1447430610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-547567e7-50c1-4156-acdf-cbce896f1c90 tempest-AttachVolumeNegativeTest-1447430610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-547567e7-50c1-4156-acdf-cbce896f1c90 tempest-AttachVolumeNegativeTest-1447430610 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:17:29 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-547567e7-50c1-4156-acdf-cbce896f1c90 tempest-AttachVolumeNegativeTest-1447430610 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-547567e7-50c1-4156-acdf-cbce896f1c90 tempest-AttachVolumeNegativeTest-1447430610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d9b3a6c6-a1a0-41e4-95d2-0a48273d0ab7 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:29 devstack sudo[97571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4843ee03-3eb0-46e8-8f25-c936083c55b5__9c685a7devstack@QuobyteHD
Nov 04 12:17:29 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:29 devstack sudo[97573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d9b3a6c6-a1a0-41e4-95d2-0a48273d0ab7 1073741824
Nov 04 12:17:29 devstack sudo[97573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [req-a91e8314-ca9b-4c48-b7ed-417339fc7abc req-293eec34-68a8-4311-be7f-63b48c3719b6 tempest-VolumesSnapshotsTestJSON-1415999267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-a91e8314-ca9b-4c48-b7ed-417339fc7abc req-293eec34-68a8-4311-be7f-63b48c3719b6 tempest-VolumesSnapshotsTestJSON-1415999267 None] Flow 'volume_create_manager' (6ba3ef34-289a-4b03-ac6c-136c0b1365a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-a91e8314-ca9b-4c48-b7ed-417339fc7abc req-293eec34-68a8-4311-be7f-63b48c3719b6 tempest-VolumesSnapshotsTestJSON-1415999267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48c7b191-46fe-4449-bab9-051ad2c88874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-a91e8314-ca9b-4c48-b7ed-417339fc7abc req-293eec34-68a8-4311-be7f-63b48c3719b6 tempest-VolumesSnapshotsTestJSON-1415999267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48c7b191-46fe-4449-bab9-051ad2c88874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-872832903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3094459-19c2-451a-b308-7d8e4b326e60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78988b1b4fa64bc69d871916ebd840e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:29Z,use_quota=True,user_id='93f5ac7cb40541b195f589d397421fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-a91e8314-ca9b-4c48-b7ed-417339fc7abc req-293eec34-68a8-4311-be7f-63b48c3719b6 tempest-VolumesSnapshotsTestJSON-1415999267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4cf5e2a-7cd4-40b9-8ddf-73be88c2b9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-a91e8314-ca9b-4c48-b7ed-417339fc7abc req-293eec34-68a8-4311-be7f-63b48c3719b6 tempest-VolumesSnapshotsTestJSON-1415999267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4cf5e2a-7cd4-40b9-8ddf-73be88c2b9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-a91e8314-ca9b-4c48-b7ed-417339fc7abc req-293eec34-68a8-4311-be7f-63b48c3719b6 tempest-VolumesSnapshotsTestJSON-1415999267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91984b28-c63c-4042-a76c-535a3bc3e182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-a91e8314-ca9b-4c48-b7ed-417339fc7abc req-293eec34-68a8-4311-be7f-63b48c3719b6 tempest-VolumesSnapshotsTestJSON-1415999267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91984b28-c63c-4042-a76c-535a3bc3e182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3094459-19c2-451a-b308-7d8e4b326e60', 'volume_name': 'volume-c3094459-19c2-451a-b308-7d8e4b326e60', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-a91e8314-ca9b-4c48-b7ed-417339fc7abc req-293eec34-68a8-4311-be7f-63b48c3719b6 tempest-VolumesSnapshotsTestJSON-1415999267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d98f4cba-0fc4-40bc-9918-797f157b3cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-a91e8314-ca9b-4c48-b7ed-417339fc7abc req-293eec34-68a8-4311-be7f-63b48c3719b6 tempest-VolumesSnapshotsTestJSON-1415999267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d98f4cba-0fc4-40bc-9918-797f157b3cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-a91e8314-ca9b-4c48-b7ed-417339fc7abc req-293eec34-68a8-4311-be7f-63b48c3719b6 tempest-VolumesSnapshotsTestJSON-1415999267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7448b520-b938-411c-8442-029ef9f18e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:29 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [req-a91e8314-ca9b-4c48-b7ed-417339fc7abc req-293eec34-68a8-4311-be7f-63b48c3719b6 tempest-VolumesSnapshotsTestJSON-1415999267 None] Volume c3094459-19c2-451a-b308-7d8e4b326e60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3094459-19c2-451a-b308-7d8e4b326e60', 'volume_size': 1}
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-a91e8314-ca9b-4c48-b7ed-417339fc7abc req-293eec34-68a8-4311-be7f-63b48c3719b6 tempest-VolumesSnapshotsTestJSON-1415999267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:17:29 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4843ee03-3eb0-46e8-8f25-c936083c55b5__9c685a7devstack@QuobyteHD" returned: 1 in 0.359s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4843ee03-3eb0-46e8-8f25-c936083c55b5__9c685a7devstack@QuobyteHD' failed. Not Retrying. {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] 4843ee03-3eb0-46e8-8f25-c936083c55b5 was raw, converting to qcow2 {{(pid=87169) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4843ee03-3eb0-46e8-8f25-c936083c55b5__9c685a7devstack@QuobyteHD /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c2d6c52c-ac41-4680-b90a-20697faff2db {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:29 devstack sudo[97581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4843ee03-3eb0-46e8-8f25-c936083c55b5__9c685a7devstack@QuobyteHD /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c2d6c52c-ac41-4680-b90a-20697faff2db
Nov 04 12:17:29 devstack sudo[97581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:29 devstack sudo[97573]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-547567e7-50c1-4156-acdf-cbce896f1c90 tempest-AttachVolumeNegativeTest-1447430610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d9b3a6c6-a1a0-41e4-95d2-0a48273d0ab7 1073741824" returned: 0 in 0.437s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-547567e7-50c1-4156-acdf-cbce896f1c90 tempest-AttachVolumeNegativeTest-1447430610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d9b3a6c6-a1a0-41e4-95d2-0a48273d0ab7 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:29 devstack sudo[97585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d9b3a6c6-a1a0-41e4-95d2-0a48273d0ab7
Nov 04 12:17:29 devstack sudo[97585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:30 devstack sudo[97581]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4843ee03-3eb0-46e8-8f25-c936083c55b5__9c685a7devstack@QuobyteHD /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c2d6c52c-ac41-4680-b90a-20697faff2db" returned: 0 in 0.462s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:30 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4843ee03-3eb0-46e8-8f25-c936083c55b5__9c685a7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c2d6c52c-ac41-4680-b90a-20697faff2db {{(pid=87169) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 12:17:30 devstack cinder-volume[87169]: INFO cinder.image.image_utils [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Converted 0.00 MB image at 0.00 MB/s
Nov 04 12:17:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c2d6c52c-ac41-4680-b90a-20697faff2db 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:30 devstack sudo[97585]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-547567e7-50c1-4156-acdf-cbce896f1c90 tempest-AttachVolumeNegativeTest-1447430610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d9b3a6c6-a1a0-41e4-95d2-0a48273d0ab7" returned: 0 in 0.258s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:30 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-547567e7-50c1-4156-acdf-cbce896f1c90 tempest-AttachVolumeNegativeTest-1447430610 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:17:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-547567e7-50c1-4156-acdf-cbce896f1c90 tempest-AttachVolumeNegativeTest-1447430610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-a91e8314-ca9b-4c48-b7ed-417339fc7abc req-293eec34-68a8-4311-be7f-63b48c3719b6 tempest-VolumesSnapshotsTestJSON-1415999267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.625s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:17:30 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [req-a91e8314-ca9b-4c48-b7ed-417339fc7abc req-293eec34-68a8-4311-be7f-63b48c3719b6 tempest-VolumesSnapshotsTestJSON-1415999267 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:17:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-872832903',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3094459-19c2-451a-b308-7d8e4b326e60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78988b1b4fa64bc69d871916ebd840e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:29Z,use_quota=True,user_id='93f5ac7cb40541b195f589d397421fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:17:30 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [req-a91e8314-ca9b-4c48-b7ed-417339fc7abc req-293eec34-68a8-4311-be7f-63b48c3719b6 tempest-VolumesSnapshotsTestJSON-1415999267 None] Creating volume c3094459-19c2-451a-b308-7d8e4b326e60 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:17:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-a91e8314-ca9b-4c48-b7ed-417339fc7abc req-293eec34-68a8-4311-be7f-63b48c3719b6 tempest-VolumesSnapshotsTestJSON-1415999267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:17:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-a91e8314-ca9b-4c48-b7ed-417339fc7abc req-293eec34-68a8-4311-be7f-63b48c3719b6 tempest-VolumesSnapshotsTestJSON-1415999267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:17:30 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [req-a91e8314-ca9b-4c48-b7ed-417339fc7abc req-293eec34-68a8-4311-be7f-63b48c3719b6 tempest-VolumesSnapshotsTestJSON-1415999267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:17:30 devstack sudo[97591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c2d6c52c-ac41-4680-b90a-20697faff2db 1G
Nov 04 12:17:30 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [req-a91e8314-ca9b-4c48-b7ed-417339fc7abc req-293eec34-68a8-4311-be7f-63b48c3719b6 tempest-VolumesSnapshotsTestJSON-1415999267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:17:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-a91e8314-ca9b-4c48-b7ed-417339fc7abc req-293eec34-68a8-4311-be7f-63b48c3719b6 tempest-VolumesSnapshotsTestJSON-1415999267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:30 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [req-a91e8314-ca9b-4c48-b7ed-417339fc7abc req-293eec34-68a8-4311-be7f-63b48c3719b6 tempest-VolumesSnapshotsTestJSON-1415999267 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:17:30 devstack sudo[97591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:30 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [req-a91e8314-ca9b-4c48-b7ed-417339fc7abc req-293eec34-68a8-4311-be7f-63b48c3719b6 tempest-VolumesSnapshotsTestJSON-1415999267 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:17:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-a91e8314-ca9b-4c48-b7ed-417339fc7abc req-293eec34-68a8-4311-be7f-63b48c3719b6 tempest-VolumesSnapshotsTestJSON-1415999267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:30 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:UPDATE=162,cinder:SELECT=125,cinder:INSERT=36,cinder:DELETE=16 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:17:30 devstack sudo[97593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60 1073741824
Nov 04 12:17:30 devstack sudo[97593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-547567e7-50c1-4156-acdf-cbce896f1c90 tempest-AttachVolumeNegativeTest-1447430610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e101fa8d-645b-4964-ba43-fdea13254bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9b3a6c6-a1a0-41e4-95d2-0a48273d0ab7', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-547567e7-50c1-4156-acdf-cbce896f1c90 tempest-AttachVolumeNegativeTest-1447430610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (561e6729-44a9-4496-8b15-dc1a55ca1e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:30 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-547567e7-50c1-4156-acdf-cbce896f1c90 tempest-AttachVolumeNegativeTest-1447430610 None] Volume volume-d9b3a6c6-a1a0-41e4-95d2-0a48273d0ab7 (d9b3a6c6-a1a0-41e4-95d2-0a48273d0ab7): created successfully
Nov 04 12:17:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-547567e7-50c1-4156-acdf-cbce896f1c90 tempest-AttachVolumeNegativeTest-1447430610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (561e6729-44a9-4496-8b15-dc1a55ca1e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-547567e7-50c1-4156-acdf-cbce896f1c90 tempest-AttachVolumeNegativeTest-1447430610 None] Flow 'volume_create_manager' (1e5a42da-cb71-46b5-9731-6532d0f01b62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:17:30 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-547567e7-50c1-4156-acdf-cbce896f1c90 tempest-AttachVolumeNegativeTest-1447430610 None] Created volume successfully.
Nov 04 12:17:30 devstack sudo[97591]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c2d6c52c-ac41-4680-b90a-20697faff2db 1G" returned: 0 in 0.460s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:30 devstack cinder-volume[87169]: DEBUG cinder.volume.volume_utils [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Downloaded image 4843ee03-3eb0-46e8-8f25-c936083c55b5 ((None, [{'url': 'file:///opt/stack/data/glance/images/4843ee03-3eb0-46e8-8f25-c936083c55b5', 'metadata': {}}])) to volume c2d6c52c-ac41-4680-b90a-20697faff2db successfully. {{(pid=87169) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 04 12:17:30 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Temporary image 4843ee03-3eb0-46e8-8f25-c936083c55b5 for user afc31113c1b949e489af01b36f432eca is deleted. {{(pid=87169) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 04 12:17:30 devstack cinder-volume[87169]: DEBUG cinder.volume.volume_utils [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Marking volume c2d6c52c-ac41-4680-b90a-20697faff2db as bootable. {{(pid=87169) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 04 12:17:30 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Copying metadata from image 4843ee03-3eb0-46e8-8f25-c936083c55b5 to c2d6c52c-ac41-4680-b90a-20697faff2db. {{(pid=87169) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 04 12:17:30 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Creating volume glance metadata for volume c2d6c52c-ac41-4680-b90a-20697faff2db backed by image 4843ee03-3eb0-46e8-8f25-c936083c55b5 with: {'image_id': '4843ee03-3eb0-46e8-8f25-c936083c55b5', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '84df4fc124c4ec58f01d3cc58123cda8', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87169) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 04 12:17:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e8c71bb-951d-4a60-9107-a2286992929a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2d6c52c-ac41-4680-b90a-20697faff2db', 'volume_size': 1, 'image_id': '4843ee03-3eb0-46e8-8f25-c936083c55b5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4843ee03-3eb0-46e8-8f25-c936083c55b5', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '84df4fc124c4ec58f01d3cc58123cda8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0b281a60a5a0487f9842b609dee6a1ce', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7580cf8fc409458d438f9666caf06ee3f19a6ca5ded131e1dfad978e2d9efc12fdab3b8ebba1c2ba1a1d09f22fa69250b8954fd24b759e6ce5f7a9e2c002006c', 'id': '4843ee03-3eb0-46e8-8f25-c936083c55b5', 'created_at': datetime.datetime(2026, 11, 4, 11, 17, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 17, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4843ee03-3eb0-46e8-8f25-c936083c55b5/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cc0636eff20>}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25ee8cba-d054-418d-813c-88ad185b8da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:30 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Volume volume-c2d6c52c-ac41-4680-b90a-20697faff2db (c2d6c52c-ac41-4680-b90a-20697faff2db): created successfully
Nov 04 12:17:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25ee8cba-d054-418d-813c-88ad185b8da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Flow 'volume_create_manager' (f3da17fc-4bc1-4c37-bc05-439dc2de7507) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:17:30 devstack sudo[97593]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-a91e8314-ca9b-4c48-b7ed-417339fc7abc req-293eec34-68a8-4311-be7f-63b48c3719b6 tempest-VolumesSnapshotsTestJSON-1415999267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60 1073741824" returned: 0 in 0.622s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:30 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-16242ae5-c58f-46f5-9f56-412d234e042e tempest-VolumeImageDependencyTests-103528878 None] Created volume successfully.
Nov 04 12:17:30 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:17:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-a91e8314-ca9b-4c48-b7ed-417339fc7abc req-293eec34-68a8-4311-be7f-63b48c3719b6 tempest-VolumesSnapshotsTestJSON-1415999267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:30 devstack sudo[97637]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60
Nov 04 12:17:30 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Flow 'volume_create_manager' (0b810837-6d91-4921-9c70-9a823363a1fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:17:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb75564-7628-41c2-b673-183a8651d5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb75564-7628-41c2-b673-183a8651d5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:17:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1518674289',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ef8f25a-e1dc-4197-98bf-bf05dd514b87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9577f6b7e1544c3483661e0743ed0fc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=807d13bd-3eee-40bd-a7a7-f327bbca1504,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:31Z,use_quota=True,user_id='49d380127cf54193b0b477121e230f47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (591151d6-15ea-4517-8120-2cb1cdaec6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (591151d6-15ea-4517-8120-2cb1cdaec6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e6c1694-1488-4215-bcf0-5eb456a90721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e6c1694-1488-4215-bcf0-5eb456a90721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9ef8f25a-e1dc-4197-98bf-bf05dd514b87', 'volume_name': 'volume-9ef8f25a-e1dc-4197-98bf-bf05dd514b87', 'volume_size': 2, 'source_volid': '807d13bd-3eee-40bd-a7a7-f327bbca1504', 'source_volstatus': 'available'}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1728f937-1d2e-4275-983a-1462bc8904c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1728f937-1d2e-4275-983a-1462bc8904c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d01eb51-dee7-43eb-9989-7c19f9a97ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:30 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Volume 9ef8f25a-e1dc-4197-98bf-bf05dd514b87: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9ef8f25a-e1dc-4197-98bf-bf05dd514b87', 'volume_size': 2, 'source_volid': '807d13bd-3eee-40bd-a7a7-f327bbca1504', 'source_volstatus': 'available'}
Nov 04 12:17:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:17:31 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-a91e8314-ca9b-4c48-b7ed-417339fc7abc req-293eec34-68a8-4311-be7f-63b48c3719b6 tempest-VolumesSnapshotsTestJSON-1415999267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60" returned: 0 in 0.272s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:31 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [req-a91e8314-ca9b-4c48-b7ed-417339fc7abc req-293eec34-68a8-4311-be7f-63b48c3719b6 tempest-VolumesSnapshotsTestJSON-1415999267 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:17:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-a91e8314-ca9b-4c48-b7ed-417339fc7abc req-293eec34-68a8-4311-be7f-63b48c3719b6 tempest-VolumesSnapshotsTestJSON-1415999267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.104s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:17:31 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Cloning volume 807d13bd-3eee-40bd-a7a7-f327bbca1504 to volume 9ef8f25a-e1dc-4197-98bf-bf05dd514b87
Nov 04 12:17:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-a91e8314-ca9b-4c48-b7ed-417339fc7abc req-293eec34-68a8-4311-be7f-63b48c3719b6 tempest-VolumesSnapshotsTestJSON-1415999267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7448b520-b938-411c-8442-029ef9f18e87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3094459-19c2-451a-b308-7d8e4b326e60', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-a91e8314-ca9b-4c48-b7ed-417339fc7abc req-293eec34-68a8-4311-be7f-63b48c3719b6 tempest-VolumesSnapshotsTestJSON-1415999267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59b8ccdc-49a3-4d3e-a3af-de439648ff69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:31 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [req-a91e8314-ca9b-4c48-b7ed-417339fc7abc req-293eec34-68a8-4311-be7f-63b48c3719b6 tempest-VolumesSnapshotsTestJSON-1415999267 None] Volume volume-c3094459-19c2-451a-b308-7d8e4b326e60 (c3094459-19c2-451a-b308-7d8e4b326e60): created successfully
Nov 04 12:17:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-a91e8314-ca9b-4c48-b7ed-417339fc7abc req-293eec34-68a8-4311-be7f-63b48c3719b6 tempest-VolumesSnapshotsTestJSON-1415999267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59b8ccdc-49a3-4d3e-a3af-de439648ff69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-a91e8314-ca9b-4c48-b7ed-417339fc7abc req-293eec34-68a8-4311-be7f-63b48c3719b6 tempest-VolumesSnapshotsTestJSON-1415999267 None] Flow 'volume_create_manager' (6ba3ef34-289a-4b03-ac6c-136c0b1365a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:17:31 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Creating offline snapshot 470dd27d-edcf-4b36-afdb-430e5999da89 of volume 807d13bd-3eee-40bd-a7a7-f327bbca1504 {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:17:31 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-a91e8314-ca9b-4c48-b7ed-417339fc7abc req-293eec34-68a8-4311-be7f-63b48c3719b6 tempest-VolumesSnapshotsTestJSON-1415999267 None] Created volume successfully.
Nov 04 12:17:31 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[478d1c43-3f67-4fe6-8a10-9b6e7728ffa0]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:17:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:31 devstack sudo[97646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504
Nov 04 12:17:31 devstack sudo[97646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-e46a1152-4d8e-4f3a-bbe2-f7b1be7cfd8d req-ebc2c8fc-146c-468f-a819-e3144392a102 tempest-VolumesSnapshotsTestJSON-1415999267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:17:31 devstack sudo[97646]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504" returned: 0 in 0.469s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504.470dd27d-edcf-4b36-afdb-430e5999da89 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:31 devstack sudo[97651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504.470dd27d-edcf-4b36-afdb-430e5999da89 1G
Nov 04 12:17:31 devstack sudo[97651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:31 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1cb98fbc-ebee-436b-999a-d74a2ede1a6f tempest-VolumeImageDependencyTests-103528878 None] Acquiring lock "cinder-c2d6c52c-ac41-4680-b90a-20697faff2db-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:17:31 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1cb98fbc-ebee-436b-999a-d74a2ede1a6f tempest-VolumeImageDependencyTests-103528878 None] Lock "cinder-c2d6c52c-ac41-4680-b90a-20697faff2db-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:17:31 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1cb98fbc-ebee-436b-999a-d74a2ede1a6f tempest-VolumeImageDependencyTests-103528878 None] Acquiring lock "cinder-quobyte-c2d6c52c-ac41-4680-b90a-20697faff2db" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:17:31 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1cb98fbc-ebee-436b-999a-d74a2ede1a6f tempest-VolumeImageDependencyTests-103528878 None] Lock "cinder-quobyte-c2d6c52c-ac41-4680-b90a-20697faff2db" acquired by "delete_volume" :: waited 0.019s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:17:32 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3661c6f-7fba-45d7-a081-93ef9f620f1d]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:17:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1cb98fbc-ebee-436b-999a-d74a2ede1a6f tempest-VolumeImageDependencyTests-103528878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c2d6c52c-ac41-4680-b90a-20697faff2db {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:32 devstack sudo[97664]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c2d6c52c-ac41-4680-b90a-20697faff2db
Nov 04 12:17:32 devstack sudo[97664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-2b4693b2-548b-4a64-a493-97cf95cd6b09 req-5da3408d-19ea-44d0-995a-e26e23ebcd74 tempest-AttachVolumeNegativeTest-1447430610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:17:32 devstack sudo[97651]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504.470dd27d-edcf-4b36-afdb-430e5999da89 1G" returned: 0 in 0.570s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-807d13bd-3eee-40bd-a7a7-f327bbca1504 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504.470dd27d-edcf-4b36-afdb-430e5999da89 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:32 devstack sudo[97673]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-807d13bd-3eee-40bd-a7a7-f327bbca1504 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504.470dd27d-edcf-4b36-afdb-430e5999da89
Nov 04 12:17:32 devstack sudo[97673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:32 devstack sudo[97664]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1cb98fbc-ebee-436b-999a-d74a2ede1a6f tempest-VolumeImageDependencyTests-103528878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c2d6c52c-ac41-4680-b90a-20697faff2db" returned: 0 in 0.416s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1cb98fbc-ebee-436b-999a-d74a2ede1a6f tempest-VolumeImageDependencyTests-103528878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c2d6c52c-ac41-4680-b90a-20697faff2db {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:32 devstack sudo[97678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c2d6c52c-ac41-4680-b90a-20697faff2db
Nov 04 12:17:32 devstack sudo[97678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:32 devstack sudo[97673]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-807d13bd-3eee-40bd-a7a7-f327bbca1504 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504.470dd27d-edcf-4b36-afdb-430e5999da89" returned: 0 in 0.289s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:32 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504.470dd27d-edcf-4b36-afdb-430e5999da89 is being set with open permissions: ugo+rw
Nov 04 12:17:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504.470dd27d-edcf-4b36-afdb-430e5999da89 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:32 devstack sudo[97683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504.470dd27d-edcf-4b36-afdb-430e5999da89
Nov 04 12:17:32 devstack sudo[97683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:32 devstack sudo[97678]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1cb98fbc-ebee-436b-999a-d74a2ede1a6f tempest-VolumeImageDependencyTests-103528878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c2d6c52c-ac41-4680-b90a-20697faff2db" returned: 0 in 0.276s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:32 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1cb98fbc-ebee-436b-999a-d74a2ede1a6f tempest-VolumeImageDependencyTests-103528878 None] Lock "cinder-quobyte-c2d6c52c-ac41-4680-b90a-20697faff2db" released by "delete_volume" :: held 0.750s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:17:32 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-1cb98fbc-ebee-436b-999a-d74a2ede1a6f tempest-VolumeImageDependencyTests-103528878 None] Created reservations ['c75f2253-eea9-442c-ab18-21774b9da051', 'a63de419-c074-40cf-93c1-e44696ff52a2', 'd3e88539-ab34-466b-a517-2ce46153f69c', '79d56864-78f4-4908-8c0f-a3a5f05503d8'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:17:32 devstack sudo[97683]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504.470dd27d-edcf-4b36-afdb-430e5999da89" returned: 0 in 0.271s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:32 devstack sudo[97687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504.info
Nov 04 12:17:32 devstack sudo[97687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1cb98fbc-ebee-436b-999a-d74a2ede1a6f tempest-VolumeImageDependencyTests-103528878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:17:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1cb98fbc-ebee-436b-999a-d74a2ede1a6f tempest-VolumeImageDependencyTests-103528878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:17:32 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1cb98fbc-ebee-436b-999a-d74a2ede1a6f tempest-VolumeImageDependencyTests-103528878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:17:32 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1cb98fbc-ebee-436b-999a-d74a2ede1a6f tempest-VolumeImageDependencyTests-103528878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:17:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1cb98fbc-ebee-436b-999a-d74a2ede1a6f tempest-VolumeImageDependencyTests-103528878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1cb98fbc-ebee-436b-999a-d74a2ede1a6f tempest-VolumeImageDependencyTests-103528878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:32 devstack sudo[97689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:17:32 devstack sudo[97689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:33 devstack sudo[97687]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504.info" returned: 0 in 0.281s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:33 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504.info is being set with open permissions: ugo+rw
Nov 04 12:17:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:33 devstack sudo[97689]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:33 devstack sudo[97693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504.info
Nov 04 12:17:33 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1cb98fbc-ebee-436b-999a-d74a2ede1a6f tempest-VolumeImageDependencyTests-103528878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.272s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:33 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-1cb98fbc-ebee-436b-999a-d74a2ede1a6f tempest-VolumeImageDependencyTests-103528878 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:17:33 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-1cb98fbc-ebee-436b-999a-d74a2ede1a6f tempest-VolumeImageDependencyTests-103528878 None] Deleted volume successfully.
Nov 04 12:17:33 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1cb98fbc-ebee-436b-999a-d74a2ede1a6f tempest-VolumeImageDependencyTests-103528878 None] Lock "cinder-c2d6c52c-ac41-4680-b90a-20697faff2db-delete_volume" released by "delete_volume" :: held 1.339s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:17:33 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504.info" returned: 0 in 0.249s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:33 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Acquiring lock "cinder-quobyte-9ef8f25a-e1dc-4197-98bf-bf05dd514b87" by "_copy_volume_from_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:17:33 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Lock "cinder-quobyte-9ef8f25a-e1dc-4197-98bf-bf05dd514b87" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:17:33 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] snapshot: 470dd27d-edcf-4b36-afdb-430e5999da89, volume: 9ef8f25a-e1dc-4197-98bf-bf05dd514b87,  {{(pid=87169) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 04 12:17:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:17:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:17:33 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:17:33 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:17:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:33 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d70a8b5-1e18-4463-8b22-4ae6e55ff432]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:17:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504.470dd27d-edcf-4b36-afdb-430e5999da89 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:33 devstack sudo[97696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504.470dd27d-edcf-4b36-afdb-430e5999da89
Nov 04 12:17:33 devstack sudo[97696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:33 devstack sudo[97696]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504.470dd27d-edcf-4b36-afdb-430e5999da89" returned: 0 in 0.384s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:33 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-807d13bd-3eee-40bd-a7a7-f327bbca1504(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:17:33 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9602cfa-a3c0-4bcb-aaef-296616dd2fb9]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:17:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:33 devstack sudo[97701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504
Nov 04 12:17:33 devstack sudo[97701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:34 devstack sudo[97701]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504" returned: 0 in 0.437s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:34 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504 {{(pid=87169) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 04 12:17:34 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Creating direct copy from snapshot {{(pid=87169) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 04 12:17:34 devstack cinder-volume[87169]: DEBUG cinder.utils [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Path /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9ef8f25a-e1dc-4197-98bf-bf05dd514b87 not found in is_blk_device check {{(pid=87169) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 04 12:17:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9ef8f25a-e1dc-4197-98bf-bf05dd514b87 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:34 devstack sudo[97706]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9ef8f25a-e1dc-4197-98bf-bf05dd514b87
Nov 04 12:17:34 devstack sudo[97706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:37 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac2e55d0-4c32-4cb6-a3a5-fd07185b691b tempest-CinderUnicodeTest-786383852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:17:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ac2e55d0-4c32-4cb6-a3a5-fd07185b691b tempest-CinderUnicodeTest-786383852 None] Flow 'volume_create_manager' (c949a11b-2899-4e70-95b5-512f7c079fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:17:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ac2e55d0-4c32-4cb6-a3a5-fd07185b691b tempest-CinderUnicodeTest-786383852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a740d2f-f00b-4c6d-972a-ba323f16be91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ac2e55d0-4c32-4cb6-a3a5-fd07185b691b tempest-CinderUnicodeTest-786383852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a740d2f-f00b-4c6d-972a-ba323f16be91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=216b474d-94fb-45d5-9e5a-e511d8b485b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ce2af113e2d4d05a081551562402fd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:38Z,use_quota=True,user_id='2cbde06fa7af4cbca4a0625e7c661a19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ac2e55d0-4c32-4cb6-a3a5-fd07185b691b tempest-CinderUnicodeTest-786383852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a68cefad-0e87-428f-acd7-a96f80252ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ac2e55d0-4c32-4cb6-a3a5-fd07185b691b tempest-CinderUnicodeTest-786383852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a68cefad-0e87-428f-acd7-a96f80252ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ac2e55d0-4c32-4cb6-a3a5-fd07185b691b tempest-CinderUnicodeTest-786383852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcda0d24-7e42-4965-ad01-206f2d49389a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ac2e55d0-4c32-4cb6-a3a5-fd07185b691b tempest-CinderUnicodeTest-786383852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcda0d24-7e42-4965-ad01-206f2d49389a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '216b474d-94fb-45d5-9e5a-e511d8b485b8', 'volume_name': 'volume-216b474d-94fb-45d5-9e5a-e511d8b485b8', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ac2e55d0-4c32-4cb6-a3a5-fd07185b691b tempest-CinderUnicodeTest-786383852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2954de51-18b5-4fd3-9a38-7938769507d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ac2e55d0-4c32-4cb6-a3a5-fd07185b691b tempest-CinderUnicodeTest-786383852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2954de51-18b5-4fd3-9a38-7938769507d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ac2e55d0-4c32-4cb6-a3a5-fd07185b691b tempest-CinderUnicodeTest-786383852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (107f501a-7535-406f-8aca-adabc2810556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:37 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-ac2e55d0-4c32-4cb6-a3a5-fd07185b691b tempest-CinderUnicodeTest-786383852 None] Volume 216b474d-94fb-45d5-9e5a-e511d8b485b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-216b474d-94fb-45d5-9e5a-e511d8b485b8', 'volume_size': 1}
Nov 04 12:17:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ac2e55d0-4c32-4cb6-a3a5-fd07185b691b tempest-CinderUnicodeTest-786383852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:17:40 devstack sudo[97706]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9ef8f25a-e1dc-4197-98bf-bf05dd514b87" returned: 0 in 6.545s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:40 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Image conversion details: src /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504, size 1024.00 MB, duration 6.55 sec, destination /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9ef8f25a-e1dc-4197-98bf-bf05dd514b87 {{(pid=87169) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 12:17:40 devstack cinder-volume[87169]: INFO cinder.image.image_utils [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Converted 1024.00 MB image at 156.42 MB/s
Nov 04 12:17:40 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9ef8f25a-e1dc-4197-98bf-bf05dd514b87 is being set with open permissions: ugo+rw
Nov 04 12:17:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9ef8f25a-e1dc-4197-98bf-bf05dd514b87 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:40 devstack sudo[97720]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9ef8f25a-e1dc-4197-98bf-bf05dd514b87
Nov 04 12:17:40 devstack sudo[97720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:41 devstack sudo[97720]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9ef8f25a-e1dc-4197-98bf-bf05dd514b87" returned: 0 in 0.243s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:41 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Lock "cinder-quobyte-9ef8f25a-e1dc-4197-98bf-bf05dd514b87" released by "_copy_volume_from_snapshot" :: held 7.683s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:17:41 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Acquiring lock "cinder-quobyte-470dd27d-edcf-4b36-afdb-430e5999da89" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:17:41 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Lock "cinder-quobyte-470dd27d-edcf-4b36-afdb-430e5999da89" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:17:41 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Deleting offline snapshot 470dd27d-edcf-4b36-afdb-430e5999da89 of volume 807d13bd-3eee-40bd-a7a7-f327bbca1504 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:17:41 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] snapshot_file for this snap is: volume-807d13bd-3eee-40bd-a7a7-f327bbca1504.470dd27d-edcf-4b36-afdb-430e5999da89 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:17:41 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[771e01f3-20ca-4505-b9e9-9755606fcd91]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:17:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504.470dd27d-edcf-4b36-afdb-430e5999da89 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:41 devstack sudo[97724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504.470dd27d-edcf-4b36-afdb-430e5999da89
Nov 04 12:17:41 devstack sudo[97724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:41 devstack sudo[97724]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504.470dd27d-edcf-4b36-afdb-430e5999da89" returned: 0 in 0.357s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:41 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-807d13bd-3eee-40bd-a7a7-f327bbca1504(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:17:41 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02898f2-cd4d-4fd0-9ac5-77ff0ca500db]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:17:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:41 devstack sudo[97729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504
Nov 04 12:17:41 devstack sudo[97729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:42 devstack sudo[97729]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504" returned: 0 in 0.534s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504.470dd27d-edcf-4b36-afdb-430e5999da89 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:42 devstack sudo[97734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504.470dd27d-edcf-4b36-afdb-430e5999da89
Nov 04 12:17:42 devstack sudo[97734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:42 devstack sudo[97734]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504.470dd27d-edcf-4b36-afdb-430e5999da89" returned: 0 in 0.318s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504.470dd27d-edcf-4b36-afdb-430e5999da89 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:42 devstack sudo[97740]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504.470dd27d-edcf-4b36-afdb-430e5999da89
Nov 04 12:17:42 devstack sudo[97740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:42 devstack sudo[97740]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504.470dd27d-edcf-4b36-afdb-430e5999da89" returned: 0 in 0.243s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:42 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Lock "cinder-quobyte-470dd27d-edcf-4b36-afdb-430e5999da89" released by "_delete_snapshot" :: held 1.544s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:17:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.610s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-e46a1152-4d8e-4f3a-bbe2-f7b1be7cfd8d req-ebc2c8fc-146c-468f-a819-e3144392a102 tempest-VolumesSnapshotsTestJSON-1415999267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.117s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:17:42 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [req-e46a1152-4d8e-4f3a-bbe2-f7b1be7cfd8d req-ebc2c8fc-146c-468f-a819-e3144392a102 tempest-VolumesSnapshotsTestJSON-1415999267 None] Creating offline snapshot 9ab0323e-d746-4006-82ae-6bea8cb62d14 of volume c3094459-19c2-451a-b308-7d8e4b326e60 {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:17:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d01eb51-dee7-43eb-9989-7c19f9a97ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ef8f25a-e1dc-4197-98bf-bf05dd514b87', 'volume_size': 2, 'source_volid': '807d13bd-3eee-40bd-a7a7-f327bbca1504', 'source_volstatus': 'available'}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8834f6dc-ae8a-4309-8392-de679ad51024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:42 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cf6bb1-a138-4743-b2f5-a903b15f648b]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:17:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-e46a1152-4d8e-4f3a-bbe2-f7b1be7cfd8d req-ebc2c8fc-146c-468f-a819-e3144392a102 tempest-VolumesSnapshotsTestJSON-1415999267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:42 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Volume volume-9ef8f25a-e1dc-4197-98bf-bf05dd514b87 (9ef8f25a-e1dc-4197-98bf-bf05dd514b87): created successfully
Nov 04 12:17:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8834f6dc-ae8a-4309-8392-de679ad51024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Flow 'volume_create_manager' (0b810837-6d91-4921-9c70-9a823363a1fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:17:42 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-d009e4c1-38b1-4332-96e5-dc71fb29da59 tempest-VolumesCloneTest-1338521444 None] Created volume successfully.
Nov 04 12:17:42 devstack sudo[97743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60
Nov 04 12:17:42 devstack sudo[97743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:43 devstack sudo[97743]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-e46a1152-4d8e-4f3a-bbe2-f7b1be7cfd8d req-ebc2c8fc-146c-468f-a819-e3144392a102 tempest-VolumesSnapshotsTestJSON-1415999267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60" returned: 0 in 0.361s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-e46a1152-4d8e-4f3a-bbe2-f7b1be7cfd8d req-ebc2c8fc-146c-468f-a819-e3144392a102 tempest-VolumesSnapshotsTestJSON-1415999267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60.9ab0323e-d746-4006-82ae-6bea8cb62d14 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:43 devstack sudo[97748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60.9ab0323e-d746-4006-82ae-6bea8cb62d14 1G
Nov 04 12:17:43 devstack sudo[97748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:43 devstack sudo[97748]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-e46a1152-4d8e-4f3a-bbe2-f7b1be7cfd8d req-ebc2c8fc-146c-468f-a819-e3144392a102 tempest-VolumesSnapshotsTestJSON-1415999267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60.9ab0323e-d746-4006-82ae-6bea8cb62d14 1G" returned: 0 in 0.378s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-e46a1152-4d8e-4f3a-bbe2-f7b1be7cfd8d req-ebc2c8fc-146c-468f-a819-e3144392a102 tempest-VolumesSnapshotsTestJSON-1415999267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3094459-19c2-451a-b308-7d8e4b326e60 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60.9ab0323e-d746-4006-82ae-6bea8cb62d14 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:43 devstack sudo[97753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3094459-19c2-451a-b308-7d8e4b326e60 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60.9ab0323e-d746-4006-82ae-6bea8cb62d14
Nov 04 12:17:43 devstack sudo[97753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:43 devstack sudo[97753]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-e46a1152-4d8e-4f3a-bbe2-f7b1be7cfd8d req-ebc2c8fc-146c-468f-a819-e3144392a102 tempest-VolumesSnapshotsTestJSON-1415999267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3094459-19c2-451a-b308-7d8e4b326e60 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60.9ab0323e-d746-4006-82ae-6bea8cb62d14" returned: 0 in 0.280s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:43 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [req-e46a1152-4d8e-4f3a-bbe2-f7b1be7cfd8d req-ebc2c8fc-146c-468f-a819-e3144392a102 tempest-VolumesSnapshotsTestJSON-1415999267 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60.9ab0323e-d746-4006-82ae-6bea8cb62d14 is being set with open permissions: ugo+rw
Nov 04 12:17:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-e46a1152-4d8e-4f3a-bbe2-f7b1be7cfd8d req-ebc2c8fc-146c-468f-a819-e3144392a102 tempest-VolumesSnapshotsTestJSON-1415999267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60.9ab0323e-d746-4006-82ae-6bea8cb62d14 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:43 devstack sudo[97758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60.9ab0323e-d746-4006-82ae-6bea8cb62d14
Nov 04 12:17:43 devstack sudo[97758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:44 devstack sudo[97758]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-e46a1152-4d8e-4f3a-bbe2-f7b1be7cfd8d req-ebc2c8fc-146c-468f-a819-e3144392a102 tempest-VolumesSnapshotsTestJSON-1415999267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60.9ab0323e-d746-4006-82ae-6bea8cb62d14" returned: 0 in 0.236s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-e46a1152-4d8e-4f3a-bbe2-f7b1be7cfd8d req-ebc2c8fc-146c-468f-a819-e3144392a102 tempest-VolumesSnapshotsTestJSON-1415999267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:44 devstack sudo[97761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60.info
Nov 04 12:17:44 devstack sudo[97761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:44 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a11c5ea0-55a0-4c50-8954-94afc5121237 tempest-VolumesCloneTest-1338521444 None] Acquiring lock "cinder-9ef8f25a-e1dc-4197-98bf-bf05dd514b87-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:17:44 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a11c5ea0-55a0-4c50-8954-94afc5121237 tempest-VolumesCloneTest-1338521444 None] Lock "cinder-9ef8f25a-e1dc-4197-98bf-bf05dd514b87-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:17:44 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a11c5ea0-55a0-4c50-8954-94afc5121237 tempest-VolumesCloneTest-1338521444 None] Acquiring lock "cinder-quobyte-9ef8f25a-e1dc-4197-98bf-bf05dd514b87" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:17:44 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a11c5ea0-55a0-4c50-8954-94afc5121237 tempest-VolumesCloneTest-1338521444 None] Lock "cinder-quobyte-9ef8f25a-e1dc-4197-98bf-bf05dd514b87" acquired by "delete_volume" :: waited 0.021s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:17:44 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[798b0409-9c13-4070-a878-9d21bcb855bb]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:17:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a11c5ea0-55a0-4c50-8954-94afc5121237 tempest-VolumesCloneTest-1338521444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9ef8f25a-e1dc-4197-98bf-bf05dd514b87 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:44 devstack sudo[97761]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-e46a1152-4d8e-4f3a-bbe2-f7b1be7cfd8d req-ebc2c8fc-146c-468f-a819-e3144392a102 tempest-VolumesSnapshotsTestJSON-1415999267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60.info" returned: 0 in 0.268s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:44 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [req-e46a1152-4d8e-4f3a-bbe2-f7b1be7cfd8d req-ebc2c8fc-146c-468f-a819-e3144392a102 tempest-VolumesSnapshotsTestJSON-1415999267 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60.info is being set with open permissions: ugo+rw
Nov 04 12:17:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-e46a1152-4d8e-4f3a-bbe2-f7b1be7cfd8d req-ebc2c8fc-146c-468f-a819-e3144392a102 tempest-VolumesSnapshotsTestJSON-1415999267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:44 devstack sudo[97765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60.info
Nov 04 12:17:44 devstack sudo[97765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:44 devstack sudo[97764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9ef8f25a-e1dc-4197-98bf-bf05dd514b87
Nov 04 12:17:44 devstack sudo[97764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:44 devstack sudo[97765]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-e46a1152-4d8e-4f3a-bbe2-f7b1be7cfd8d req-ebc2c8fc-146c-468f-a819-e3144392a102 tempest-VolumesSnapshotsTestJSON-1415999267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60.info" returned: 0 in 0.248s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-e46a1152-4d8e-4f3a-bbe2-f7b1be7cfd8d req-ebc2c8fc-146c-468f-a819-e3144392a102 tempest-VolumesSnapshotsTestJSON-1415999267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.872s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-2b4693b2-548b-4a64-a493-97cf95cd6b09 req-5da3408d-19ea-44d0-995a-e26e23ebcd74 tempest-AttachVolumeNegativeTest-1447430610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 12.399s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:17:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-2b4693b2-548b-4a64-a493-97cf95cd6b09 req-5da3408d-19ea-44d0-995a-e26e23ebcd74 tempest-AttachVolumeNegativeTest-1447430610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ac2e55d0-4c32-4cb6-a3a5-fd07185b691b tempest-CinderUnicodeTest-786383852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.798s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:17:44 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ac2e55d0-4c32-4cb6-a3a5-fd07185b691b tempest-CinderUnicodeTest-786383852 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=216b474d-94fb-45d5-9e5a-e511d8b485b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ce2af113e2d4d05a081551562402fd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:38Z,use_quota=True,user_id='2cbde06fa7af4cbca4a0625e7c661a19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:17:44 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-ac2e55d0-4c32-4cb6-a3a5-fd07185b691b tempest-CinderUnicodeTest-786383852 None] Creating volume 216b474d-94fb-45d5-9e5a-e511d8b485b8 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:17:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ac2e55d0-4c32-4cb6-a3a5-fd07185b691b tempest-CinderUnicodeTest-786383852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:17:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ac2e55d0-4c32-4cb6-a3a5-fd07185b691b tempest-CinderUnicodeTest-786383852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:17:44 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ac2e55d0-4c32-4cb6-a3a5-fd07185b691b tempest-CinderUnicodeTest-786383852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:17:44 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ac2e55d0-4c32-4cb6-a3a5-fd07185b691b tempest-CinderUnicodeTest-786383852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:17:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ac2e55d0-4c32-4cb6-a3a5-fd07185b691b tempest-CinderUnicodeTest-786383852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:44 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ac2e55d0-4c32-4cb6-a3a5-fd07185b691b tempest-CinderUnicodeTest-786383852 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:17:44 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-ac2e55d0-4c32-4cb6-a3a5-fd07185b691b tempest-CinderUnicodeTest-786383852 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:17:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ac2e55d0-4c32-4cb6-a3a5-fd07185b691b tempest-CinderUnicodeTest-786383852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-216b474d-94fb-45d5-9e5a-e511d8b485b8 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:44 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-e46a1152-4d8e-4f3a-bbe2-f7b1be7cfd8d req-ebc2c8fc-146c-468f-a819-e3144392a102 tempest-VolumesSnapshotsTestJSON-1415999267 None] Create snapshot completed successfully
Nov 04 12:17:44 devstack sudo[97772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-216b474d-94fb-45d5-9e5a-e511d8b485b8 1073741824
Nov 04 12:17:44 devstack sudo[97772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:44 devstack sudo[97764]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a11c5ea0-55a0-4c50-8954-94afc5121237 tempest-VolumesCloneTest-1338521444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9ef8f25a-e1dc-4197-98bf-bf05dd514b87" returned: 0 in 0.375s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a11c5ea0-55a0-4c50-8954-94afc5121237 tempest-VolumesCloneTest-1338521444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9ef8f25a-e1dc-4197-98bf-bf05dd514b87 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-2b4693b2-548b-4a64-a493-97cf95cd6b09 req-5da3408d-19ea-44d0-995a-e26e23ebcd74 tempest-AttachVolumeNegativeTest-1447430610 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79', 'name': 'volume-d9b3a6c6-a1a0-41e4-95d2-0a48273d0ab7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '99212cb2-3791-431e-bf0b-9d38ff2ee3a3', 'enforce_multipath': True} {{(pid=87169) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 04 12:17:44 devstack sudo[97774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9ef8f25a-e1dc-4197-98bf-bf05dd514b87
Nov 04 12:17:44 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:44 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-2b4693b2-548b-4a64-a493-97cf95cd6b09 req-5da3408d-19ea-44d0-995a-e26e23ebcd74 tempest-AttachVolumeNegativeTest-1447430610 None] attachment_update completed successfully.
Nov 04 12:17:44 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a11c5ea0-55a0-4c50-8954-94afc5121237 tempest-VolumesCloneTest-1338521444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9ef8f25a-e1dc-4197-98bf-bf05dd514b87" returned: 0 in 0.293s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:44 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a11c5ea0-55a0-4c50-8954-94afc5121237 tempest-VolumesCloneTest-1338521444 None] Lock "cinder-quobyte-9ef8f25a-e1dc-4197-98bf-bf05dd514b87" released by "delete_volume" :: held 0.710s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:17:45 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-a11c5ea0-55a0-4c50-8954-94afc5121237 tempest-VolumesCloneTest-1338521444 None] Created reservations ['9027caf0-6b8c-427e-81b6-74342e38631c', '90b2a58b-ab76-4b19-b8de-de3d8b26e13c', '81b91a16-8339-4480-923f-f5d71c4f1727', '6aa67ab2-7ae6-4cf9-9cf2-eb58b7c48658'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:17:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a11c5ea0-55a0-4c50-8954-94afc5121237 tempest-VolumesCloneTest-1338521444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:17:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a11c5ea0-55a0-4c50-8954-94afc5121237 tempest-VolumesCloneTest-1338521444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:17:45 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a11c5ea0-55a0-4c50-8954-94afc5121237 tempest-VolumesCloneTest-1338521444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:17:45 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a11c5ea0-55a0-4c50-8954-94afc5121237 tempest-VolumesCloneTest-1338521444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:17:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a11c5ea0-55a0-4c50-8954-94afc5121237 tempest-VolumesCloneTest-1338521444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a11c5ea0-55a0-4c50-8954-94afc5121237 tempest-VolumesCloneTest-1338521444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:45 devstack sudo[98196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:17:45 devstack sudo[98196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:45 devstack sudo[97772]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ac2e55d0-4c32-4cb6-a3a5-fd07185b691b tempest-CinderUnicodeTest-786383852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-216b474d-94fb-45d5-9e5a-e511d8b485b8 1073741824" returned: 0 in 0.564s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ac2e55d0-4c32-4cb6-a3a5-fd07185b691b tempest-CinderUnicodeTest-786383852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-216b474d-94fb-45d5-9e5a-e511d8b485b8 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:45 devstack sudo[98199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-216b474d-94fb-45d5-9e5a-e511d8b485b8
Nov 04 12:17:45 devstack sudo[98199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:45 devstack cinder-volume[87169]: DEBUG cinder.coordination [req-ea0d1a56-0222-4d8f-9f29-19b200461d8e req-a15e22b9-9e7d-4ae4-843f-d38d9d624359 tempest-VolumesSnapshotsTestJSON-1415999267 None] Acquiring lock "cinder-9ab0323e-d746-4006-82ae-6bea8cb62d14-delete_snapshot" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:17:45 devstack cinder-volume[87169]: DEBUG cinder.coordination [req-ea0d1a56-0222-4d8f-9f29-19b200461d8e req-a15e22b9-9e7d-4ae4-843f-d38d9d624359 tempest-VolumesSnapshotsTestJSON-1415999267 None] Lock "cinder-9ab0323e-d746-4006-82ae-6bea8cb62d14-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:17:45 devstack cinder-volume[87169]: DEBUG cinder.coordination [req-ea0d1a56-0222-4d8f-9f29-19b200461d8e req-a15e22b9-9e7d-4ae4-843f-d38d9d624359 tempest-VolumesSnapshotsTestJSON-1415999267 None] Acquiring lock "cinder-quobyte-c3094459-19c2-451a-b308-7d8e4b326e60" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:17:45 devstack cinder-volume[87169]: DEBUG cinder.coordination [req-ea0d1a56-0222-4d8f-9f29-19b200461d8e req-a15e22b9-9e7d-4ae4-843f-d38d9d624359 tempest-VolumesSnapshotsTestJSON-1415999267 None] Lock "cinder-quobyte-c3094459-19c2-451a-b308-7d8e4b326e60" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:17:45 devstack cinder-volume[87169]: DEBUG cinder.coordination [req-ea0d1a56-0222-4d8f-9f29-19b200461d8e req-a15e22b9-9e7d-4ae4-843f-d38d9d624359 tempest-VolumesSnapshotsTestJSON-1415999267 None] Acquiring lock "cinder-quobyte-9ab0323e-d746-4006-82ae-6bea8cb62d14" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:17:45 devstack cinder-volume[87169]: DEBUG cinder.coordination [req-ea0d1a56-0222-4d8f-9f29-19b200461d8e req-a15e22b9-9e7d-4ae4-843f-d38d9d624359 tempest-VolumesSnapshotsTestJSON-1415999267 None] Lock "cinder-quobyte-9ab0323e-d746-4006-82ae-6bea8cb62d14" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:17:45 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [req-ea0d1a56-0222-4d8f-9f29-19b200461d8e req-a15e22b9-9e7d-4ae4-843f-d38d9d624359 tempest-VolumesSnapshotsTestJSON-1415999267 None] Deleting offline snapshot 9ab0323e-d746-4006-82ae-6bea8cb62d14 of volume c3094459-19c2-451a-b308-7d8e4b326e60 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:17:45 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [req-ea0d1a56-0222-4d8f-9f29-19b200461d8e req-a15e22b9-9e7d-4ae4-843f-d38d9d624359 tempest-VolumesSnapshotsTestJSON-1415999267 None] snapshot_file for this snap is: volume-c3094459-19c2-451a-b308-7d8e4b326e60.9ab0323e-d746-4006-82ae-6bea8cb62d14 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:17:45 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a26c44-ce77-49ae-916c-770618f7b3bd]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:17:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-ea0d1a56-0222-4d8f-9f29-19b200461d8e req-a15e22b9-9e7d-4ae4-843f-d38d9d624359 tempest-VolumesSnapshotsTestJSON-1415999267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60.9ab0323e-d746-4006-82ae-6bea8cb62d14 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:45 devstack sudo[98196]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a11c5ea0-55a0-4c50-8954-94afc5121237 tempest-VolumesCloneTest-1338521444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.355s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:45 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-a11c5ea0-55a0-4c50-8954-94afc5121237 tempest-VolumesCloneTest-1338521444 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:17:45 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-a11c5ea0-55a0-4c50-8954-94afc5121237 tempest-VolumesCloneTest-1338521444 None] Deleted volume successfully.
Nov 04 12:17:45 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e77c73c8-f261-4c44-8007-6ea77535f718 tempest-VolumesCloneTest-1338521444 None] Acquiring lock "cinder-807d13bd-3eee-40bd-a7a7-f327bbca1504-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:17:45 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a11c5ea0-55a0-4c50-8954-94afc5121237 tempest-VolumesCloneTest-1338521444 None] Lock "cinder-9ef8f25a-e1dc-4197-98bf-bf05dd514b87-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:17:45 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e77c73c8-f261-4c44-8007-6ea77535f718 tempest-VolumesCloneTest-1338521444 None] Lock "cinder-807d13bd-3eee-40bd-a7a7-f327bbca1504-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:17:45 devstack sudo[98199]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ac2e55d0-4c32-4cb6-a3a5-fd07185b691b tempest-CinderUnicodeTest-786383852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-216b474d-94fb-45d5-9e5a-e511d8b485b8" returned: 0 in 0.446s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:45 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ac2e55d0-4c32-4cb6-a3a5-fd07185b691b tempest-CinderUnicodeTest-786383852 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:17:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ac2e55d0-4c32-4cb6-a3a5-fd07185b691b tempest-CinderUnicodeTest-786383852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:45 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e77c73c8-f261-4c44-8007-6ea77535f718 tempest-VolumesCloneTest-1338521444 None] Acquiring lock "cinder-quobyte-807d13bd-3eee-40bd-a7a7-f327bbca1504" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:17:45 devstack sudo[98202]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60.9ab0323e-d746-4006-82ae-6bea8cb62d14
Nov 04 12:17:45 devstack sudo[98202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:45 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ac2e55d0-4c32-4cb6-a3a5-fd07185b691b tempest-CinderUnicodeTest-786383852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (107f501a-7535-406f-8aca-adabc2810556) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-216b474d-94fb-45d5-9e5a-e511d8b485b8', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:45 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ac2e55d0-4c32-4cb6-a3a5-fd07185b691b tempest-CinderUnicodeTest-786383852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f79aabf-13d6-4c85-b529-d18f491bdc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:45 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e77c73c8-f261-4c44-8007-6ea77535f718 tempest-VolumesCloneTest-1338521444 None] Lock "cinder-quobyte-807d13bd-3eee-40bd-a7a7-f327bbca1504" acquired by "delete_volume" :: waited 0.038s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:17:45 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-ac2e55d0-4c32-4cb6-a3a5-fd07185b691b tempest-CinderUnicodeTest-786383852 None] Volume volume-216b474d-94fb-45d5-9e5a-e511d8b485b8 (216b474d-94fb-45d5-9e5a-e511d8b485b8): created successfully
Nov 04 12:17:45 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ac2e55d0-4c32-4cb6-a3a5-fd07185b691b tempest-CinderUnicodeTest-786383852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f79aabf-13d6-4c85-b529-d18f491bdc78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:45 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ac2e55d0-4c32-4cb6-a3a5-fd07185b691b tempest-CinderUnicodeTest-786383852 None] Flow 'volume_create_manager' (c949a11b-2899-4e70-95b5-512f7c079fe6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:17:45 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e8ad8e5-d6d6-4d9b-804d-9dba9f00036e]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:17:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e77c73c8-f261-4c44-8007-6ea77535f718 tempest-VolumesCloneTest-1338521444 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:45 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-ac2e55d0-4c32-4cb6-a3a5-fd07185b691b tempest-CinderUnicodeTest-786383852 None] Created volume successfully.
Nov 04 12:17:45 devstack sudo[98205]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504
Nov 04 12:17:45 devstack sudo[98205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:45 devstack sudo[98202]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-ea0d1a56-0222-4d8f-9f29-19b200461d8e req-a15e22b9-9e7d-4ae4-843f-d38d9d624359 tempest-VolumesSnapshotsTestJSON-1415999267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60.9ab0323e-d746-4006-82ae-6bea8cb62d14" returned: 0 in 0.554s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:45 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [req-ea0d1a56-0222-4d8f-9f29-19b200461d8e req-a15e22b9-9e7d-4ae4-843f-d38d9d624359 tempest-VolumesSnapshotsTestJSON-1415999267 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3094459-19c2-451a-b308-7d8e4b326e60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:17:46 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b77dbe1-5e40-41da-9b3e-7b05bd89e125]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:17:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-ea0d1a56-0222-4d8f-9f29-19b200461d8e req-a15e22b9-9e7d-4ae4-843f-d38d9d624359 tempest-VolumesSnapshotsTestJSON-1415999267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:46 devstack sudo[98210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60
Nov 04 12:17:46 devstack sudo[98210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:46 devstack sudo[98205]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e77c73c8-f261-4c44-8007-6ea77535f718 tempest-VolumesCloneTest-1338521444 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504" returned: 0 in 0.388s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e77c73c8-f261-4c44-8007-6ea77535f718 tempest-VolumesCloneTest-1338521444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:46 devstack sudo[98215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504
Nov 04 12:17:46 devstack sudo[98215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:46 devstack sudo[98210]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-ea0d1a56-0222-4d8f-9f29-19b200461d8e req-a15e22b9-9e7d-4ae4-843f-d38d9d624359 tempest-VolumesSnapshotsTestJSON-1415999267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60" returned: 0 in 0.483s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-ea0d1a56-0222-4d8f-9f29-19b200461d8e req-a15e22b9-9e7d-4ae4-843f-d38d9d624359 tempest-VolumesSnapshotsTestJSON-1415999267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60.9ab0323e-d746-4006-82ae-6bea8cb62d14 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:46 devstack sudo[98215]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e77c73c8-f261-4c44-8007-6ea77535f718 tempest-VolumesCloneTest-1338521444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-807d13bd-3eee-40bd-a7a7-f327bbca1504" returned: 0 in 0.374s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:46 devstack sudo[98221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60.9ab0323e-d746-4006-82ae-6bea8cb62d14
Nov 04 12:17:46 devstack sudo[98221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:46 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e77c73c8-f261-4c44-8007-6ea77535f718 tempest-VolumesCloneTest-1338521444 None] Lock "cinder-quobyte-807d13bd-3eee-40bd-a7a7-f327bbca1504" released by "delete_volume" :: held 0.862s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:17:46 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-e77c73c8-f261-4c44-8007-6ea77535f718 tempest-VolumesCloneTest-1338521444 None] Created reservations ['03dffd53-0b07-4395-a8f8-38aa699b8d1a', '49ba1265-3daa-4867-926e-75146f4a9b08', 'f1b8aa59-f0ea-4b9b-b61a-85fe5bffa227', 'efffc7cd-dc7b-41ce-8b33-686715652426'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:17:46 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d277a92-1b46-4e86-885b-827b9ba1bd6c tempest-CinderUnicodeTest-786383852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:17:46 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5d277a92-1b46-4e86-885b-827b9ba1bd6c tempest-CinderUnicodeTest-786383852 None] Flow 'volume_create_manager' (7eecd372-7c53-4a32-a350-f3e122de3b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:17:46 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5d277a92-1b46-4e86-885b-827b9ba1bd6c tempest-CinderUnicodeTest-786383852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d17737e2-5ca6-40df-b3e2-cd215fc56f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:46 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5d277a92-1b46-4e86-885b-827b9ba1bd6c tempest-CinderUnicodeTest-786383852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d17737e2-5ca6-40df-b3e2-cd215fc56f31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:17:46Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1167357841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc82775f-3edd-4bd9-87fd-6bdf8e08ace6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ce2af113e2d4d05a081551562402fd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:47Z,use_quota=True,user_id='2cbde06fa7af4cbca4a0625e7c661a19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:46 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5d277a92-1b46-4e86-885b-827b9ba1bd6c tempest-CinderUnicodeTest-786383852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41a4d0e9-6032-4ee3-be5c-ec4f9a26de37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:46 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5d277a92-1b46-4e86-885b-827b9ba1bd6c tempest-CinderUnicodeTest-786383852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41a4d0e9-6032-4ee3-be5c-ec4f9a26de37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:46 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5d277a92-1b46-4e86-885b-827b9ba1bd6c tempest-CinderUnicodeTest-786383852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edc415f8-5de7-4b70-8420-c29f96f3a66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:46 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5d277a92-1b46-4e86-885b-827b9ba1bd6c tempest-CinderUnicodeTest-786383852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edc415f8-5de7-4b70-8420-c29f96f3a66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc82775f-3edd-4bd9-87fd-6bdf8e08ace6', 'volume_name': 'volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:46 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5d277a92-1b46-4e86-885b-827b9ba1bd6c tempest-CinderUnicodeTest-786383852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0253371-f2ad-4049-b7b2-2526dfa70e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:46 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5d277a92-1b46-4e86-885b-827b9ba1bd6c tempest-CinderUnicodeTest-786383852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0253371-f2ad-4049-b7b2-2526dfa70e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:46 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5d277a92-1b46-4e86-885b-827b9ba1bd6c tempest-CinderUnicodeTest-786383852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02511137-8887-438c-8b07-346f8259bda3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:46 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-5d277a92-1b46-4e86-885b-827b9ba1bd6c tempest-CinderUnicodeTest-786383852 None] Volume cc82775f-3edd-4bd9-87fd-6bdf8e08ace6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6', 'volume_size': 1}
Nov 04 12:17:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5d277a92-1b46-4e86-885b-827b9ba1bd6c tempest-CinderUnicodeTest-786383852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:17:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5d277a92-1b46-4e86-885b-827b9ba1bd6c tempest-CinderUnicodeTest-786383852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:17:46 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5d277a92-1b46-4e86-885b-827b9ba1bd6c tempest-CinderUnicodeTest-786383852 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:17:46Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1167357841',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc82775f-3edd-4bd9-87fd-6bdf8e08ace6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ce2af113e2d4d05a081551562402fd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:47Z,use_quota=True,user_id='2cbde06fa7af4cbca4a0625e7c661a19',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:17:46 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-5d277a92-1b46-4e86-885b-827b9ba1bd6c tempest-CinderUnicodeTest-786383852 None] Creating volume cc82775f-3edd-4bd9-87fd-6bdf8e08ace6 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:17:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5d277a92-1b46-4e86-885b-827b9ba1bd6c tempest-CinderUnicodeTest-786383852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:17:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5d277a92-1b46-4e86-885b-827b9ba1bd6c tempest-CinderUnicodeTest-786383852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:17:46 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5d277a92-1b46-4e86-885b-827b9ba1bd6c tempest-CinderUnicodeTest-786383852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:17:46 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5d277a92-1b46-4e86-885b-827b9ba1bd6c tempest-CinderUnicodeTest-786383852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:17:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5d277a92-1b46-4e86-885b-827b9ba1bd6c tempest-CinderUnicodeTest-786383852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:46 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5d277a92-1b46-4e86-885b-827b9ba1bd6c tempest-CinderUnicodeTest-786383852 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:17:46 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-5d277a92-1b46-4e86-885b-827b9ba1bd6c tempest-CinderUnicodeTest-786383852 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:17:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5d277a92-1b46-4e86-885b-827b9ba1bd6c tempest-CinderUnicodeTest-786383852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:46 devstack sudo[98225]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6 1073741824
Nov 04 12:17:46 devstack sudo[98225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e77c73c8-f261-4c44-8007-6ea77535f718 tempest-VolumesCloneTest-1338521444 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:17:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e77c73c8-f261-4c44-8007-6ea77535f718 tempest-VolumesCloneTest-1338521444 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:17:46 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e77c73c8-f261-4c44-8007-6ea77535f718 tempest-VolumesCloneTest-1338521444 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:17:46 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e77c73c8-f261-4c44-8007-6ea77535f718 tempest-VolumesCloneTest-1338521444 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:17:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e77c73c8-f261-4c44-8007-6ea77535f718 tempest-VolumesCloneTest-1338521444 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e77c73c8-f261-4c44-8007-6ea77535f718 tempest-VolumesCloneTest-1338521444 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:46 devstack sudo[98229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:17:46 devstack sudo[98229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:47 devstack sudo[98221]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-ea0d1a56-0222-4d8f-9f29-19b200461d8e req-a15e22b9-9e7d-4ae4-843f-d38d9d624359 tempest-VolumesSnapshotsTestJSON-1415999267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60.9ab0323e-d746-4006-82ae-6bea8cb62d14" returned: 0 in 0.499s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-ea0d1a56-0222-4d8f-9f29-19b200461d8e req-a15e22b9-9e7d-4ae4-843f-d38d9d624359 tempest-VolumesSnapshotsTestJSON-1415999267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60.9ab0323e-d746-4006-82ae-6bea8cb62d14 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:47 devstack sudo[98231]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60.9ab0323e-d746-4006-82ae-6bea8cb62d14
Nov 04 12:17:47 devstack sudo[98231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:47 devstack sudo[98229]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e77c73c8-f261-4c44-8007-6ea77535f718 tempest-VolumesCloneTest-1338521444 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.303s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:47 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-e77c73c8-f261-4c44-8007-6ea77535f718 tempest-VolumesCloneTest-1338521444 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:17:47 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-e77c73c8-f261-4c44-8007-6ea77535f718 tempest-VolumesCloneTest-1338521444 None] Deleted volume successfully.
Nov 04 12:17:47 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e77c73c8-f261-4c44-8007-6ea77535f718 tempest-VolumesCloneTest-1338521444 None] Lock "cinder-807d13bd-3eee-40bd-a7a7-f327bbca1504-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:17:47 devstack sudo[98231]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-ea0d1a56-0222-4d8f-9f29-19b200461d8e req-a15e22b9-9e7d-4ae4-843f-d38d9d624359 tempest-VolumesSnapshotsTestJSON-1415999267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60.9ab0323e-d746-4006-82ae-6bea8cb62d14" returned: 0 in 0.312s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:47 devstack sudo[98225]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5d277a92-1b46-4e86-885b-827b9ba1bd6c tempest-CinderUnicodeTest-786383852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6 1073741824" returned: 0 in 0.572s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:47 devstack cinder-volume[87169]: DEBUG cinder.coordination [req-ea0d1a56-0222-4d8f-9f29-19b200461d8e req-a15e22b9-9e7d-4ae4-843f-d38d9d624359 tempest-VolumesSnapshotsTestJSON-1415999267 None] Lock "cinder-quobyte-9ab0323e-d746-4006-82ae-6bea8cb62d14" released by "_delete_snapshot" :: held 2.058s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:17:47 devstack cinder-volume[87169]: DEBUG cinder.coordination [req-ea0d1a56-0222-4d8f-9f29-19b200461d8e req-a15e22b9-9e7d-4ae4-843f-d38d9d624359 tempest-VolumesSnapshotsTestJSON-1415999267 None] Lock "cinder-quobyte-c3094459-19c2-451a-b308-7d8e4b326e60" released by "delete_snapshot" :: held 2.135s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:17:47 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-62c386a8-87f6-44af-adae-3467ac03c4a8 req-ce2c0e69-020f-4735-adb6-22b2fecd7266 tempest-AttachVolumeNegativeTest-1447430610 None] Terminate volume connection completed successfully.
Nov 04 12:17:47 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-62c386a8-87f6-44af-adae-3467ac03c4a8 req-ce2c0e69-020f-4735-adb6-22b2fecd7266 tempest-AttachVolumeNegativeTest-1447430610 None] Deleting attachment 99212cb2-3791-431e-bf0b-9d38ff2ee3a3. {{(pid=87169) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 12:17:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5d277a92-1b46-4e86-885b-827b9ba1bd6c tempest-CinderUnicodeTest-786383852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:47 devstack sudo[98265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6
Nov 04 12:17:47 devstack sudo[98265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:47 devstack cinder-volume[87169]: DEBUG cinder.quota [req-ea0d1a56-0222-4d8f-9f29-19b200461d8e req-a15e22b9-9e7d-4ae4-843f-d38d9d624359 tempest-VolumesSnapshotsTestJSON-1415999267 None] Created reservations ['ed2481da-8314-4e1c-bc51-c59cf258e8a4', 'f6f64d0b-335a-4676-89a0-62541c4e973f', '51baf865-0088-4903-8e49-6933313b9aed', '8033925a-88e3-4ede-b413-5497a54fee20'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:17:47 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-ea0d1a56-0222-4d8f-9f29-19b200461d8e req-a15e22b9-9e7d-4ae4-843f-d38d9d624359 tempest-VolumesSnapshotsTestJSON-1415999267 None] Delete snapshot completed successfully.
Nov 04 12:17:47 devstack cinder-volume[87169]: DEBUG cinder.coordination [req-ea0d1a56-0222-4d8f-9f29-19b200461d8e req-a15e22b9-9e7d-4ae4-843f-d38d9d624359 tempest-VolumesSnapshotsTestJSON-1415999267 None] Lock "cinder-9ab0323e-d746-4006-82ae-6bea8cb62d14-delete_snapshot" released by "delete_snapshot" :: held 2.368s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:17:47 devstack sudo[98265]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5d277a92-1b46-4e86-885b-827b9ba1bd6c tempest-CinderUnicodeTest-786383852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6" returned: 0 in 0.315s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:47 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5d277a92-1b46-4e86-885b-827b9ba1bd6c tempest-CinderUnicodeTest-786383852 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:17:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5d277a92-1b46-4e86-885b-827b9ba1bd6c tempest-CinderUnicodeTest-786383852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:47 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5d277a92-1b46-4e86-885b-827b9ba1bd6c tempest-CinderUnicodeTest-786383852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02511137-8887-438c-8b07-346f8259bda3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:47 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5d277a92-1b46-4e86-885b-827b9ba1bd6c tempest-CinderUnicodeTest-786383852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (186c6eeb-6b5d-4ee1-8e3f-b8faa6079424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:47 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-5d277a92-1b46-4e86-885b-827b9ba1bd6c tempest-CinderUnicodeTest-786383852 None] Volume volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6 (cc82775f-3edd-4bd9-87fd-6bdf8e08ace6): created successfully
Nov 04 12:17:47 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5d277a92-1b46-4e86-885b-827b9ba1bd6c tempest-CinderUnicodeTest-786383852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (186c6eeb-6b5d-4ee1-8e3f-b8faa6079424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:47 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5d277a92-1b46-4e86-885b-827b9ba1bd6c tempest-CinderUnicodeTest-786383852 None] Flow 'volume_create_manager' (7eecd372-7c53-4a32-a350-f3e122de3b07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:17:47 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-5d277a92-1b46-4e86-885b-827b9ba1bd6c tempest-CinderUnicodeTest-786383852 None] Created volume successfully.
Nov 04 12:17:48 devstack cinder-volume[87169]: DEBUG cinder.coordination [req-f7768ab1-91e8-44ca-b996-11c808ff3ce7 req-a6a37d56-cf92-4dbe-9b2f-e07e20d39cae tempest-VolumesSnapshotsTestJSON-1415999267 None] Acquiring lock "cinder-c3094459-19c2-451a-b308-7d8e4b326e60-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:17:48 devstack cinder-volume[87169]: DEBUG cinder.coordination [req-f7768ab1-91e8-44ca-b996-11c808ff3ce7 req-a6a37d56-cf92-4dbe-9b2f-e07e20d39cae tempest-VolumesSnapshotsTestJSON-1415999267 None] Lock "cinder-c3094459-19c2-451a-b308-7d8e4b326e60-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:17:48 devstack cinder-volume[87169]: DEBUG cinder.coordination [req-f7768ab1-91e8-44ca-b996-11c808ff3ce7 req-a6a37d56-cf92-4dbe-9b2f-e07e20d39cae tempest-VolumesSnapshotsTestJSON-1415999267 None] Acquiring lock "cinder-quobyte-c3094459-19c2-451a-b308-7d8e4b326e60" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:17:48 devstack cinder-volume[87169]: DEBUG cinder.coordination [req-f7768ab1-91e8-44ca-b996-11c808ff3ce7 req-a6a37d56-cf92-4dbe-9b2f-e07e20d39cae tempest-VolumesSnapshotsTestJSON-1415999267 None] Lock "cinder-quobyte-c3094459-19c2-451a-b308-7d8e4b326e60" acquired by "delete_volume" :: waited 0.015s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:17:48 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[22569ab1-24f4-401e-8952-19f85c08844b]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:17:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-f7768ab1-91e8-44ca-b996-11c808ff3ce7 req-a6a37d56-cf92-4dbe-9b2f-e07e20d39cae tempest-VolumesSnapshotsTestJSON-1415999267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:49 devstack sudo[98288]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60
Nov 04 12:17:49 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d9b28510-43ea-488a-b020-7a400615c6e4 tempest-CinderUnicodeTest-786383852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:17:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d9b28510-43ea-488a-b020-7a400615c6e4 tempest-CinderUnicodeTest-786383852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:17:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-d9b28510-43ea-488a-b020-7a400615c6e4 tempest-CinderUnicodeTest-786383852 None] Creating offline snapshot 24038cd7-2150-4991-bd42-7eba9a90faf4 of volume cc82775f-3edd-4bd9-87fd-6bdf8e08ace6 {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:17:49 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5b6168-9f6f-400c-87b8-1c8a41266aed]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:17:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d9b28510-43ea-488a-b020-7a400615c6e4 tempest-CinderUnicodeTest-786383852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:49 devstack sudo[98291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6
Nov 04 12:17:49 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:49 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-f7768ab1-91e8-44ca-b996-11c808ff3ce7 req-a6a37d56-cf92-4dbe-9b2f-e07e20d39cae tempest-VolumesSnapshotsTestJSON-1415999267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60" returned: 0 in 0.524s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-f7768ab1-91e8-44ca-b996-11c808ff3ce7 req-a6a37d56-cf92-4dbe-9b2f-e07e20d39cae tempest-VolumesSnapshotsTestJSON-1415999267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:49 devstack sudo[98297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60
Nov 04 12:17:49 devstack sudo[98297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:49 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:17:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:17:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:17:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:17:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:17:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:49 devstack sudo[98302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:17:49 devstack sudo[98302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:49 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d9b28510-43ea-488a-b020-7a400615c6e4 tempest-CinderUnicodeTest-786383852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6" returned: 0 in 0.628s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d9b28510-43ea-488a-b020-7a400615c6e4 tempest-CinderUnicodeTest-786383852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6.24038cd7-2150-4991-bd42-7eba9a90faf4 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:49 devstack sudo[98297]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-f7768ab1-91e8-44ca-b996-11c808ff3ce7 req-a6a37d56-cf92-4dbe-9b2f-e07e20d39cae tempest-VolumesSnapshotsTestJSON-1415999267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c3094459-19c2-451a-b308-7d8e4b326e60" returned: 0 in 0.480s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:50 devstack sudo[98307]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6.24038cd7-2150-4991-bd42-7eba9a90faf4 1G
Nov 04 12:17:50 devstack sudo[98307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:50 devstack cinder-volume[87169]: DEBUG cinder.coordination [req-f7768ab1-91e8-44ca-b996-11c808ff3ce7 req-a6a37d56-cf92-4dbe-9b2f-e07e20d39cae tempest-VolumesSnapshotsTestJSON-1415999267 None] Lock "cinder-quobyte-c3094459-19c2-451a-b308-7d8e4b326e60" released by "delete_volume" :: held 1.102s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:17:50 devstack cinder-volume[87169]: DEBUG cinder.quota [req-f7768ab1-91e8-44ca-b996-11c808ff3ce7 req-a6a37d56-cf92-4dbe-9b2f-e07e20d39cae tempest-VolumesSnapshotsTestJSON-1415999267 None] Created reservations ['107989e6-fb1b-499b-8d2a-7ba1eaee7be1', '1ceef44e-2e30-41b3-ab8d-a1280b219bab', '01c4cb6d-9b1b-4878-a411-9f16f926022c', '3a4b1264-b341-4b02-ba88-0c6a17724c88'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:17:50 devstack sudo[98302]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.390s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:50 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:17:50 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager._thread_info {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:17:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread count: 28 {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 12:17:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread info: [<_MainThread(MainThread, started 137165867425920)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137165754678912)>, <Thread(Thread-3 (stat_writer), started daemon 137165754130752)>, <Thread(Rabbit-heartbeat, started daemon 137165752997504)>, <Thread(Thread-5 (_runner), started daemon 137165753227712)>, <Thread(Thread-7 (_runner), started daemon 137165751273856)>, <Thread(fd_logger, started daemon 137165755322048)>, <Thread(privsep_reader, started daemon 137165748896704)>, <Thread(tpool_thread_0, started daemon 137165742520000)>, <Thread(tpool_thread_1, started daemon 137165734127296)>, <Thread(tpool_thread_2, started daemon 137165725734592)>, <Thread(tpool_thread_3, started daemon 137165717341888)>, <Thread(tpool_thread_4, started daemon 137165708949184)>, <Thread(tpool_thread_5, started daemon 137165700556480)>, <Thread(tpool_thread_6, started daemon 137165692163776)>, <Thread(tpool_thread_7, started daemon 137165683771072)>, <Thread(tpool_thread_8, started daemon 137165675378368)>, <Thread(tpool_thread_9, started daemon 137165666985664)>, <Thread(tpool_thread_10, started daemon 137165658592960)>, <Thread(tpool_thread_11, started daemon 137165650183872)>, <Thread(tpool_thread_12, started daemon 137165641774784)>, <Thread(tpool_thread_13, started daemon 137165633365696)>, <Thread(tpool_thread_14, started daemon 137165624956608)>, <Thread(tpool_thread_15, started daemon 137165616547520)>, <Thread(tpool_thread_16, started daemon 137165608138432)>, <Thread(tpool_thread_17, started daemon 137165599729344)>, <Thread(tpool_thread_18, started daemon 137165591320256)>, <Thread(tpool_thread_19, started daemon 137165582911168)>] {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 12:17:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-f7768ab1-91e8-44ca-b996-11c808ff3ce7 req-a6a37d56-cf92-4dbe-9b2f-e07e20d39cae tempest-VolumesSnapshotsTestJSON-1415999267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:17:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-f7768ab1-91e8-44ca-b996-11c808ff3ce7 req-a6a37d56-cf92-4dbe-9b2f-e07e20d39cae tempest-VolumesSnapshotsTestJSON-1415999267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:17:50 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [req-f7768ab1-91e8-44ca-b996-11c808ff3ce7 req-a6a37d56-cf92-4dbe-9b2f-e07e20d39cae tempest-VolumesSnapshotsTestJSON-1415999267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:17:50 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [req-f7768ab1-91e8-44ca-b996-11c808ff3ce7 req-a6a37d56-cf92-4dbe-9b2f-e07e20d39cae tempest-VolumesSnapshotsTestJSON-1415999267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:17:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-f7768ab1-91e8-44ca-b996-11c808ff3ce7 req-a6a37d56-cf92-4dbe-9b2f-e07e20d39cae tempest-VolumesSnapshotsTestJSON-1415999267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-f7768ab1-91e8-44ca-b996-11c808ff3ce7 req-a6a37d56-cf92-4dbe-9b2f-e07e20d39cae tempest-VolumesSnapshotsTestJSON-1415999267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:50 devstack sudo[98312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:17:50 devstack sudo[98312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:50 devstack sudo[98307]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:50 devstack sudo[98312]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d9b28510-43ea-488a-b020-7a400615c6e4 tempest-CinderUnicodeTest-786383852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6.24038cd7-2150-4991-bd42-7eba9a90faf4 1G" returned: 0 in 0.763s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d9b28510-43ea-488a-b020-7a400615c6e4 tempest-CinderUnicodeTest-786383852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6.24038cd7-2150-4991-bd42-7eba9a90faf4 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-f7768ab1-91e8-44ca-b996-11c808ff3ce7 req-a6a37d56-cf92-4dbe-9b2f-e07e20d39cae tempest-VolumesSnapshotsTestJSON-1415999267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.411s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:50 devstack cinder-volume[87169]: DEBUG cinder.manager [req-f7768ab1-91e8-44ca-b996-11c808ff3ce7 req-a6a37d56-cf92-4dbe-9b2f-e07e20d39cae tempest-VolumesSnapshotsTestJSON-1415999267 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:17:50 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-f7768ab1-91e8-44ca-b996-11c808ff3ce7 req-a6a37d56-cf92-4dbe-9b2f-e07e20d39cae tempest-VolumesSnapshotsTestJSON-1415999267 None] Deleted volume successfully.
Nov 04 12:17:50 devstack sudo[98319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6.24038cd7-2150-4991-bd42-7eba9a90faf4
Nov 04 12:17:50 devstack sudo[98319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:50 devstack cinder-volume[87169]: DEBUG cinder.coordination [req-f7768ab1-91e8-44ca-b996-11c808ff3ce7 req-a6a37d56-cf92-4dbe-9b2f-e07e20d39cae tempest-VolumesSnapshotsTestJSON-1415999267 None] Lock "cinder-c3094459-19c2-451a-b308-7d8e4b326e60-delete_volume" released by "delete_volume" :: held 1.938s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:17:51 devstack sudo[98319]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d9b28510-43ea-488a-b020-7a400615c6e4 tempest-CinderUnicodeTest-786383852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6.24038cd7-2150-4991-bd42-7eba9a90faf4" returned: 0 in 0.348s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:51 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-d9b28510-43ea-488a-b020-7a400615c6e4 tempest-CinderUnicodeTest-786383852 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6.24038cd7-2150-4991-bd42-7eba9a90faf4 is being set with open permissions: ugo+rw
Nov 04 12:17:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d9b28510-43ea-488a-b020-7a400615c6e4 tempest-CinderUnicodeTest-786383852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6.24038cd7-2150-4991-bd42-7eba9a90faf4 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:51 devstack sudo[98326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6.24038cd7-2150-4991-bd42-7eba9a90faf4
Nov 04 12:17:51 devstack sudo[98326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:51 devstack sudo[98326]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d9b28510-43ea-488a-b020-7a400615c6e4 tempest-CinderUnicodeTest-786383852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6.24038cd7-2150-4991-bd42-7eba9a90faf4" returned: 0 in 0.287s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d9b28510-43ea-488a-b020-7a400615c6e4 tempest-CinderUnicodeTest-786383852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:51 devstack sudo[98329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6.info
Nov 04 12:17:51 devstack sudo[98329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:51 devstack sudo[98329]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d9b28510-43ea-488a-b020-7a400615c6e4 tempest-CinderUnicodeTest-786383852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6.info" returned: 0 in 0.318s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:51 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-d9b28510-43ea-488a-b020-7a400615c6e4 tempest-CinderUnicodeTest-786383852 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6.info is being set with open permissions: ugo+rw
Nov 04 12:17:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d9b28510-43ea-488a-b020-7a400615c6e4 tempest-CinderUnicodeTest-786383852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:51 devstack sudo[98332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6.info
Nov 04 12:17:51 devstack sudo[98332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:52 devstack sudo[98332]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d9b28510-43ea-488a-b020-7a400615c6e4 tempest-CinderUnicodeTest-786383852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6.info" returned: 0 in 0.331s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d9b28510-43ea-488a-b020-7a400615c6e4 tempest-CinderUnicodeTest-786383852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.819s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:52 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-d9b28510-43ea-488a-b020-7a400615c6e4 tempest-CinderUnicodeTest-786383852 None] Create snapshot completed successfully
Nov 04 12:17:52 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f758bddd-13c6-40e0-9d76-a3657599904a tempest-CinderUnicodeTest-786383852 None] Acquiring lock "cinder-24038cd7-2150-4991-bd42-7eba9a90faf4-delete_snapshot" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:17:52 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f758bddd-13c6-40e0-9d76-a3657599904a tempest-CinderUnicodeTest-786383852 None] Lock "cinder-24038cd7-2150-4991-bd42-7eba9a90faf4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:17:52 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f758bddd-13c6-40e0-9d76-a3657599904a tempest-CinderUnicodeTest-786383852 None] Acquiring lock "cinder-quobyte-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:17:52 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f758bddd-13c6-40e0-9d76-a3657599904a tempest-CinderUnicodeTest-786383852 None] Lock "cinder-quobyte-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:17:52 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f758bddd-13c6-40e0-9d76-a3657599904a tempest-CinderUnicodeTest-786383852 None] Acquiring lock "cinder-quobyte-24038cd7-2150-4991-bd42-7eba9a90faf4" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:17:52 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f758bddd-13c6-40e0-9d76-a3657599904a tempest-CinderUnicodeTest-786383852 None] Lock "cinder-quobyte-24038cd7-2150-4991-bd42-7eba9a90faf4" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:17:52 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-f758bddd-13c6-40e0-9d76-a3657599904a tempest-CinderUnicodeTest-786383852 None] Deleting offline snapshot 24038cd7-2150-4991-bd42-7eba9a90faf4 of volume cc82775f-3edd-4bd9-87fd-6bdf8e08ace6 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:17:52 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-f758bddd-13c6-40e0-9d76-a3657599904a tempest-CinderUnicodeTest-786383852 None] snapshot_file for this snap is: volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6.24038cd7-2150-4991-bd42-7eba9a90faf4 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:17:52 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f9a6be-1e10-4398-8640-8722c0efa323]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:17:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f758bddd-13c6-40e0-9d76-a3657599904a tempest-CinderUnicodeTest-786383852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6.24038cd7-2150-4991-bd42-7eba9a90faf4 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:52 devstack sudo[98335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6.24038cd7-2150-4991-bd42-7eba9a90faf4
Nov 04 12:17:52 devstack sudo[98335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:53 devstack sudo[98335]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f758bddd-13c6-40e0-9d76-a3657599904a tempest-CinderUnicodeTest-786383852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6.24038cd7-2150-4991-bd42-7eba9a90faf4" returned: 0 in 0.509s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:53 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-f758bddd-13c6-40e0-9d76-a3657599904a tempest-CinderUnicodeTest-786383852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:17:53 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd27b897-8039-4c0d-816f-e3bdb31b22d9]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:17:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f758bddd-13c6-40e0-9d76-a3657599904a tempest-CinderUnicodeTest-786383852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:53 devstack sudo[98345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6
Nov 04 12:17:53 devstack sudo[98345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:53 devstack sudo[98345]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f758bddd-13c6-40e0-9d76-a3657599904a tempest-CinderUnicodeTest-786383852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6" returned: 0 in 0.517s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f758bddd-13c6-40e0-9d76-a3657599904a tempest-CinderUnicodeTest-786383852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6.24038cd7-2150-4991-bd42-7eba9a90faf4 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:53 devstack sudo[98350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6.24038cd7-2150-4991-bd42-7eba9a90faf4
Nov 04 12:17:53 devstack sudo[98350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:54 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:17:54 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Flow 'volume_create_manager' (3b95f652-e766-4128-b6c8-4392e4ae7726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:17:54 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd495d9b-3bc7-452c-b4c9-ae52c0d327a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:54 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd495d9b-3bc7-452c-b4c9-ae52c0d327a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1024471291',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac78889e-53fb-4eec-bfdf-1389906efc10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72857eb9f18b443b8205f4945ca52176',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:54Z,use_quota=True,user_id='78c4d48bb8a64758a7e7657ca956189d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:54 devstack sudo[98350]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:54 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d886ac8-2c16-45d3-b7d7-f1737eca8618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:54 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d886ac8-2c16-45d3-b7d7-f1737eca8618) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:54 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1f8f451-ecc0-443d-bff4-45efa42a5eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:54 devstack cinder-volume[87169]: DEBUG cinder.image.glance [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Creating Keystone auth plugin from conf {{(pid=87169) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 04 12:17:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f758bddd-13c6-40e0-9d76-a3657599904a tempest-CinderUnicodeTest-786383852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6.24038cd7-2150-4991-bd42-7eba9a90faf4" returned: 0 in 0.490s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f758bddd-13c6-40e0-9d76-a3657599904a tempest-CinderUnicodeTest-786383852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6.24038cd7-2150-4991-bd42-7eba9a90faf4 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:54 devstack sudo[98356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6.24038cd7-2150-4991-bd42-7eba9a90faf4
Nov 04 12:17:54 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:54 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f758bddd-13c6-40e0-9d76-a3657599904a tempest-CinderUnicodeTest-786383852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6.24038cd7-2150-4991-bd42-7eba9a90faf4" returned: 0 in 0.305s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:54 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f758bddd-13c6-40e0-9d76-a3657599904a tempest-CinderUnicodeTest-786383852 None] Lock "cinder-quobyte-24038cd7-2150-4991-bd42-7eba9a90faf4" released by "_delete_snapshot" :: held 1.987s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:17:54 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f758bddd-13c6-40e0-9d76-a3657599904a tempest-CinderUnicodeTest-786383852 None] Lock "cinder-quobyte-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6" released by "delete_snapshot" :: held 2.019s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:17:54 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1f8f451-ecc0-443d-bff4-45efa42a5eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ac78889e-53fb-4eec-bfdf-1389906efc10', 'volume_name': 'volume-ac78889e-53fb-4eec-bfdf-1389906efc10', 'volume_size': 1, 'image_id': '5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '52d49d1f3a4b47a8a8f060da8e0e2c02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'created_at': datetime.datetime(2026, 11, 4, 11, 3, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 3, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fd6a6ac-1614-4aa5-aedb-17a31996018d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cc063752d80>}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:54 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3794a87-c4f5-4b99-95cf-958461b75a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:54 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3794a87-c4f5-4b99-95cf-958461b75a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:54 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ef1855-69ff-4f0f-821b-1ea45b82bdd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:54 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Volume ac78889e-53fb-4eec-bfdf-1389906efc10: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ac78889e-53fb-4eec-bfdf-1389906efc10', 'volume_size': 1, 'image_id': '5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '52d49d1f3a4b47a8a8f060da8e0e2c02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'created_at': datetime.datetime(2026, 11, 4, 11, 3, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 3, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fd6a6ac-1614-4aa5-aedb-17a31996018d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cc063752d80>}
Nov 04 12:17:54 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Trying to clone ac78889e-53fb-4eec-bfdf-1389906efc10 from image 5fd6a6ac-1614-4aa5-aedb-17a31996018d at location (None, [{'url': 'file:///opt/stack/data/glance/images/5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'metadata': {}}]). {{(pid=87169) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 04 12:17:54 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-f758bddd-13c6-40e0-9d76-a3657599904a tempest-CinderUnicodeTest-786383852 None] Created reservations ['d062cdfc-aa42-4dc7-bc8d-5a66cf61fe71', '1ba3cc8e-ce72-4d7d-a57a-20b0584615f1', '8c9b9405-4b94-4bdc-b68f-95d18cdeeb3b', '420def2a-4219-4c82-8a78-4354865867f3'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:17:54 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-f758bddd-13c6-40e0-9d76-a3657599904a tempest-CinderUnicodeTest-786383852 None] Delete snapshot completed successfully.
Nov 04 12:17:54 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f758bddd-13c6-40e0-9d76-a3657599904a tempest-CinderUnicodeTest-786383852 None] Lock "cinder-24038cd7-2150-4991-bd42-7eba9a90faf4-delete_snapshot" released by "delete_snapshot" :: held 2.354s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:17:55 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_ost8hsv2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87169) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 04 12:17:55 devstack cinder-volume[87169]: INFO cinder.image.image_utils [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Image download 20.69 MB at 20.69 MB/s
Nov 04 12:17:55 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abf7da7-2c85-46f3-9a1f-1f290c89dcf4]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:17:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_ost8hsv2devstack@QuobyteHD {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:55 devstack sudo[98360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_ost8hsv2devstack@QuobyteHD
Nov 04 12:17:55 devstack sudo[98360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:55 devstack sudo[98360]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_ost8hsv2devstack@QuobyteHD" returned: 0 in 0.384s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:55 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Temporary image 5fd6a6ac-1614-4aa5-aedb-17a31996018d is fetched for user 78c4d48bb8a64758a7e7657ca956189d. {{(pid=87169) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 04 12:17:55 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a21face-364c-485b-a46c-1ad0d98f46d9]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:17:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_ost8hsv2devstack@QuobyteHD {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:55 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-37bfb1fa-e3c2-4420-8ece-2afd356ff828 tempest-CinderUnicodeTest-786383852 None] Acquiring lock "cinder-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:17:55 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-37bfb1fa-e3c2-4420-8ece-2afd356ff828 tempest-CinderUnicodeTest-786383852 None] Lock "cinder-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:17:55 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-37bfb1fa-e3c2-4420-8ece-2afd356ff828 tempest-CinderUnicodeTest-786383852 None] Acquiring lock "cinder-quobyte-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:17:55 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-37bfb1fa-e3c2-4420-8ece-2afd356ff828 tempest-CinderUnicodeTest-786383852 None] Lock "cinder-quobyte-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6" acquired by "delete_volume" :: waited 0.023s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:17:55 devstack sudo[98367]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_ost8hsv2devstack@QuobyteHD
Nov 04 12:17:55 devstack sudo[98367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:55 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df6d8a7-26f3-42dc-a327-5574ef4fa87f]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:17:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-37bfb1fa-e3c2-4420-8ece-2afd356ff828 tempest-CinderUnicodeTest-786383852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:56 devstack sudo[98369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6
Nov 04 12:17:56 devstack sudo[98369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:56 devstack sudo[98367]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_ost8hsv2devstack@QuobyteHD" returned: 0 in 0.376s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:17:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:17:56 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:17:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1024471291',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac78889e-53fb-4eec-bfdf-1389906efc10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72857eb9f18b443b8205f4945ca52176',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:54Z,use_quota=True,user_id='78c4d48bb8a64758a7e7657ca956189d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:17:56 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Creating volume ac78889e-53fb-4eec-bfdf-1389906efc10 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:17:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:17:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:17:56 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:17:56 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:17:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:56 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:17:56 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:17:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ac78889e-53fb-4eec-bfdf-1389906efc10 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:56 devstack sudo[98374]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ac78889e-53fb-4eec-bfdf-1389906efc10 1073741824
Nov 04 12:17:56 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:56 devstack sudo[98369]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-37bfb1fa-e3c2-4420-8ece-2afd356ff828 tempest-CinderUnicodeTest-786383852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6" returned: 0 in 0.476s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-37bfb1fa-e3c2-4420-8ece-2afd356ff828 tempest-CinderUnicodeTest-786383852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:56 devstack sudo[98383]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6
Nov 04 12:17:56 devstack sudo[98383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:56 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [req-fabbe555-57b4-42ee-bc1f-04f88b66e054 req-5b9d7e74-c247-458b-a349-20d4416fc061 tempest-VolumesGetTestJSON-1229005098 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:17:56 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:56 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-fabbe555-57b4-42ee-bc1f-04f88b66e054 req-5b9d7e74-c247-458b-a349-20d4416fc061 tempest-VolumesGetTestJSON-1229005098 None] Flow 'volume_create_manager' (b7fd9a4f-2744-401d-8cb5-49aeaa2531bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:17:56 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-fabbe555-57b4-42ee-bc1f-04f88b66e054 req-5b9d7e74-c247-458b-a349-20d4416fc061 tempest-VolumesGetTestJSON-1229005098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d04d026-9fc7-4085-aefd-1c164561d6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ac78889e-53fb-4eec-bfdf-1389906efc10 1073741824" returned: 0 in 0.674s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:56 devstack sudo[98383]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:56 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-fabbe555-57b4-42ee-bc1f-04f88b66e054 req-5b9d7e74-c247-458b-a349-20d4416fc061 tempest-VolumesGetTestJSON-1229005098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d04d026-9fc7-4085-aefd-1c164561d6c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1975374576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e44392f-741c-4340-8778-c788ce990790,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bf12641992a94fb7964084bcb586d918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:57Z,use_quota=True,user_id='59ee3d67b65d4fd28eec5d61e0f723f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:56 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-fabbe555-57b4-42ee-bc1f-04f88b66e054 req-5b9d7e74-c247-458b-a349-20d4416fc061 tempest-VolumesGetTestJSON-1229005098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29eb69f6-040c-440b-8430-03ff685a7e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:56 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-fabbe555-57b4-42ee-bc1f-04f88b66e054 req-5b9d7e74-c247-458b-a349-20d4416fc061 tempest-VolumesGetTestJSON-1229005098 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29eb69f6-040c-440b-8430-03ff685a7e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:56 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-fabbe555-57b4-42ee-bc1f-04f88b66e054 req-5b9d7e74-c247-458b-a349-20d4416fc061 tempest-VolumesGetTestJSON-1229005098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c3705b-980b-4372-a39d-b94fdbec47a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:56 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-fabbe555-57b4-42ee-bc1f-04f88b66e054 req-5b9d7e74-c247-458b-a349-20d4416fc061 tempest-VolumesGetTestJSON-1229005098 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21c3705b-980b-4372-a39d-b94fdbec47a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e44392f-741c-4340-8778-c788ce990790', 'volume_name': 'volume-5e44392f-741c-4340-8778-c788ce990790', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:56 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-fabbe555-57b4-42ee-bc1f-04f88b66e054 req-5b9d7e74-c247-458b-a349-20d4416fc061 tempest-VolumesGetTestJSON-1229005098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6abe6877-1285-48c0-ad33-87ba8b47a880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:56 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-fabbe555-57b4-42ee-bc1f-04f88b66e054 req-5b9d7e74-c247-458b-a349-20d4416fc061 tempest-VolumesGetTestJSON-1229005098 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6abe6877-1285-48c0-ad33-87ba8b47a880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:56 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-fabbe555-57b4-42ee-bc1f-04f88b66e054 req-5b9d7e74-c247-458b-a349-20d4416fc061 tempest-VolumesGetTestJSON-1229005098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ab2a3ca-8378-41a9-8944-d8c9f101e90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:56 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [req-fabbe555-57b4-42ee-bc1f-04f88b66e054 req-5b9d7e74-c247-458b-a349-20d4416fc061 tempest-VolumesGetTestJSON-1229005098 None] Volume 5e44392f-741c-4340-8778-c788ce990790: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e44392f-741c-4340-8778-c788ce990790', 'volume_size': 1}
Nov 04 12:17:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-fabbe555-57b4-42ee-bc1f-04f88b66e054 req-5b9d7e74-c247-458b-a349-20d4416fc061 tempest-VolumesGetTestJSON-1229005098 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:17:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-37bfb1fa-e3c2-4420-8ece-2afd356ff828 tempest-CinderUnicodeTest-786383852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6" returned: 0 in 0.449s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:56 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-37bfb1fa-e3c2-4420-8ece-2afd356ff828 tempest-CinderUnicodeTest-786383852 None] Lock "cinder-quobyte-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6" released by "delete_volume" :: held 1.015s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:17:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ac78889e-53fb-4eec-bfdf-1389906efc10 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:56 devstack sudo[98392]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ac78889e-53fb-4eec-bfdf-1389906efc10
Nov 04 12:17:56 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:56 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-37bfb1fa-e3c2-4420-8ece-2afd356ff828 tempest-CinderUnicodeTest-786383852 None] Created reservations ['41b127b0-f9cd-444f-b9b4-1eacb1904e24', 'ba6a1b10-13a6-4e38-b220-008115841fab', '09ec27a9-bde7-44ac-9331-425e743cb3b9', 'd53065cb-dd7d-42f5-9792-2118c0431636'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:17:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-37bfb1fa-e3c2-4420-8ece-2afd356ff828 tempest-CinderUnicodeTest-786383852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:17:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-37bfb1fa-e3c2-4420-8ece-2afd356ff828 tempest-CinderUnicodeTest-786383852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:17:57 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-37bfb1fa-e3c2-4420-8ece-2afd356ff828 tempest-CinderUnicodeTest-786383852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:17:57 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-37bfb1fa-e3c2-4420-8ece-2afd356ff828 tempest-CinderUnicodeTest-786383852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:17:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-37bfb1fa-e3c2-4420-8ece-2afd356ff828 tempest-CinderUnicodeTest-786383852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-37bfb1fa-e3c2-4420-8ece-2afd356ff828 tempest-CinderUnicodeTest-786383852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:57 devstack sudo[98394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:17:57 devstack sudo[98394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:57 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ac78889e-53fb-4eec-bfdf-1389906efc10" returned: 0 in 0.293s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:57 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:17:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-fabbe555-57b4-42ee-bc1f-04f88b66e054 req-5b9d7e74-c247-458b-a349-20d4416fc061 tempest-VolumesGetTestJSON-1229005098 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.352s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:17:57 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [req-fabbe555-57b4-42ee-bc1f-04f88b66e054 req-5b9d7e74-c247-458b-a349-20d4416fc061 tempest-VolumesGetTestJSON-1229005098 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:17:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1975374576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e44392f-741c-4340-8778-c788ce990790,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bf12641992a94fb7964084bcb586d918',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:17:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:17:57Z,use_quota=True,user_id='59ee3d67b65d4fd28eec5d61e0f723f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:17:57 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [req-fabbe555-57b4-42ee-bc1f-04f88b66e054 req-5b9d7e74-c247-458b-a349-20d4416fc061 tempest-VolumesGetTestJSON-1229005098 None] Creating volume 5e44392f-741c-4340-8778-c788ce990790 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:17:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-fabbe555-57b4-42ee-bc1f-04f88b66e054 req-5b9d7e74-c247-458b-a349-20d4416fc061 tempest-VolumesGetTestJSON-1229005098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:17:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-fabbe555-57b4-42ee-bc1f-04f88b66e054 req-5b9d7e74-c247-458b-a349-20d4416fc061 tempest-VolumesGetTestJSON-1229005098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:17:57 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [req-fabbe555-57b4-42ee-bc1f-04f88b66e054 req-5b9d7e74-c247-458b-a349-20d4416fc061 tempest-VolumesGetTestJSON-1229005098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:17:57 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [req-fabbe555-57b4-42ee-bc1f-04f88b66e054 req-5b9d7e74-c247-458b-a349-20d4416fc061 tempest-VolumesGetTestJSON-1229005098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:17:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-fabbe555-57b4-42ee-bc1f-04f88b66e054 req-5b9d7e74-c247-458b-a349-20d4416fc061 tempest-VolumesGetTestJSON-1229005098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:57 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [req-fabbe555-57b4-42ee-bc1f-04f88b66e054 req-5b9d7e74-c247-458b-a349-20d4416fc061 tempest-VolumesGetTestJSON-1229005098 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:17:57 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [req-fabbe555-57b4-42ee-bc1f-04f88b66e054 req-5b9d7e74-c247-458b-a349-20d4416fc061 tempest-VolumesGetTestJSON-1229005098 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:17:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-fabbe555-57b4-42ee-bc1f-04f88b66e054 req-5b9d7e74-c247-458b-a349-20d4416fc061 tempest-VolumesGetTestJSON-1229005098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e44392f-741c-4340-8778-c788ce990790 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:57 devstack sudo[98397]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e44392f-741c-4340-8778-c788ce990790 1073741824
Nov 04 12:17:57 devstack sudo[98397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:57 devstack cinder-volume[87169]: DEBUG cinder.volume.volume_utils [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Attempting download of 5fd6a6ac-1614-4aa5-aedb-17a31996018d ((None, [{'url': 'file:///opt/stack/data/glance/images/5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'metadata': {}}])) to volume ac78889e-53fb-4eec-bfdf-1389906efc10. {{(pid=87169) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 04 12:17:57 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec9792c-8b2c-4944-8cb9-125ee133dc3c]: (4, 'raw') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:17:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fd6a6ac-1614-4aa5-aedb-17a31996018d_l5b2hvsf {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:57 devstack sudo[98394]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-37bfb1fa-e3c2-4420-8ece-2afd356ff828 tempest-CinderUnicodeTest-786383852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.295s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:57 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-37bfb1fa-e3c2-4420-8ece-2afd356ff828 tempest-CinderUnicodeTest-786383852 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:17:57 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-37bfb1fa-e3c2-4420-8ece-2afd356ff828 tempest-CinderUnicodeTest-786383852 None] Deleted volume successfully.
Nov 04 12:17:57 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-37bfb1fa-e3c2-4420-8ece-2afd356ff828 tempest-CinderUnicodeTest-786383852 None] Lock "cinder-cc82775f-3edd-4bd9-87fd-6bdf8e08ace6-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:17:57 devstack sudo[98400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fd6a6ac-1614-4aa5-aedb-17a31996018d_l5b2hvsf
Nov 04 12:17:57 devstack sudo[98400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:57 devstack sudo[98400]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fd6a6ac-1614-4aa5-aedb-17a31996018d_l5b2hvsf" returned: 0 in 0.387s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fd6a6ac-1614-4aa5-aedb-17a31996018d_l5b2hvsf {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:57 devstack sudo[98397]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-fabbe555-57b4-42ee-bc1f-04f88b66e054 req-5b9d7e74-c247-458b-a349-20d4416fc061 tempest-VolumesGetTestJSON-1229005098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e44392f-741c-4340-8778-c788ce990790 1073741824" returned: 0 in 0.589s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-fabbe555-57b4-42ee-bc1f-04f88b66e054 req-5b9d7e74-c247-458b-a349-20d4416fc061 tempest-VolumesGetTestJSON-1229005098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e44392f-741c-4340-8778-c788ce990790 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:57 devstack sudo[98408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fd6a6ac-1614-4aa5-aedb-17a31996018d_l5b2hvsf
Nov 04 12:17:57 devstack sudo[98408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:57 devstack sudo[98410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e44392f-741c-4340-8778-c788ce990790
Nov 04 12:17:57 devstack sudo[98410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:58 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-eea72f7d-1514-405d-bd11-f3181e4065c9 tempest-CinderUnicodeTest-786383852 None] Acquiring lock "cinder-216b474d-94fb-45d5-9e5a-e511d8b485b8-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:17:58 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-eea72f7d-1514-405d-bd11-f3181e4065c9 tempest-CinderUnicodeTest-786383852 None] Lock "cinder-216b474d-94fb-45d5-9e5a-e511d8b485b8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:17:58 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-eea72f7d-1514-405d-bd11-f3181e4065c9 tempest-CinderUnicodeTest-786383852 None] Acquiring lock "cinder-quobyte-216b474d-94fb-45d5-9e5a-e511d8b485b8" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:17:58 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-eea72f7d-1514-405d-bd11-f3181e4065c9 tempest-CinderUnicodeTest-786383852 None] Lock "cinder-quobyte-216b474d-94fb-45d5-9e5a-e511d8b485b8" acquired by "delete_volume" :: waited 0.033s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:17:58 devstack sudo[98408]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fd6a6ac-1614-4aa5-aedb-17a31996018d_l5b2hvsf" returned: 1 in 0.499s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fd6a6ac-1614-4aa5-aedb-17a31996018d_l5b2hvsf' failed. Not Retrying. {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 12:17:58 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[23982ee7-de8a-4a7e-983d-84524c4bd520]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:17:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_ost8hsv2devstack@QuobyteHD {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:58 devstack sudo[98410]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:58 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[72472a99-f759-4923-8568-0378432a94bb]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:17:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-eea72f7d-1514-405d-bd11-f3181e4065c9 tempest-CinderUnicodeTest-786383852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-216b474d-94fb-45d5-9e5a-e511d8b485b8 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-fabbe555-57b4-42ee-bc1f-04f88b66e054 req-5b9d7e74-c247-458b-a349-20d4416fc061 tempest-VolumesGetTestJSON-1229005098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e44392f-741c-4340-8778-c788ce990790" returned: 0 in 0.397s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:58 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [req-fabbe555-57b4-42ee-bc1f-04f88b66e054 req-5b9d7e74-c247-458b-a349-20d4416fc061 tempest-VolumesGetTestJSON-1229005098 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:17:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-fabbe555-57b4-42ee-bc1f-04f88b66e054 req-5b9d7e74-c247-458b-a349-20d4416fc061 tempest-VolumesGetTestJSON-1229005098 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-fabbe555-57b4-42ee-bc1f-04f88b66e054 req-5b9d7e74-c247-458b-a349-20d4416fc061 tempest-VolumesGetTestJSON-1229005098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ab2a3ca-8378-41a9-8944-d8c9f101e90b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e44392f-741c-4340-8778-c788ce990790', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-fabbe555-57b4-42ee-bc1f-04f88b66e054 req-5b9d7e74-c247-458b-a349-20d4416fc061 tempest-VolumesGetTestJSON-1229005098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89145d44-34b7-4f43-a48e-c3ffde5a25fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:17:58 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [req-fabbe555-57b4-42ee-bc1f-04f88b66e054 req-5b9d7e74-c247-458b-a349-20d4416fc061 tempest-VolumesGetTestJSON-1229005098 None] Volume volume-5e44392f-741c-4340-8778-c788ce990790 (5e44392f-741c-4340-8778-c788ce990790): created successfully
Nov 04 12:17:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-fabbe555-57b4-42ee-bc1f-04f88b66e054 req-5b9d7e74-c247-458b-a349-20d4416fc061 tempest-VolumesGetTestJSON-1229005098 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89145d44-34b7-4f43-a48e-c3ffde5a25fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:17:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-fabbe555-57b4-42ee-bc1f-04f88b66e054 req-5b9d7e74-c247-458b-a349-20d4416fc061 tempest-VolumesGetTestJSON-1229005098 None] Flow 'volume_create_manager' (b7fd9a4f-2744-401d-8cb5-49aeaa2531bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:17:58 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-fabbe555-57b4-42ee-bc1f-04f88b66e054 req-5b9d7e74-c247-458b-a349-20d4416fc061 tempest-VolumesGetTestJSON-1229005098 None] Created volume successfully.
Nov 04 12:17:58 devstack sudo[98416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_ost8hsv2devstack@QuobyteHD
Nov 04 12:17:58 devstack sudo[98416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:58 devstack sudo[98417]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-216b474d-94fb-45d5-9e5a-e511d8b485b8
Nov 04 12:17:58 devstack sudo[98417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:58 devstack sudo[98416]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_ost8hsv2devstack@QuobyteHD" returned: 0 in 0.471s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:58 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] 5fd6a6ac-1614-4aa5-aedb-17a31996018d was qcow2, converting to qcow2 {{(pid=87169) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 04 12:17:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_ost8hsv2devstack@QuobyteHD /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ac78889e-53fb-4eec-bfdf-1389906efc10 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:58 devstack sudo[98432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_ost8hsv2devstack@QuobyteHD /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ac78889e-53fb-4eec-bfdf-1389906efc10
Nov 04 12:17:58 devstack sudo[98432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:58 devstack sudo[98417]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-eea72f7d-1514-405d-bd11-f3181e4065c9 tempest-CinderUnicodeTest-786383852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-216b474d-94fb-45d5-9e5a-e511d8b485b8" returned: 0 in 0.556s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-eea72f7d-1514-405d-bd11-f3181e4065c9 tempest-CinderUnicodeTest-786383852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-216b474d-94fb-45d5-9e5a-e511d8b485b8 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:58 devstack sudo[98441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-216b474d-94fb-45d5-9e5a-e511d8b485b8
Nov 04 12:17:58 devstack sudo[98441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:59 devstack sudo[98441]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-eea72f7d-1514-405d-bd11-f3181e4065c9 tempest-CinderUnicodeTest-786383852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-216b474d-94fb-45d5-9e5a-e511d8b485b8" returned: 0 in 0.442s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:59 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-eea72f7d-1514-405d-bd11-f3181e4065c9 tempest-CinderUnicodeTest-786383852 None] Lock "cinder-quobyte-216b474d-94fb-45d5-9e5a-e511d8b485b8" released by "delete_volume" :: held 1.117s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:17:59 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-eea72f7d-1514-405d-bd11-f3181e4065c9 tempest-CinderUnicodeTest-786383852 None] Created reservations ['ae43ca63-977f-431c-92f7-f9b8e0caf8ac', 'd9709b17-2e4b-46a6-81ee-353dd1649ab1', 'ba406451-774d-480b-a29d-3253b9066476', 'f5c49892-60fb-47ae-8d7f-56b3c23acd9d'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:17:59 devstack cinder-volume[87169]: DEBUG cinder.coordination [req-ffcd70cb-1609-4fc1-a2d9-a58015e61892 req-ca738fdb-efd7-4e90-971e-e5ff177a4477 tempest-VolumesGetTestJSON-1229005098 None] Acquiring lock "cinder-5e44392f-741c-4340-8778-c788ce990790-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:17:59 devstack cinder-volume[87169]: DEBUG cinder.coordination [req-ffcd70cb-1609-4fc1-a2d9-a58015e61892 req-ca738fdb-efd7-4e90-971e-e5ff177a4477 tempest-VolumesGetTestJSON-1229005098 None] Lock "cinder-5e44392f-741c-4340-8778-c788ce990790-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:17:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-eea72f7d-1514-405d-bd11-f3181e4065c9 tempest-CinderUnicodeTest-786383852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:17:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-eea72f7d-1514-405d-bd11-f3181e4065c9 tempest-CinderUnicodeTest-786383852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:17:59 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-eea72f7d-1514-405d-bd11-f3181e4065c9 tempest-CinderUnicodeTest-786383852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:17:59 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-eea72f7d-1514-405d-bd11-f3181e4065c9 tempest-CinderUnicodeTest-786383852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:17:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-eea72f7d-1514-405d-bd11-f3181e4065c9 tempest-CinderUnicodeTest-786383852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:17:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-eea72f7d-1514-405d-bd11-f3181e4065c9 tempest-CinderUnicodeTest-786383852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:59 devstack sudo[98456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:17:59 devstack sudo[98456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:59 devstack cinder-volume[87169]: DEBUG cinder.coordination [req-ffcd70cb-1609-4fc1-a2d9-a58015e61892 req-ca738fdb-efd7-4e90-971e-e5ff177a4477 tempest-VolumesGetTestJSON-1229005098 None] Acquiring lock "cinder-quobyte-5e44392f-741c-4340-8778-c788ce990790" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:17:59 devstack cinder-volume[87169]: DEBUG cinder.coordination [req-ffcd70cb-1609-4fc1-a2d9-a58015e61892 req-ca738fdb-efd7-4e90-971e-e5ff177a4477 tempest-VolumesGetTestJSON-1229005098 None] Lock "cinder-quobyte-5e44392f-741c-4340-8778-c788ce990790" acquired by "delete_volume" :: waited 0.015s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:17:59 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f656f71-6bb5-4d9a-8248-0e8073b219d0]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:17:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-ffcd70cb-1609-4fc1-a2d9-a58015e61892 req-ca738fdb-efd7-4e90-971e-e5ff177a4477 tempest-VolumesGetTestJSON-1229005098 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e44392f-741c-4340-8778-c788ce990790 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:17:59 devstack sudo[98459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e44392f-741c-4340-8778-c788ce990790
Nov 04 12:17:59 devstack sudo[98459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:17:59 devstack sudo[98456]: pam_unix(sudo:session): session closed for user root
Nov 04 12:17:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-eea72f7d-1514-405d-bd11-f3181e4065c9 tempest-CinderUnicodeTest-786383852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.382s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:17:59 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-eea72f7d-1514-405d-bd11-f3181e4065c9 tempest-CinderUnicodeTest-786383852 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:17:59 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-eea72f7d-1514-405d-bd11-f3181e4065c9 tempest-CinderUnicodeTest-786383852 None] Deleted volume successfully.
Nov 04 12:17:59 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-eea72f7d-1514-405d-bd11-f3181e4065c9 tempest-CinderUnicodeTest-786383852 None] Lock "cinder-216b474d-94fb-45d5-9e5a-e511d8b485b8-delete_volume" released by "delete_volume" :: held 1.858s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:18:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-ffcd70cb-1609-4fc1-a2d9-a58015e61892 req-ca738fdb-efd7-4e90-971e-e5ff177a4477 tempest-VolumesGetTestJSON-1229005098 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e44392f-741c-4340-8778-c788ce990790" returned: 0 in 0.537s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-ffcd70cb-1609-4fc1-a2d9-a58015e61892 req-ca738fdb-efd7-4e90-971e-e5ff177a4477 tempest-VolumesGetTestJSON-1229005098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e44392f-741c-4340-8778-c788ce990790 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:00 devstack sudo[98459]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:00 devstack sudo[98467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e44392f-741c-4340-8778-c788ce990790
Nov 04 12:18:00 devstack sudo[98467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:00 devstack sudo[98467]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-ffcd70cb-1609-4fc1-a2d9-a58015e61892 req-ca738fdb-efd7-4e90-971e-e5ff177a4477 tempest-VolumesGetTestJSON-1229005098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e44392f-741c-4340-8778-c788ce990790" returned: 0 in 0.418s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:00 devstack cinder-volume[87169]: DEBUG cinder.coordination [req-ffcd70cb-1609-4fc1-a2d9-a58015e61892 req-ca738fdb-efd7-4e90-971e-e5ff177a4477 tempest-VolumesGetTestJSON-1229005098 None] Lock "cinder-quobyte-5e44392f-741c-4340-8778-c788ce990790" released by "delete_volume" :: held 1.060s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:18:00 devstack cinder-volume[87169]: DEBUG cinder.quota [req-ffcd70cb-1609-4fc1-a2d9-a58015e61892 req-ca738fdb-efd7-4e90-971e-e5ff177a4477 tempest-VolumesGetTestJSON-1229005098 None] Created reservations ['d8c26663-b0d6-4673-b1e7-cf4f45351500', '852b09bf-8968-4a43-9cda-0cd53ef82a84', '425e04ff-9e70-4abb-847e-b39f6fc8d538', '6981fbb3-c5cc-4e88-a3c6-55af235e14a7'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:18:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-ffcd70cb-1609-4fc1-a2d9-a58015e61892 req-ca738fdb-efd7-4e90-971e-e5ff177a4477 tempest-VolumesGetTestJSON-1229005098 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-ffcd70cb-1609-4fc1-a2d9-a58015e61892 req-ca738fdb-efd7-4e90-971e-e5ff177a4477 tempest-VolumesGetTestJSON-1229005098 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:00 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [req-ffcd70cb-1609-4fc1-a2d9-a58015e61892 req-ca738fdb-efd7-4e90-971e-e5ff177a4477 tempest-VolumesGetTestJSON-1229005098 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:18:00 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [req-ffcd70cb-1609-4fc1-a2d9-a58015e61892 req-ca738fdb-efd7-4e90-971e-e5ff177a4477 tempest-VolumesGetTestJSON-1229005098 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:18:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-ffcd70cb-1609-4fc1-a2d9-a58015e61892 req-ca738fdb-efd7-4e90-971e-e5ff177a4477 tempest-VolumesGetTestJSON-1229005098 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-ffcd70cb-1609-4fc1-a2d9-a58015e61892 req-ca738fdb-efd7-4e90-971e-e5ff177a4477 tempest-VolumesGetTestJSON-1229005098 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:00 devstack sudo[98471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:18:00 devstack sudo[98471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:01 devstack sudo[98471]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-ffcd70cb-1609-4fc1-a2d9-a58015e61892 req-ca738fdb-efd7-4e90-971e-e5ff177a4477 tempest-VolumesGetTestJSON-1229005098 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.315s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:01 devstack cinder-volume[87169]: DEBUG cinder.manager [req-ffcd70cb-1609-4fc1-a2d9-a58015e61892 req-ca738fdb-efd7-4e90-971e-e5ff177a4477 tempest-VolumesGetTestJSON-1229005098 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:18:01 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-ffcd70cb-1609-4fc1-a2d9-a58015e61892 req-ca738fdb-efd7-4e90-971e-e5ff177a4477 tempest-VolumesGetTestJSON-1229005098 None] Deleted volume successfully.
Nov 04 12:18:01 devstack cinder-volume[87169]: DEBUG cinder.coordination [req-ffcd70cb-1609-4fc1-a2d9-a58015e61892 req-ca738fdb-efd7-4e90-971e-e5ff177a4477 tempest-VolumesGetTestJSON-1229005098 None] Lock "cinder-5e44392f-741c-4340-8778-c788ce990790-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:18:01 devstack sudo[98432]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_ost8hsv2devstack@QuobyteHD /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ac78889e-53fb-4eec-bfdf-1389906efc10" returned: 0 in 2.755s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:01 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_ost8hsv2devstack@QuobyteHD, size 112.00 MB, duration 2.76 sec, destination /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ac78889e-53fb-4eec-bfdf-1389906efc10 {{(pid=87169) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 12:18:01 devstack cinder-volume[87169]: INFO cinder.image.image_utils [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Converted 112.00 MB image at 40.63 MB/s
Nov 04 12:18:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ac78889e-53fb-4eec-bfdf-1389906efc10 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:01 devstack sudo[98475]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ac78889e-53fb-4eec-bfdf-1389906efc10 1G
Nov 04 12:18:01 devstack sudo[98475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:02 devstack sudo[98475]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ac78889e-53fb-4eec-bfdf-1389906efc10 1G" returned: 0 in 0.648s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:02 devstack cinder-volume[87169]: DEBUG cinder.volume.volume_utils [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Downloaded image 5fd6a6ac-1614-4aa5-aedb-17a31996018d ((None, [{'url': 'file:///opt/stack/data/glance/images/5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'metadata': {}}])) to volume ac78889e-53fb-4eec-bfdf-1389906efc10 successfully. {{(pid=87169) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 04 12:18:02 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Temporary image 5fd6a6ac-1614-4aa5-aedb-17a31996018d for user 78c4d48bb8a64758a7e7657ca956189d is deleted. {{(pid=87169) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 04 12:18:02 devstack cinder-volume[87169]: DEBUG cinder.volume.volume_utils [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Marking volume ac78889e-53fb-4eec-bfdf-1389906efc10 as bootable. {{(pid=87169) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 04 12:18:02 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Copying metadata from image 5fd6a6ac-1614-4aa5-aedb-17a31996018d to ac78889e-53fb-4eec-bfdf-1389906efc10. {{(pid=87169) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 04 12:18:02 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Creating volume glance metadata for volume ac78889e-53fb-4eec-bfdf-1389906efc10 backed by image 5fd6a6ac-1614-4aa5-aedb-17a31996018d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87169) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 04 12:18:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ef1855-69ff-4f0f-821b-1ea45b82bdd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac78889e-53fb-4eec-bfdf-1389906efc10', 'volume_size': 1, 'image_id': '5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '52d49d1f3a4b47a8a8f060da8e0e2c02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'created_at': datetime.datetime(2026, 11, 4, 11, 3, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 3, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fd6a6ac-1614-4aa5-aedb-17a31996018d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cc063752d80>}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bef6e47e-3bc5-4137-96c0-db7498b46733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:02 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Volume volume-ac78889e-53fb-4eec-bfdf-1389906efc10 (ac78889e-53fb-4eec-bfdf-1389906efc10): created successfully
Nov 04 12:18:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bef6e47e-3bc5-4137-96c0-db7498b46733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Flow 'volume_create_manager' (3b95f652-e766-4128-b6c8-4392e4ae7726) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:18:02 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-d5599fa2-683a-401f-95a7-c1a31f45a723 tempest-VolumesExtendTest-418001118 None] Created volume successfully.
Nov 04 12:18:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-68c0527a-18af-43dc-9633-00450a768a42 tempest-VolumesExtendTest-418001118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-68c0527a-18af-43dc-9633-00450a768a42 tempest-VolumesExtendTest-418001118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:03 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50eafd7-c8d5-43c5-8e86-1d52d47c0468]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:18:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-68c0527a-18af-43dc-9633-00450a768a42 tempest-VolumesExtendTest-418001118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ac78889e-53fb-4eec-bfdf-1389906efc10 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:03 devstack sudo[98545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ac78889e-53fb-4eec-bfdf-1389906efc10
Nov 04 12:18:03 devstack sudo[98545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:03 devstack sudo[98545]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-68c0527a-18af-43dc-9633-00450a768a42 tempest-VolumesExtendTest-418001118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ac78889e-53fb-4eec-bfdf-1389906efc10" returned: 0 in 0.889s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-68c0527a-18af-43dc-9633-00450a768a42 tempest-VolumesExtendTest-418001118 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ac78889e-53fb-4eec-bfdf-1389906efc10 2G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-68c0527a-18af-43dc-9633-00450a768a42 tempest-VolumesExtendTest-418001118 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ac78889e-53fb-4eec-bfdf-1389906efc10 2G" returned: 0 in 0.225s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-68c0527a-18af-43dc-9633-00450a768a42 tempest-VolumesExtendTest-418001118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.178s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:04 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-68c0527a-18af-43dc-9633-00450a768a42 tempest-VolumesExtendTest-418001118 None] Extend volume completed successfully.
Nov 04 12:18:06 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1cceed30-7dcc-4680-a6de-d32f3ced8e3b tempest-VolumesExtendTest-418001118 None] Acquiring lock "cinder-ac78889e-53fb-4eec-bfdf-1389906efc10-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:18:06 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1cceed30-7dcc-4680-a6de-d32f3ced8e3b tempest-VolumesExtendTest-418001118 None] Lock "cinder-ac78889e-53fb-4eec-bfdf-1389906efc10-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:18:06 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:UPDATE=186,cinder:DELETE=15,cinder:SELECT=144,cinder:INSERT=57 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:18:06 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1cceed30-7dcc-4680-a6de-d32f3ced8e3b tempest-VolumesExtendTest-418001118 None] Acquiring lock "cinder-quobyte-ac78889e-53fb-4eec-bfdf-1389906efc10" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:18:06 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1cceed30-7dcc-4680-a6de-d32f3ced8e3b tempest-VolumesExtendTest-418001118 None] Lock "cinder-quobyte-ac78889e-53fb-4eec-bfdf-1389906efc10" acquired by "delete_volume" :: waited 0.036s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:18:06 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[32544115-1219-4ef9-b1bf-2aefd46d5c19]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:18:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1cceed30-7dcc-4680-a6de-d32f3ced8e3b tempest-VolumesExtendTest-418001118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ac78889e-53fb-4eec-bfdf-1389906efc10 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:06 devstack sudo[98557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ac78889e-53fb-4eec-bfdf-1389906efc10
Nov 04 12:18:06 devstack sudo[98557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:07 devstack sudo[98557]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1cceed30-7dcc-4680-a6de-d32f3ced8e3b tempest-VolumesExtendTest-418001118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ac78889e-53fb-4eec-bfdf-1389906efc10" returned: 0 in 0.673s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1cceed30-7dcc-4680-a6de-d32f3ced8e3b tempest-VolumesExtendTest-418001118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ac78889e-53fb-4eec-bfdf-1389906efc10 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:07 devstack sudo[98563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ac78889e-53fb-4eec-bfdf-1389906efc10
Nov 04 12:18:07 devstack sudo[98563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:07 devstack sudo[98563]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1cceed30-7dcc-4680-a6de-d32f3ced8e3b tempest-VolumesExtendTest-418001118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ac78889e-53fb-4eec-bfdf-1389906efc10" returned: 0 in 0.554s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:07 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1cceed30-7dcc-4680-a6de-d32f3ced8e3b tempest-VolumesExtendTest-418001118 None] Lock "cinder-quobyte-ac78889e-53fb-4eec-bfdf-1389906efc10" released by "delete_volume" :: held 1.332s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:18:07 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-1cceed30-7dcc-4680-a6de-d32f3ced8e3b tempest-VolumesExtendTest-418001118 None] Created reservations ['ed3b15a1-2e9d-464b-9120-558d8e4dd8fd', '703f65f3-8931-4039-b200-4a48b3f3f5ff', 'eadb9df0-48b6-4d83-b2b1-4fa3a66d7efd', '0707ce4e-34b1-4d43-89b3-6fd8025ffa4f'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:18:07 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-1442ba30-8be3-4755-806f-7d325b060ae3 tempest-ProjectReaderTests-1624724882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:18:07 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1442ba30-8be3-4755-806f-7d325b060ae3 tempest-ProjectReaderTests-1624724882 None] Flow 'volume_create_manager' (41ecbb71-5986-4d35-82ca-de7701e27ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:18:07 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1442ba30-8be3-4755-806f-7d325b060ae3 tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64c44ea2-6c54-4971-b85e-e848d98970c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1442ba30-8be3-4755-806f-7d325b060ae3 tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64c44ea2-6c54-4971-b85e-e848d98970c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:18:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1729793254',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adb79070-6d32-4348-b30f-38c5dd614e63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86eb6c72cbf945018024d60d86244af3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:18:08Z,use_quota=True,user_id='7b43430a779343b78bf657cb3c191723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1442ba30-8be3-4755-806f-7d325b060ae3 tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7dcbac5-b555-4573-921e-2a3c35244585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1442ba30-8be3-4755-806f-7d325b060ae3 tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7dcbac5-b555-4573-921e-2a3c35244585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1442ba30-8be3-4755-806f-7d325b060ae3 tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc277461-0673-455d-a62e-edc534dd7809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1442ba30-8be3-4755-806f-7d325b060ae3 tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc277461-0673-455d-a62e-edc534dd7809) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adb79070-6d32-4348-b30f-38c5dd614e63', 'volume_name': 'volume-adb79070-6d32-4348-b30f-38c5dd614e63', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1442ba30-8be3-4755-806f-7d325b060ae3 tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c122e96-8966-4917-95bd-df928ef60ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1442ba30-8be3-4755-806f-7d325b060ae3 tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c122e96-8966-4917-95bd-df928ef60ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1442ba30-8be3-4755-806f-7d325b060ae3 tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a9d2aff-fb09-4470-ab00-ef725afa01a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:08 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-1442ba30-8be3-4755-806f-7d325b060ae3 tempest-ProjectReaderTests-1624724882 None] Volume adb79070-6d32-4348-b30f-38c5dd614e63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adb79070-6d32-4348-b30f-38c5dd614e63', 'volume_size': 1}
Nov 04 12:18:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1442ba30-8be3-4755-806f-7d325b060ae3 tempest-ProjectReaderTests-1624724882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1442ba30-8be3-4755-806f-7d325b060ae3 tempest-ProjectReaderTests-1624724882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:08 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1442ba30-8be3-4755-806f-7d325b060ae3 tempest-ProjectReaderTests-1624724882 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:18:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1729793254',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adb79070-6d32-4348-b30f-38c5dd614e63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86eb6c72cbf945018024d60d86244af3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:18:08Z,use_quota=True,user_id='7b43430a779343b78bf657cb3c191723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:18:08 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-1442ba30-8be3-4755-806f-7d325b060ae3 tempest-ProjectReaderTests-1624724882 None] Creating volume adb79070-6d32-4348-b30f-38c5dd614e63 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:18:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1442ba30-8be3-4755-806f-7d325b060ae3 tempest-ProjectReaderTests-1624724882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1442ba30-8be3-4755-806f-7d325b060ae3 tempest-ProjectReaderTests-1624724882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:08 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1442ba30-8be3-4755-806f-7d325b060ae3 tempest-ProjectReaderTests-1624724882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:18:08 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1442ba30-8be3-4755-806f-7d325b060ae3 tempest-ProjectReaderTests-1624724882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:18:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1442ba30-8be3-4755-806f-7d325b060ae3 tempest-ProjectReaderTests-1624724882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:08 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1442ba30-8be3-4755-806f-7d325b060ae3 tempest-ProjectReaderTests-1624724882 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:18:08 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-1442ba30-8be3-4755-806f-7d325b060ae3 tempest-ProjectReaderTests-1624724882 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:18:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1442ba30-8be3-4755-806f-7d325b060ae3 tempest-ProjectReaderTests-1624724882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-adb79070-6d32-4348-b30f-38c5dd614e63 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:08 devstack sudo[98567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-adb79070-6d32-4348-b30f-38c5dd614e63 1073741824
Nov 04 12:18:08 devstack sudo[98567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1cceed30-7dcc-4680-a6de-d32f3ced8e3b tempest-VolumesExtendTest-418001118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1cceed30-7dcc-4680-a6de-d32f3ced8e3b tempest-VolumesExtendTest-418001118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:08 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1cceed30-7dcc-4680-a6de-d32f3ced8e3b tempest-VolumesExtendTest-418001118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:18:08 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1cceed30-7dcc-4680-a6de-d32f3ced8e3b tempest-VolumesExtendTest-418001118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:18:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1cceed30-7dcc-4680-a6de-d32f3ced8e3b tempest-VolumesExtendTest-418001118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1cceed30-7dcc-4680-a6de-d32f3ced8e3b tempest-VolumesExtendTest-418001118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:08 devstack sudo[98569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:18:08 devstack sudo[98569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:08 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-b92bceae-203c-444b-9973-30d523b605b4 tempest-VolumesTestJSON-1001488751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:18:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b92bceae-203c-444b-9973-30d523b605b4 tempest-VolumesTestJSON-1001488751 None] Flow 'volume_create_manager' (6bf0dc21-4782-4fc8-a223-75d6b4db25b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:18:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b92bceae-203c-444b-9973-30d523b605b4 tempest-VolumesTestJSON-1001488751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9112736c-2dc9-4e7d-92de-acec937cf02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b92bceae-203c-444b-9973-30d523b605b4 tempest-VolumesTestJSON-1001488751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9112736c-2dc9-4e7d-92de-acec937cf02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-452561129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac9b5b5-45d1-455d-87a5-a155ce3c555c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='33e2211e29624f4f8ed507f454f8c1a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:18:08Z,use_quota=True,user_id='b6f2e6bf01124addadd99eacb2f341ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b92bceae-203c-444b-9973-30d523b605b4 tempest-VolumesTestJSON-1001488751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbcb5f59-6be7-40df-abce-d2df019c7d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b92bceae-203c-444b-9973-30d523b605b4 tempest-VolumesTestJSON-1001488751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbcb5f59-6be7-40df-abce-d2df019c7d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b92bceae-203c-444b-9973-30d523b605b4 tempest-VolumesTestJSON-1001488751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8184c83e-87d4-4d16-b5bc-cdb24df79cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b92bceae-203c-444b-9973-30d523b605b4 tempest-VolumesTestJSON-1001488751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8184c83e-87d4-4d16-b5bc-cdb24df79cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fac9b5b5-45d1-455d-87a5-a155ce3c555c', 'volume_name': 'volume-fac9b5b5-45d1-455d-87a5-a155ce3c555c', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:08 devstack sudo[98569]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b92bceae-203c-444b-9973-30d523b605b4 tempest-VolumesTestJSON-1001488751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2cce229-d054-4e1c-b621-c0cc6bd78428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b92bceae-203c-444b-9973-30d523b605b4 tempest-VolumesTestJSON-1001488751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2cce229-d054-4e1c-b621-c0cc6bd78428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b92bceae-203c-444b-9973-30d523b605b4 tempest-VolumesTestJSON-1001488751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4e41cce-cef1-4264-8841-e9fbd420b56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:08 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-b92bceae-203c-444b-9973-30d523b605b4 tempest-VolumesTestJSON-1001488751 None] Volume fac9b5b5-45d1-455d-87a5-a155ce3c555c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fac9b5b5-45d1-455d-87a5-a155ce3c555c', 'volume_size': 1}
Nov 04 12:18:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b92bceae-203c-444b-9973-30d523b605b4 tempest-VolumesTestJSON-1001488751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1cceed30-7dcc-4680-a6de-d32f3ced8e3b tempest-VolumesExtendTest-418001118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.396s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:08 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-1cceed30-7dcc-4680-a6de-d32f3ced8e3b tempest-VolumesExtendTest-418001118 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:18:08 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-1cceed30-7dcc-4680-a6de-d32f3ced8e3b tempest-VolumesExtendTest-418001118 None] Deleted volume successfully.
Nov 04 12:18:08 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1cceed30-7dcc-4680-a6de-d32f3ced8e3b tempest-VolumesExtendTest-418001118 None] Lock "cinder-ac78889e-53fb-4eec-bfdf-1389906efc10-delete_volume" released by "delete_volume" :: held 2.274s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:18:08 devstack sudo[98567]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1442ba30-8be3-4755-806f-7d325b060ae3 tempest-ProjectReaderTests-1624724882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-adb79070-6d32-4348-b30f-38c5dd614e63 1073741824" returned: 0 in 0.633s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1442ba30-8be3-4755-806f-7d325b060ae3 tempest-ProjectReaderTests-1624724882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-adb79070-6d32-4348-b30f-38c5dd614e63 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:08 devstack sudo[98577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-adb79070-6d32-4348-b30f-38c5dd614e63
Nov 04 12:18:08 devstack sudo[98577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:09 devstack sudo[98577]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1442ba30-8be3-4755-806f-7d325b060ae3 tempest-ProjectReaderTests-1624724882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-adb79070-6d32-4348-b30f-38c5dd614e63" returned: 0 in 0.272s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1442ba30-8be3-4755-806f-7d325b060ae3 tempest-ProjectReaderTests-1624724882 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1442ba30-8be3-4755-806f-7d325b060ae3 tempest-ProjectReaderTests-1624724882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b92bceae-203c-444b-9973-30d523b605b4 tempest-VolumesTestJSON-1001488751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.453s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-b92bceae-203c-444b-9973-30d523b605b4 tempest-VolumesTestJSON-1001488751 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-452561129',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fac9b5b5-45d1-455d-87a5-a155ce3c555c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='33e2211e29624f4f8ed507f454f8c1a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:18:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:18:08Z,use_quota=True,user_id='b6f2e6bf01124addadd99eacb2f341ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-b92bceae-203c-444b-9973-30d523b605b4 tempest-VolumesTestJSON-1001488751 None] Creating volume fac9b5b5-45d1-455d-87a5-a155ce3c555c {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b92bceae-203c-444b-9973-30d523b605b4 tempest-VolumesTestJSON-1001488751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b92bceae-203c-444b-9973-30d523b605b4 tempest-VolumesTestJSON-1001488751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-b92bceae-203c-444b-9973-30d523b605b4 tempest-VolumesTestJSON-1001488751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-b92bceae-203c-444b-9973-30d523b605b4 tempest-VolumesTestJSON-1001488751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b92bceae-203c-444b-9973-30d523b605b4 tempest-VolumesTestJSON-1001488751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-b92bceae-203c-444b-9973-30d523b605b4 tempest-VolumesTestJSON-1001488751 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:18:09 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-b92bceae-203c-444b-9973-30d523b605b4 tempest-VolumesTestJSON-1001488751 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b92bceae-203c-444b-9973-30d523b605b4 tempest-VolumesTestJSON-1001488751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fac9b5b5-45d1-455d-87a5-a155ce3c555c 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1442ba30-8be3-4755-806f-7d325b060ae3 tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a9d2aff-fb09-4470-ab00-ef725afa01a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adb79070-6d32-4348-b30f-38c5dd614e63', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:09 devstack sudo[98580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fac9b5b5-45d1-455d-87a5-a155ce3c555c 1073741824
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1442ba30-8be3-4755-806f-7d325b060ae3 tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5118e181-e020-4116-be67-982d8d229968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:09 devstack sudo[98580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:09 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-1442ba30-8be3-4755-806f-7d325b060ae3 tempest-ProjectReaderTests-1624724882 None] Volume volume-adb79070-6d32-4348-b30f-38c5dd614e63 (adb79070-6d32-4348-b30f-38c5dd614e63): created successfully
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1442ba30-8be3-4755-806f-7d325b060ae3 tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5118e181-e020-4116-be67-982d8d229968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1442ba30-8be3-4755-806f-7d325b060ae3 tempest-ProjectReaderTests-1624724882 None] Flow 'volume_create_manager' (41ecbb71-5986-4d35-82ca-de7701e27ce4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:18:09 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-1442ba30-8be3-4755-806f-7d325b060ae3 tempest-ProjectReaderTests-1624724882 None] Created volume successfully.
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c8cc0cd-5051-4c23-b5e8-6bbd8f5d71b7 tempest-VolumesExtendTest-418001118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2c8cc0cd-5051-4c23-b5e8-6bbd8f5d71b7 tempest-VolumesExtendTest-418001118 None] Flow 'volume_create_manager' (0078e9af-0fa4-4067-88e7-c02a3cd3ab1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2c8cc0cd-5051-4c23-b5e8-6bbd8f5d71b7 tempest-VolumesExtendTest-418001118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00af98da-3aad-4d6f-910e-afc7423d003a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2c8cc0cd-5051-4c23-b5e8-6bbd8f5d71b7 tempest-VolumesExtendTest-418001118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00af98da-3aad-4d6f-910e-afc7423d003a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-319623035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1765732a-6a4d-4e49-84b2-1ab3772243ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72857eb9f18b443b8205f4945ca52176',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:18:09Z,use_quota=True,user_id='78c4d48bb8a64758a7e7657ca956189d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2c8cc0cd-5051-4c23-b5e8-6bbd8f5d71b7 tempest-VolumesExtendTest-418001118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bcfc512-7c8c-4841-a28a-744099312cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2c8cc0cd-5051-4c23-b5e8-6bbd8f5d71b7 tempest-VolumesExtendTest-418001118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1bcfc512-7c8c-4841-a28a-744099312cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2c8cc0cd-5051-4c23-b5e8-6bbd8f5d71b7 tempest-VolumesExtendTest-418001118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7ef1b1b-514e-47ea-8c2d-e425daba851c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2c8cc0cd-5051-4c23-b5e8-6bbd8f5d71b7 tempest-VolumesExtendTest-418001118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7ef1b1b-514e-47ea-8c2d-e425daba851c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1765732a-6a4d-4e49-84b2-1ab3772243ce', 'volume_name': 'volume-1765732a-6a4d-4e49-84b2-1ab3772243ce', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2c8cc0cd-5051-4c23-b5e8-6bbd8f5d71b7 tempest-VolumesExtendTest-418001118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbdc6d5e-9a19-4a5b-b780-4751bc512499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2c8cc0cd-5051-4c23-b5e8-6bbd8f5d71b7 tempest-VolumesExtendTest-418001118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cbdc6d5e-9a19-4a5b-b780-4751bc512499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2c8cc0cd-5051-4c23-b5e8-6bbd8f5d71b7 tempest-VolumesExtendTest-418001118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94d622b0-d862-42ba-8f65-42cd13acb756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:09 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-2c8cc0cd-5051-4c23-b5e8-6bbd8f5d71b7 tempest-VolumesExtendTest-418001118 None] Volume 1765732a-6a4d-4e49-84b2-1ab3772243ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1765732a-6a4d-4e49-84b2-1ab3772243ce', 'volume_size': 1}
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2c8cc0cd-5051-4c23-b5e8-6bbd8f5d71b7 tempest-VolumesExtendTest-418001118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:09 devstack sudo[98580]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b92bceae-203c-444b-9973-30d523b605b4 tempest-VolumesTestJSON-1001488751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fac9b5b5-45d1-455d-87a5-a155ce3c555c 1073741824" returned: 0 in 0.484s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b92bceae-203c-444b-9973-30d523b605b4 tempest-VolumesTestJSON-1001488751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fac9b5b5-45d1-455d-87a5-a155ce3c555c {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:09 devstack sudo[98586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fac9b5b5-45d1-455d-87a5-a155ce3c555c
Nov 04 12:18:09 devstack sudo[98586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:09 devstack sudo[98586]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b92bceae-203c-444b-9973-30d523b605b4 tempest-VolumesTestJSON-1001488751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fac9b5b5-45d1-455d-87a5-a155ce3c555c" returned: 0 in 0.247s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-b92bceae-203c-444b-9973-30d523b605b4 tempest-VolumesTestJSON-1001488751 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b92bceae-203c-444b-9973-30d523b605b4 tempest-VolumesTestJSON-1001488751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2c8cc0cd-5051-4c23-b5e8-6bbd8f5d71b7 tempest-VolumesExtendTest-418001118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.330s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-2c8cc0cd-5051-4c23-b5e8-6bbd8f5d71b7 tempest-VolumesExtendTest-418001118 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:18:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-319623035',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1765732a-6a4d-4e49-84b2-1ab3772243ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72857eb9f18b443b8205f4945ca52176',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:18:09Z,use_quota=True,user_id='78c4d48bb8a64758a7e7657ca956189d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-2c8cc0cd-5051-4c23-b5e8-6bbd8f5d71b7 tempest-VolumesExtendTest-418001118 None] Creating volume 1765732a-6a4d-4e49-84b2-1ab3772243ce {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2c8cc0cd-5051-4c23-b5e8-6bbd8f5d71b7 tempest-VolumesExtendTest-418001118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2c8cc0cd-5051-4c23-b5e8-6bbd8f5d71b7 tempest-VolumesExtendTest-418001118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-2c8cc0cd-5051-4c23-b5e8-6bbd8f5d71b7 tempest-VolumesExtendTest-418001118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-2c8cc0cd-5051-4c23-b5e8-6bbd8f5d71b7 tempest-VolumesExtendTest-418001118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2c8cc0cd-5051-4c23-b5e8-6bbd8f5d71b7 tempest-VolumesExtendTest-418001118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-2c8cc0cd-5051-4c23-b5e8-6bbd8f5d71b7 tempest-VolumesExtendTest-418001118 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:18:09 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-2c8cc0cd-5051-4c23-b5e8-6bbd8f5d71b7 tempest-VolumesExtendTest-418001118 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2c8cc0cd-5051-4c23-b5e8-6bbd8f5d71b7 tempest-VolumesExtendTest-418001118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b92bceae-203c-444b-9973-30d523b605b4 tempest-VolumesTestJSON-1001488751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4e41cce-cef1-4264-8841-e9fbd420b56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fac9b5b5-45d1-455d-87a5-a155ce3c555c', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b92bceae-203c-444b-9973-30d523b605b4 tempest-VolumesTestJSON-1001488751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a594ac6-d377-45cb-b0ac-dafb4d886db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:09 devstack sudo[98589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce 1073741824
Nov 04 12:18:09 devstack sudo[98589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:09 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-b92bceae-203c-444b-9973-30d523b605b4 tempest-VolumesTestJSON-1001488751 None] Volume volume-fac9b5b5-45d1-455d-87a5-a155ce3c555c (fac9b5b5-45d1-455d-87a5-a155ce3c555c): created successfully
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b92bceae-203c-444b-9973-30d523b605b4 tempest-VolumesTestJSON-1001488751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a594ac6-d377-45cb-b0ac-dafb4d886db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b92bceae-203c-444b-9973-30d523b605b4 tempest-VolumesTestJSON-1001488751 None] Flow 'volume_create_manager' (6bf0dc21-4782-4fc8-a223-75d6b4db25b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:18:09 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-b92bceae-203c-444b-9973-30d523b605b4 tempest-VolumesTestJSON-1001488751 None] Created volume successfully.
Nov 04 12:18:10 devstack sudo[98589]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:10 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-6a1d4e59-9769-4146-9e40-b02cdc3d9710 tempest-ProjectReaderTests-1624724882 None] Acquiring lock "cinder-adb79070-6d32-4348-b30f-38c5dd614e63-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:18:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2c8cc0cd-5051-4c23-b5e8-6bbd8f5d71b7 tempest-VolumesExtendTest-418001118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce 1073741824" returned: 0 in 0.469s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:10 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-6a1d4e59-9769-4146-9e40-b02cdc3d9710 tempest-ProjectReaderTests-1624724882 None] Lock "cinder-adb79070-6d32-4348-b30f-38c5dd614e63-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:18:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2c8cc0cd-5051-4c23-b5e8-6bbd8f5d71b7 tempest-VolumesExtendTest-418001118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:10 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-6a1d4e59-9769-4146-9e40-b02cdc3d9710 tempest-ProjectReaderTests-1624724882 None] Acquiring lock "cinder-quobyte-adb79070-6d32-4348-b30f-38c5dd614e63" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:18:10 devstack sudo[98595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce
Nov 04 12:18:10 devstack sudo[98595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:10 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-6a1d4e59-9769-4146-9e40-b02cdc3d9710 tempest-ProjectReaderTests-1624724882 None] Lock "cinder-quobyte-adb79070-6d32-4348-b30f-38c5dd614e63" acquired by "delete_volume" :: waited 0.019s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:18:10 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e4f347-4089-4855-a6c1-c770dac2d66f]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:18:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6a1d4e59-9769-4146-9e40-b02cdc3d9710 tempest-ProjectReaderTests-1624724882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-adb79070-6d32-4348-b30f-38c5dd614e63 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:10 devstack sudo[98597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-adb79070-6d32-4348-b30f-38c5dd614e63
Nov 04 12:18:10 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2c8cc0cd-5051-4c23-b5e8-6bbd8f5d71b7 tempest-VolumesExtendTest-418001118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce" returned: 0 in 0.292s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:10 devstack sudo[98595]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:10 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-2c8cc0cd-5051-4c23-b5e8-6bbd8f5d71b7 tempest-VolumesExtendTest-418001118 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:18:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2c8cc0cd-5051-4c23-b5e8-6bbd8f5d71b7 tempest-VolumesExtendTest-418001118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:10 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2c8cc0cd-5051-4c23-b5e8-6bbd8f5d71b7 tempest-VolumesExtendTest-418001118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94d622b0-d862-42ba-8f65-42cd13acb756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1765732a-6a4d-4e49-84b2-1ab3772243ce', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:10 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2c8cc0cd-5051-4c23-b5e8-6bbd8f5d71b7 tempest-VolumesExtendTest-418001118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a96f8c2-3fe9-43e3-ae3b-53292f22c9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:10 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-2c8cc0cd-5051-4c23-b5e8-6bbd8f5d71b7 tempest-VolumesExtendTest-418001118 None] Volume volume-1765732a-6a4d-4e49-84b2-1ab3772243ce (1765732a-6a4d-4e49-84b2-1ab3772243ce): created successfully
Nov 04 12:18:10 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2c8cc0cd-5051-4c23-b5e8-6bbd8f5d71b7 tempest-VolumesExtendTest-418001118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a96f8c2-3fe9-43e3-ae3b-53292f22c9a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:10 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2c8cc0cd-5051-4c23-b5e8-6bbd8f5d71b7 tempest-VolumesExtendTest-418001118 None] Flow 'volume_create_manager' (0078e9af-0fa4-4067-88e7-c02a3cd3ab1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:18:10 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-2c8cc0cd-5051-4c23-b5e8-6bbd8f5d71b7 tempest-VolumesExtendTest-418001118 None] Created volume successfully.
Nov 04 12:18:10 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6a1d4e59-9769-4146-9e40-b02cdc3d9710 tempest-ProjectReaderTests-1624724882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-adb79070-6d32-4348-b30f-38c5dd614e63" returned: 0 in 0.488s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6a1d4e59-9769-4146-9e40-b02cdc3d9710 tempest-ProjectReaderTests-1624724882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-adb79070-6d32-4348-b30f-38c5dd614e63 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:10 devstack sudo[98603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-adb79070-6d32-4348-b30f-38c5dd614e63
Nov 04 12:18:10 devstack sudo[98603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:11 devstack sudo[98603]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6a1d4e59-9769-4146-9e40-b02cdc3d9710 tempest-ProjectReaderTests-1624724882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-adb79070-6d32-4348-b30f-38c5dd614e63" returned: 0 in 0.273s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:11 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-6a1d4e59-9769-4146-9e40-b02cdc3d9710 tempest-ProjectReaderTests-1624724882 None] Lock "cinder-quobyte-adb79070-6d32-4348-b30f-38c5dd614e63" released by "delete_volume" :: held 0.834s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:18:11 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-041dfa51-eec1-4e41-891d-ec62b52b2cde tempest-VolumesTestJSON-1001488751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:18:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-041dfa51-eec1-4e41-891d-ec62b52b2cde tempest-VolumesTestJSON-1001488751 None] Flow 'volume_create_manager' (417dd413-6e82-40f9-b730-b79f9ceb9de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:18:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-041dfa51-eec1-4e41-891d-ec62b52b2cde tempest-VolumesTestJSON-1001488751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ab0169b-420d-495a-a0b3-8d2a4f78e657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-041dfa51-eec1-4e41-891d-ec62b52b2cde tempest-VolumesTestJSON-1001488751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ab0169b-420d-495a-a0b3-8d2a4f78e657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1214239726',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59195d0f-ccbb-4e93-817b-b4df61dea099,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='33e2211e29624f4f8ed507f454f8c1a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:18:11Z,use_quota=True,user_id='b6f2e6bf01124addadd99eacb2f341ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-041dfa51-eec1-4e41-891d-ec62b52b2cde tempest-VolumesTestJSON-1001488751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d657a2eb-8865-4957-8e88-2e5df3c00c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-041dfa51-eec1-4e41-891d-ec62b52b2cde tempest-VolumesTestJSON-1001488751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d657a2eb-8865-4957-8e88-2e5df3c00c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-041dfa51-eec1-4e41-891d-ec62b52b2cde tempest-VolumesTestJSON-1001488751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91e563c9-de46-44e7-bb02-421a42b41ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-041dfa51-eec1-4e41-891d-ec62b52b2cde tempest-VolumesTestJSON-1001488751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91e563c9-de46-44e7-bb02-421a42b41ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59195d0f-ccbb-4e93-817b-b4df61dea099', 'volume_name': 'volume-59195d0f-ccbb-4e93-817b-b4df61dea099', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-041dfa51-eec1-4e41-891d-ec62b52b2cde tempest-VolumesTestJSON-1001488751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25df6ef7-4b31-4671-8233-d120aa309c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-041dfa51-eec1-4e41-891d-ec62b52b2cde tempest-VolumesTestJSON-1001488751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25df6ef7-4b31-4671-8233-d120aa309c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-041dfa51-eec1-4e41-891d-ec62b52b2cde tempest-VolumesTestJSON-1001488751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a593f46-ac06-42a0-9e4c-77e4aaa8f49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:11 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-041dfa51-eec1-4e41-891d-ec62b52b2cde tempest-VolumesTestJSON-1001488751 None] Volume 59195d0f-ccbb-4e93-817b-b4df61dea099: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59195d0f-ccbb-4e93-817b-b4df61dea099', 'volume_size': 1}
Nov 04 12:18:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-041dfa51-eec1-4e41-891d-ec62b52b2cde tempest-VolumesTestJSON-1001488751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-041dfa51-eec1-4e41-891d-ec62b52b2cde tempest-VolumesTestJSON-1001488751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:11 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-041dfa51-eec1-4e41-891d-ec62b52b2cde tempest-VolumesTestJSON-1001488751 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1214239726',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59195d0f-ccbb-4e93-817b-b4df61dea099,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='33e2211e29624f4f8ed507f454f8c1a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:18:11Z,use_quota=True,user_id='b6f2e6bf01124addadd99eacb2f341ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:18:11 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-041dfa51-eec1-4e41-891d-ec62b52b2cde tempest-VolumesTestJSON-1001488751 None] Creating volume 59195d0f-ccbb-4e93-817b-b4df61dea099 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:18:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-041dfa51-eec1-4e41-891d-ec62b52b2cde tempest-VolumesTestJSON-1001488751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-041dfa51-eec1-4e41-891d-ec62b52b2cde tempest-VolumesTestJSON-1001488751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:11 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-041dfa51-eec1-4e41-891d-ec62b52b2cde tempest-VolumesTestJSON-1001488751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:18:11 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-041dfa51-eec1-4e41-891d-ec62b52b2cde tempest-VolumesTestJSON-1001488751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:18:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-041dfa51-eec1-4e41-891d-ec62b52b2cde tempest-VolumesTestJSON-1001488751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:11 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-041dfa51-eec1-4e41-891d-ec62b52b2cde tempest-VolumesTestJSON-1001488751 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:18:11 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-041dfa51-eec1-4e41-891d-ec62b52b2cde tempest-VolumesTestJSON-1001488751 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:18:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-041dfa51-eec1-4e41-891d-ec62b52b2cde tempest-VolumesTestJSON-1001488751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-59195d0f-ccbb-4e93-817b-b4df61dea099 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:11 devstack sudo[98607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-59195d0f-ccbb-4e93-817b-b4df61dea099 1073741824
Nov 04 12:18:11 devstack sudo[98607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:11 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-6a1d4e59-9769-4146-9e40-b02cdc3d9710 tempest-ProjectReaderTests-1624724882 None] Created reservations ['d4f0ddb5-6979-434b-abac-9cb05c90e45c', 'a6fa78da-3e73-439e-8a95-376759cac860', 'e9a490d7-aaa4-49f9-9601-dc5c04945d94', 'dc155b3d-b28f-4144-a057-2531c5d41475'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:18:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-6a1d4e59-9769-4146-9e40-b02cdc3d9710 tempest-ProjectReaderTests-1624724882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-6a1d4e59-9769-4146-9e40-b02cdc3d9710 tempest-ProjectReaderTests-1624724882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:11 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-6a1d4e59-9769-4146-9e40-b02cdc3d9710 tempest-ProjectReaderTests-1624724882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:18:11 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-6a1d4e59-9769-4146-9e40-b02cdc3d9710 tempest-ProjectReaderTests-1624724882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:18:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-6a1d4e59-9769-4146-9e40-b02cdc3d9710 tempest-ProjectReaderTests-1624724882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6a1d4e59-9769-4146-9e40-b02cdc3d9710 tempest-ProjectReaderTests-1624724882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:11 devstack sudo[98609]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:18:11 devstack sudo[98609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-86a66576-7153-455c-bc22-5b6d19bdbad0 tempest-VolumesExtendTest-418001118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:11 devstack sudo[98609]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6a1d4e59-9769-4146-9e40-b02cdc3d9710 tempest-ProjectReaderTests-1624724882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.331s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:11 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-6a1d4e59-9769-4146-9e40-b02cdc3d9710 tempest-ProjectReaderTests-1624724882 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:18:11 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-6a1d4e59-9769-4146-9e40-b02cdc3d9710 tempest-ProjectReaderTests-1624724882 None] Deleted volume successfully.
Nov 04 12:18:11 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-6a1d4e59-9769-4146-9e40-b02cdc3d9710 tempest-ProjectReaderTests-1624724882 None] Lock "cinder-adb79070-6d32-4348-b30f-38c5dd614e63-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:18:11 devstack sudo[98607]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-041dfa51-eec1-4e41-891d-ec62b52b2cde tempest-VolumesTestJSON-1001488751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-59195d0f-ccbb-4e93-817b-b4df61dea099 1073741824" returned: 0 in 0.634s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-041dfa51-eec1-4e41-891d-ec62b52b2cde tempest-VolumesTestJSON-1001488751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-59195d0f-ccbb-4e93-817b-b4df61dea099 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:12 devstack sudo[98616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-59195d0f-ccbb-4e93-817b-b4df61dea099
Nov 04 12:18:12 devstack sudo[98616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:12 devstack sudo[98616]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-041dfa51-eec1-4e41-891d-ec62b52b2cde tempest-VolumesTestJSON-1001488751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-59195d0f-ccbb-4e93-817b-b4df61dea099" returned: 0 in 0.267s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:12 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-041dfa51-eec1-4e41-891d-ec62b52b2cde tempest-VolumesTestJSON-1001488751 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:18:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-041dfa51-eec1-4e41-891d-ec62b52b2cde tempest-VolumesTestJSON-1001488751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-86a66576-7153-455c-bc22-5b6d19bdbad0 tempest-VolumesExtendTest-418001118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.431s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:12 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-041dfa51-eec1-4e41-891d-ec62b52b2cde tempest-VolumesTestJSON-1001488751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a593f46-ac06-42a0-9e4c-77e4aaa8f49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59195d0f-ccbb-4e93-817b-b4df61dea099', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:12 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-041dfa51-eec1-4e41-891d-ec62b52b2cde tempest-VolumesTestJSON-1001488751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08a3cc1c-707f-4642-a904-9738e54ad67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:12 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-86a66576-7153-455c-bc22-5b6d19bdbad0 tempest-VolumesExtendTest-418001118 None] Creating offline snapshot f32c653a-8988-4106-8665-ada4a813bff2 of volume 1765732a-6a4d-4e49-84b2-1ab3772243ce {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:18:12 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0c1cfd-f86f-442d-bfb7-5271ba502eba]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:18:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-86a66576-7153-455c-bc22-5b6d19bdbad0 tempest-VolumesExtendTest-418001118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:12 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-041dfa51-eec1-4e41-891d-ec62b52b2cde tempest-VolumesTestJSON-1001488751 None] Volume volume-59195d0f-ccbb-4e93-817b-b4df61dea099 (59195d0f-ccbb-4e93-817b-b4df61dea099): created successfully
Nov 04 12:18:12 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-041dfa51-eec1-4e41-891d-ec62b52b2cde tempest-VolumesTestJSON-1001488751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08a3cc1c-707f-4642-a904-9738e54ad67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:12 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-041dfa51-eec1-4e41-891d-ec62b52b2cde tempest-VolumesTestJSON-1001488751 None] Flow 'volume_create_manager' (417dd413-6e82-40f9-b730-b79f9ceb9de2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:18:12 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-041dfa51-eec1-4e41-891d-ec62b52b2cde tempest-VolumesTestJSON-1001488751 None] Created volume successfully.
Nov 04 12:18:12 devstack sudo[98619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce
Nov 04 12:18:12 devstack sudo[98619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:12 devstack sudo[98619]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-86a66576-7153-455c-bc22-5b6d19bdbad0 tempest-VolumesExtendTest-418001118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce" returned: 0 in 0.444s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-86a66576-7153-455c-bc22-5b6d19bdbad0 tempest-VolumesExtendTest-418001118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce.f32c653a-8988-4106-8665-ada4a813bff2 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:12 devstack sudo[98624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce.f32c653a-8988-4106-8665-ada4a813bff2 1G
Nov 04 12:18:12 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:13 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-413cc908-369a-4daa-9ff4-7ca911840a9f tempest-ProjectReaderTests-1624724882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:18:13 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-413cc908-369a-4daa-9ff4-7ca911840a9f tempest-ProjectReaderTests-1624724882 None] Flow 'volume_create_manager' (de88f504-cc42-447a-823a-4730775a82ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:18:13 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-413cc908-369a-4daa-9ff4-7ca911840a9f tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4b689b1-3bc0-4722-bb2a-5e8d71fb2a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:13 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-413cc908-369a-4daa-9ff4-7ca911840a9f tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4b689b1-3bc0-4722-bb2a-5e8d71fb2a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-78007689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21758ec2-ef35-4ca5-9d36-aa538802fba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86eb6c72cbf945018024d60d86244af3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:18:13Z,use_quota=True,user_id='7b43430a779343b78bf657cb3c191723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:13 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-413cc908-369a-4daa-9ff4-7ca911840a9f tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75222596-58a1-46d9-b0f3-4b76718bff82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:13 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-413cc908-369a-4daa-9ff4-7ca911840a9f tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75222596-58a1-46d9-b0f3-4b76718bff82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:13 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-413cc908-369a-4daa-9ff4-7ca911840a9f tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0b6fe7f-92f1-4120-ad68-6090a05313bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:13 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-413cc908-369a-4daa-9ff4-7ca911840a9f tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0b6fe7f-92f1-4120-ad68-6090a05313bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21758ec2-ef35-4ca5-9d36-aa538802fba8', 'volume_name': 'volume-21758ec2-ef35-4ca5-9d36-aa538802fba8', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:13 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-413cc908-369a-4daa-9ff4-7ca911840a9f tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bc0bf6f-5847-40ec-83e6-c6827a728c07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:13 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-413cc908-369a-4daa-9ff4-7ca911840a9f tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bc0bf6f-5847-40ec-83e6-c6827a728c07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:13 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-413cc908-369a-4daa-9ff4-7ca911840a9f tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaf36525-5262-49b1-a743-75edb76e2196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:13 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-413cc908-369a-4daa-9ff4-7ca911840a9f tempest-ProjectReaderTests-1624724882 None] Volume 21758ec2-ef35-4ca5-9d36-aa538802fba8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21758ec2-ef35-4ca5-9d36-aa538802fba8', 'volume_size': 1}
Nov 04 12:18:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-413cc908-369a-4daa-9ff4-7ca911840a9f tempest-ProjectReaderTests-1624724882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:13 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-86a66576-7153-455c-bc22-5b6d19bdbad0 tempest-VolumesExtendTest-418001118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce.f32c653a-8988-4106-8665-ada4a813bff2 1G" returned: 0 in 0.509s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-86a66576-7153-455c-bc22-5b6d19bdbad0 tempest-VolumesExtendTest-418001118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1765732a-6a4d-4e49-84b2-1ab3772243ce -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce.f32c653a-8988-4106-8665-ada4a813bff2 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:13 devstack sudo[98629]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1765732a-6a4d-4e49-84b2-1ab3772243ce -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce.f32c653a-8988-4106-8665-ada4a813bff2
Nov 04 12:18:13 devstack sudo[98629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:13 devstack sudo[98629]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-86a66576-7153-455c-bc22-5b6d19bdbad0 tempest-VolumesExtendTest-418001118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1765732a-6a4d-4e49-84b2-1ab3772243ce -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce.f32c653a-8988-4106-8665-ada4a813bff2" returned: 0 in 0.312s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:13 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-86a66576-7153-455c-bc22-5b6d19bdbad0 tempest-VolumesExtendTest-418001118 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce.f32c653a-8988-4106-8665-ada4a813bff2 is being set with open permissions: ugo+rw
Nov 04 12:18:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-86a66576-7153-455c-bc22-5b6d19bdbad0 tempest-VolumesExtendTest-418001118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce.f32c653a-8988-4106-8665-ada4a813bff2 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:13 devstack sudo[98635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce.f32c653a-8988-4106-8665-ada4a813bff2
Nov 04 12:18:13 devstack sudo[98635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:13 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0c10edb-c115-461e-b2b2-24c0fd16d984 tempest-VolumesTestJSON-1001488751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:18:13 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d0c10edb-c115-461e-b2b2-24c0fd16d984 tempest-VolumesTestJSON-1001488751 None] Flow 'volume_create_manager' (7c9ed9e6-60b1-45d8-91b2-92110831da66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:18:13 devstack sudo[98635]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:13 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d0c10edb-c115-461e-b2b2-24c0fd16d984 tempest-VolumesTestJSON-1001488751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca724ed8-beda-42d7-9754-442e45ef05d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-86a66576-7153-455c-bc22-5b6d19bdbad0 tempest-VolumesExtendTest-418001118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce.f32c653a-8988-4106-8665-ada4a813bff2" returned: 0 in 0.297s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:13 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d0c10edb-c115-461e-b2b2-24c0fd16d984 tempest-VolumesTestJSON-1001488751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca724ed8-beda-42d7-9754-442e45ef05d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1693628391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0843832-65d1-42e8-828a-191030bc67fd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='33e2211e29624f4f8ed507f454f8c1a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:18:14Z,use_quota=True,user_id='b6f2e6bf01124addadd99eacb2f341ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:13 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d0c10edb-c115-461e-b2b2-24c0fd16d984 tempest-VolumesTestJSON-1001488751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (664727a9-5ccc-4fd4-b42e-59729fc27e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:13 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d0c10edb-c115-461e-b2b2-24c0fd16d984 tempest-VolumesTestJSON-1001488751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (664727a9-5ccc-4fd4-b42e-59729fc27e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:13 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d0c10edb-c115-461e-b2b2-24c0fd16d984 tempest-VolumesTestJSON-1001488751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b00844e-f7e8-4fd7-aa6e-8d55e25d79fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:13 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d0c10edb-c115-461e-b2b2-24c0fd16d984 tempest-VolumesTestJSON-1001488751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b00844e-f7e8-4fd7-aa6e-8d55e25d79fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0843832-65d1-42e8-828a-191030bc67fd', 'volume_name': 'volume-d0843832-65d1-42e8-828a-191030bc67fd', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:13 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d0c10edb-c115-461e-b2b2-24c0fd16d984 tempest-VolumesTestJSON-1001488751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0310b432-f310-494d-9b59-06c823417663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:13 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d0c10edb-c115-461e-b2b2-24c0fd16d984 tempest-VolumesTestJSON-1001488751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0310b432-f310-494d-9b59-06c823417663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:13 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d0c10edb-c115-461e-b2b2-24c0fd16d984 tempest-VolumesTestJSON-1001488751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b221fcf-1c1d-40c7-96ad-528e3fba9213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:13 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-d0c10edb-c115-461e-b2b2-24c0fd16d984 tempest-VolumesTestJSON-1001488751 None] Volume d0843832-65d1-42e8-828a-191030bc67fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0843832-65d1-42e8-828a-191030bc67fd', 'volume_size': 1}
Nov 04 12:18:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d0c10edb-c115-461e-b2b2-24c0fd16d984 tempest-VolumesTestJSON-1001488751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-86a66576-7153-455c-bc22-5b6d19bdbad0 tempest-VolumesExtendTest-418001118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:14 devstack sudo[98638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce.info
Nov 04 12:18:14 devstack sudo[98638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:14 devstack sudo[98638]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-86a66576-7153-455c-bc22-5b6d19bdbad0 tempest-VolumesExtendTest-418001118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce.info" returned: 0 in 0.269s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:14 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-86a66576-7153-455c-bc22-5b6d19bdbad0 tempest-VolumesExtendTest-418001118 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce.info is being set with open permissions: ugo+rw
Nov 04 12:18:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-86a66576-7153-455c-bc22-5b6d19bdbad0 tempest-VolumesExtendTest-418001118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:14 devstack sudo[98641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce.info
Nov 04 12:18:14 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:14 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-86a66576-7153-455c-bc22-5b6d19bdbad0 tempest-VolumesExtendTest-418001118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce.info" returned: 0 in 0.247s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-86a66576-7153-455c-bc22-5b6d19bdbad0 tempest-VolumesExtendTest-418001118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.262s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-413cc908-369a-4daa-9ff4-7ca911840a9f tempest-ProjectReaderTests-1624724882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.278s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:14 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-413cc908-369a-4daa-9ff4-7ca911840a9f tempest-ProjectReaderTests-1624724882 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:18:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-78007689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21758ec2-ef35-4ca5-9d36-aa538802fba8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86eb6c72cbf945018024d60d86244af3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:18:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:18:13Z,use_quota=True,user_id='7b43430a779343b78bf657cb3c191723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:18:14 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-413cc908-369a-4daa-9ff4-7ca911840a9f tempest-ProjectReaderTests-1624724882 None] Creating volume 21758ec2-ef35-4ca5-9d36-aa538802fba8 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:18:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-413cc908-369a-4daa-9ff4-7ca911840a9f tempest-ProjectReaderTests-1624724882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-413cc908-369a-4daa-9ff4-7ca911840a9f tempest-ProjectReaderTests-1624724882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:14 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-413cc908-369a-4daa-9ff4-7ca911840a9f tempest-ProjectReaderTests-1624724882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:18:14 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-413cc908-369a-4daa-9ff4-7ca911840a9f tempest-ProjectReaderTests-1624724882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:18:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-413cc908-369a-4daa-9ff4-7ca911840a9f tempest-ProjectReaderTests-1624724882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:14 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-413cc908-369a-4daa-9ff4-7ca911840a9f tempest-ProjectReaderTests-1624724882 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:18:14 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-413cc908-369a-4daa-9ff4-7ca911840a9f tempest-ProjectReaderTests-1624724882 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:18:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-413cc908-369a-4daa-9ff4-7ca911840a9f tempest-ProjectReaderTests-1624724882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21758ec2-ef35-4ca5-9d36-aa538802fba8 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:14 devstack sudo[98644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21758ec2-ef35-4ca5-9d36-aa538802fba8 1073741824
Nov 04 12:18:14 devstack sudo[98644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:14 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-86a66576-7153-455c-bc22-5b6d19bdbad0 tempest-VolumesExtendTest-418001118 None] Create snapshot completed successfully
Nov 04 12:18:15 devstack sudo[98644]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-413cc908-369a-4daa-9ff4-7ca911840a9f tempest-ProjectReaderTests-1624724882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21758ec2-ef35-4ca5-9d36-aa538802fba8 1073741824" returned: 0 in 0.455s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-413cc908-369a-4daa-9ff4-7ca911840a9f tempest-ProjectReaderTests-1624724882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21758ec2-ef35-4ca5-9d36-aa538802fba8 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:15 devstack sudo[98649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21758ec2-ef35-4ca5-9d36-aa538802fba8
Nov 04 12:18:15 devstack sudo[98649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3697cd56-df4a-4c5f-9213-02498021def2 tempest-VolumesExtendTest-418001118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:15 devstack sudo[98649]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-413cc908-369a-4daa-9ff4-7ca911840a9f tempest-ProjectReaderTests-1624724882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21758ec2-ef35-4ca5-9d36-aa538802fba8" returned: 0 in 0.275s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:15 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-413cc908-369a-4daa-9ff4-7ca911840a9f tempest-ProjectReaderTests-1624724882 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:18:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-413cc908-369a-4daa-9ff4-7ca911840a9f tempest-ProjectReaderTests-1624724882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d0c10edb-c115-461e-b2b2-24c0fd16d984 tempest-VolumesTestJSON-1001488751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.342s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:15 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d0c10edb-c115-461e-b2b2-24c0fd16d984 tempest-VolumesTestJSON-1001488751 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:18:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1693628391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0843832-65d1-42e8-828a-191030bc67fd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='33e2211e29624f4f8ed507f454f8c1a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:18:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:18:14Z,use_quota=True,user_id='b6f2e6bf01124addadd99eacb2f341ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:18:15 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-d0c10edb-c115-461e-b2b2-24c0fd16d984 tempest-VolumesTestJSON-1001488751 None] Creating volume d0843832-65d1-42e8-828a-191030bc67fd {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:18:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d0c10edb-c115-461e-b2b2-24c0fd16d984 tempest-VolumesTestJSON-1001488751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d0c10edb-c115-461e-b2b2-24c0fd16d984 tempest-VolumesTestJSON-1001488751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:15 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d0c10edb-c115-461e-b2b2-24c0fd16d984 tempest-VolumesTestJSON-1001488751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:18:15 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d0c10edb-c115-461e-b2b2-24c0fd16d984 tempest-VolumesTestJSON-1001488751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:18:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d0c10edb-c115-461e-b2b2-24c0fd16d984 tempest-VolumesTestJSON-1001488751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:15 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d0c10edb-c115-461e-b2b2-24c0fd16d984 tempest-VolumesTestJSON-1001488751 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:18:15 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-d0c10edb-c115-461e-b2b2-24c0fd16d984 tempest-VolumesTestJSON-1001488751 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:18:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0c10edb-c115-461e-b2b2-24c0fd16d984 tempest-VolumesTestJSON-1001488751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d0843832-65d1-42e8-828a-191030bc67fd 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:15 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-413cc908-369a-4daa-9ff4-7ca911840a9f tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaf36525-5262-49b1-a743-75edb76e2196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21758ec2-ef35-4ca5-9d36-aa538802fba8', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:15 devstack sudo[98652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d0843832-65d1-42e8-828a-191030bc67fd 1073741824
Nov 04 12:18:15 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-413cc908-369a-4daa-9ff4-7ca911840a9f tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6bbf82b-ef52-4086-befd-bb1f4dc7954b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:15 devstack sudo[98652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:15 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-413cc908-369a-4daa-9ff4-7ca911840a9f tempest-ProjectReaderTests-1624724882 None] Volume volume-21758ec2-ef35-4ca5-9d36-aa538802fba8 (21758ec2-ef35-4ca5-9d36-aa538802fba8): created successfully
Nov 04 12:18:15 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-413cc908-369a-4daa-9ff4-7ca911840a9f tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6bbf82b-ef52-4086-befd-bb1f4dc7954b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:15 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-413cc908-369a-4daa-9ff4-7ca911840a9f tempest-ProjectReaderTests-1624724882 None] Flow 'volume_create_manager' (de88f504-cc42-447a-823a-4730775a82ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:18:15 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-413cc908-369a-4daa-9ff4-7ca911840a9f tempest-ProjectReaderTests-1624724882 None] Created volume successfully.
Nov 04 12:18:15 devstack sudo[98652]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0c10edb-c115-461e-b2b2-24c0fd16d984 tempest-VolumesTestJSON-1001488751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d0843832-65d1-42e8-828a-191030bc67fd 1073741824" returned: 0 in 0.450s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0c10edb-c115-461e-b2b2-24c0fd16d984 tempest-VolumesTestJSON-1001488751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d0843832-65d1-42e8-828a-191030bc67fd {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:15 devstack sudo[98657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d0843832-65d1-42e8-828a-191030bc67fd
Nov 04 12:18:15 devstack sudo[98657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:16 devstack sudo[98657]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0c10edb-c115-461e-b2b2-24c0fd16d984 tempest-VolumesTestJSON-1001488751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d0843832-65d1-42e8-828a-191030bc67fd" returned: 0 in 0.263s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:16 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d0c10edb-c115-461e-b2b2-24c0fd16d984 tempest-VolumesTestJSON-1001488751 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:18:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d0c10edb-c115-461e-b2b2-24c0fd16d984 tempest-VolumesTestJSON-1001488751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3697cd56-df4a-4c5f-9213-02498021def2 tempest-VolumesExtendTest-418001118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.967s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:16 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d0c10edb-c115-461e-b2b2-24c0fd16d984 tempest-VolumesTestJSON-1001488751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b221fcf-1c1d-40c7-96ad-528e3fba9213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0843832-65d1-42e8-828a-191030bc67fd', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:16 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d0c10edb-c115-461e-b2b2-24c0fd16d984 tempest-VolumesTestJSON-1001488751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98afcd72-ac7b-4fca-92f3-37b3fd9143db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:16 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[2703598c-6a48-4f3d-9aa7-c79ebfe64182]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:18:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3697cd56-df4a-4c5f-9213-02498021def2 tempest-VolumesExtendTest-418001118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:16 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-d0c10edb-c115-461e-b2b2-24c0fd16d984 tempest-VolumesTestJSON-1001488751 None] Volume volume-d0843832-65d1-42e8-828a-191030bc67fd (d0843832-65d1-42e8-828a-191030bc67fd): created successfully
Nov 04 12:18:16 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d0c10edb-c115-461e-b2b2-24c0fd16d984 tempest-VolumesTestJSON-1001488751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98afcd72-ac7b-4fca-92f3-37b3fd9143db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:16 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d0c10edb-c115-461e-b2b2-24c0fd16d984 tempest-VolumesTestJSON-1001488751 None] Flow 'volume_create_manager' (7c9ed9e6-60b1-45d8-91b2-92110831da66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:18:16 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-d0c10edb-c115-461e-b2b2-24c0fd16d984 tempest-VolumesTestJSON-1001488751 None] Created volume successfully.
Nov 04 12:18:16 devstack sudo[98669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce
Nov 04 12:18:16 devstack sudo[98669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:16 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1e493231-fee9-4415-979d-2a6445cadcba tempest-ProjectReaderTests-1624724882 None] Acquiring lock "cinder-21758ec2-ef35-4ca5-9d36-aa538802fba8-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:18:16 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1e493231-fee9-4415-979d-2a6445cadcba tempest-ProjectReaderTests-1624724882 None] Lock "cinder-21758ec2-ef35-4ca5-9d36-aa538802fba8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:18:16 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1e493231-fee9-4415-979d-2a6445cadcba tempest-ProjectReaderTests-1624724882 None] Acquiring lock "cinder-quobyte-21758ec2-ef35-4ca5-9d36-aa538802fba8" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:18:16 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1e493231-fee9-4415-979d-2a6445cadcba tempest-ProjectReaderTests-1624724882 None] Lock "cinder-quobyte-21758ec2-ef35-4ca5-9d36-aa538802fba8" acquired by "delete_volume" :: waited 0.021s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:18:16 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91cc8f4-49c5-4673-ab0f-07d0199834e5]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:18:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1e493231-fee9-4415-979d-2a6445cadcba tempest-ProjectReaderTests-1624724882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21758ec2-ef35-4ca5-9d36-aa538802fba8 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:16 devstack sudo[98669]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3697cd56-df4a-4c5f-9213-02498021def2 tempest-VolumesExtendTest-418001118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce" returned: 0 in 0.487s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3697cd56-df4a-4c5f-9213-02498021def2 tempest-VolumesExtendTest-418001118 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce.f32c653a-8988-4106-8665-ada4a813bff2 2G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:16 devstack sudo[98680]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21758ec2-ef35-4ca5-9d36-aa538802fba8
Nov 04 12:18:16 devstack sudo[98680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3697cd56-df4a-4c5f-9213-02498021def2 tempest-VolumesExtendTest-418001118 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce.f32c653a-8988-4106-8665-ada4a813bff2 2G" returned: 0 in 0.152s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3697cd56-df4a-4c5f-9213-02498021def2 tempest-VolumesExtendTest-418001118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.696s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:16 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-3697cd56-df4a-4c5f-9213-02498021def2 tempest-VolumesExtendTest-418001118 None] Extend volume completed successfully.
Nov 04 12:18:16 devstack sudo[98680]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1e493231-fee9-4415-979d-2a6445cadcba tempest-ProjectReaderTests-1624724882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21758ec2-ef35-4ca5-9d36-aa538802fba8" returned: 0 in 0.381s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1e493231-fee9-4415-979d-2a6445cadcba tempest-ProjectReaderTests-1624724882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21758ec2-ef35-4ca5-9d36-aa538802fba8 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:16 devstack sudo[98688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21758ec2-ef35-4ca5-9d36-aa538802fba8
Nov 04 12:18:16 devstack sudo[98688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:17 devstack sudo[98688]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1e493231-fee9-4415-979d-2a6445cadcba tempest-ProjectReaderTests-1624724882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21758ec2-ef35-4ca5-9d36-aa538802fba8" returned: 0 in 0.242s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:17 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1e493231-fee9-4415-979d-2a6445cadcba tempest-ProjectReaderTests-1624724882 None] Lock "cinder-quobyte-21758ec2-ef35-4ca5-9d36-aa538802fba8" released by "delete_volume" :: held 0.675s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:18:17 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-1e493231-fee9-4415-979d-2a6445cadcba tempest-ProjectReaderTests-1624724882 None] Created reservations ['2a1fabb4-cf3b-4099-801c-3d96772c7965', '43d5269b-857b-47c1-9967-6131b21b34ea', 'f4942d0e-b1e9-4d2f-b678-1bd0e7c18968', '688f112f-b275-4965-bfe7-7c4c79c30894'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:18:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1e493231-fee9-4415-979d-2a6445cadcba tempest-ProjectReaderTests-1624724882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1e493231-fee9-4415-979d-2a6445cadcba tempest-ProjectReaderTests-1624724882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:17 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1e493231-fee9-4415-979d-2a6445cadcba tempest-ProjectReaderTests-1624724882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:18:17 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1e493231-fee9-4415-979d-2a6445cadcba tempest-ProjectReaderTests-1624724882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:18:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1e493231-fee9-4415-979d-2a6445cadcba tempest-ProjectReaderTests-1624724882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1e493231-fee9-4415-979d-2a6445cadcba tempest-ProjectReaderTests-1624724882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:17 devstack sudo[98691]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:18:17 devstack sudo[98691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:17 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1b478d8c-5486-488e-b476-55a181dbc230 tempest-VolumesExtendTest-418001118 None] Acquiring lock "cinder-f32c653a-8988-4106-8665-ada4a813bff2-delete_snapshot" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:18:17 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1b478d8c-5486-488e-b476-55a181dbc230 tempest-VolumesExtendTest-418001118 None] Lock "cinder-f32c653a-8988-4106-8665-ada4a813bff2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:18:17 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1b478d8c-5486-488e-b476-55a181dbc230 tempest-VolumesExtendTest-418001118 None] Acquiring lock "cinder-quobyte-1765732a-6a4d-4e49-84b2-1ab3772243ce" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:18:17 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1b478d8c-5486-488e-b476-55a181dbc230 tempest-VolumesExtendTest-418001118 None] Lock "cinder-quobyte-1765732a-6a4d-4e49-84b2-1ab3772243ce" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:18:17 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1b478d8c-5486-488e-b476-55a181dbc230 tempest-VolumesExtendTest-418001118 None] Acquiring lock "cinder-quobyte-f32c653a-8988-4106-8665-ada4a813bff2" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:18:17 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1b478d8c-5486-488e-b476-55a181dbc230 tempest-VolumesExtendTest-418001118 None] Lock "cinder-quobyte-f32c653a-8988-4106-8665-ada4a813bff2" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:18:17 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-1b478d8c-5486-488e-b476-55a181dbc230 tempest-VolumesExtendTest-418001118 None] Deleting offline snapshot f32c653a-8988-4106-8665-ada4a813bff2 of volume 1765732a-6a4d-4e49-84b2-1ab3772243ce {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:18:17 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-1b478d8c-5486-488e-b476-55a181dbc230 tempest-VolumesExtendTest-418001118 None] snapshot_file for this snap is: volume-1765732a-6a4d-4e49-84b2-1ab3772243ce.f32c653a-8988-4106-8665-ada4a813bff2 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:18:17 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f21f38c-073f-4d8d-9877-58d8d897bf94]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:18:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1b478d8c-5486-488e-b476-55a181dbc230 tempest-VolumesExtendTest-418001118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce.f32c653a-8988-4106-8665-ada4a813bff2 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:17 devstack sudo[98691]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1e493231-fee9-4415-979d-2a6445cadcba tempest-ProjectReaderTests-1624724882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.348s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:17 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-1e493231-fee9-4415-979d-2a6445cadcba tempest-ProjectReaderTests-1624724882 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:18:17 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-1e493231-fee9-4415-979d-2a6445cadcba tempest-ProjectReaderTests-1624724882 None] Deleted volume successfully.
Nov 04 12:18:17 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1e493231-fee9-4415-979d-2a6445cadcba tempest-ProjectReaderTests-1624724882 None] Lock "cinder-21758ec2-ef35-4ca5-9d36-aa538802fba8-delete_volume" released by "delete_volume" :: held 1.282s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:18:17 devstack sudo[98694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce.f32c653a-8988-4106-8665-ada4a813bff2
Nov 04 12:18:17 devstack sudo[98694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:17 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fc96f34f-ff7a-475c-9d0e-4437637f50d2 tempest-VolumesTestJSON-1001488751 None] Acquiring lock "cinder-d0843832-65d1-42e8-828a-191030bc67fd-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fc96f34f-ff7a-475c-9d0e-4437637f50d2 tempest-VolumesTestJSON-1001488751 None] Lock "cinder-d0843832-65d1-42e8-828a-191030bc67fd-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fc96f34f-ff7a-475c-9d0e-4437637f50d2 tempest-VolumesTestJSON-1001488751 None] Acquiring lock "cinder-quobyte-d0843832-65d1-42e8-828a-191030bc67fd" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fc96f34f-ff7a-475c-9d0e-4437637f50d2 tempest-VolumesTestJSON-1001488751 None] Lock "cinder-quobyte-d0843832-65d1-42e8-828a-191030bc67fd" acquired by "delete_volume" :: waited 0.015s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:18:18 devstack sudo[98694]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1b478d8c-5486-488e-b476-55a181dbc230 tempest-VolumesExtendTest-418001118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce.f32c653a-8988-4106-8665-ada4a813bff2" returned: 0 in 0.504s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-1b478d8c-5486-488e-b476-55a181dbc230 tempest-VolumesExtendTest-418001118 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1765732a-6a4d-4e49-84b2-1ab3772243ce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[687ed41f-870a-4d52-8e85-4894d284cae4]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fc96f34f-ff7a-475c-9d0e-4437637f50d2 tempest-VolumesTestJSON-1001488751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d0843832-65d1-42e8-828a-191030bc67fd {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea0e8fc-44b8-4b77-9657-5c9ce10aa281]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1b478d8c-5486-488e-b476-55a181dbc230 tempest-VolumesExtendTest-418001118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8782e49-2513-4a33-9b48-caf61c95a5a2 tempest-ProjectReaderTests-1624724882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a8782e49-2513-4a33-9b48-caf61c95a5a2 tempest-ProjectReaderTests-1624724882 None] Flow 'volume_create_manager' (8ef0e37b-217d-44ad-91fa-d11cbacea32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a8782e49-2513-4a33-9b48-caf61c95a5a2 tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (228d3e19-2ae9-4f65-8c7d-7391161d5546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:18 devstack sudo[98699]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d0843832-65d1-42e8-828a-191030bc67fd
Nov 04 12:18:18 devstack sudo[98699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a8782e49-2513-4a33-9b48-caf61c95a5a2 tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (228d3e19-2ae9-4f65-8c7d-7391161d5546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:18:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-111736955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f634f7a9-150a-4b61-a098-e40bdfada80d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86eb6c72cbf945018024d60d86244af3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:18:18Z,use_quota=True,user_id='7b43430a779343b78bf657cb3c191723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a8782e49-2513-4a33-9b48-caf61c95a5a2 tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af843a99-1bf1-4f70-97f0-9e5d43e1c329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a8782e49-2513-4a33-9b48-caf61c95a5a2 tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af843a99-1bf1-4f70-97f0-9e5d43e1c329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a8782e49-2513-4a33-9b48-caf61c95a5a2 tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d542f83-0e60-488e-98bd-b0773bd65cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:18 devstack sudo[98700]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce
Nov 04 12:18:18 devstack sudo[98700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a8782e49-2513-4a33-9b48-caf61c95a5a2 tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d542f83-0e60-488e-98bd-b0773bd65cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f634f7a9-150a-4b61-a098-e40bdfada80d', 'volume_name': 'volume-f634f7a9-150a-4b61-a098-e40bdfada80d', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a8782e49-2513-4a33-9b48-caf61c95a5a2 tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c84943e4-148b-4d19-b5ab-20438fb72e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a8782e49-2513-4a33-9b48-caf61c95a5a2 tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c84943e4-148b-4d19-b5ab-20438fb72e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a8782e49-2513-4a33-9b48-caf61c95a5a2 tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cb69d1b-be54-4ba4-af2c-820fa5d9b4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:18 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-a8782e49-2513-4a33-9b48-caf61c95a5a2 tempest-ProjectReaderTests-1624724882 None] Volume f634f7a9-150a-4b61-a098-e40bdfada80d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f634f7a9-150a-4b61-a098-e40bdfada80d', 'volume_size': 1}
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a8782e49-2513-4a33-9b48-caf61c95a5a2 tempest-ProjectReaderTests-1624724882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a8782e49-2513-4a33-9b48-caf61c95a5a2 tempest-ProjectReaderTests-1624724882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a8782e49-2513-4a33-9b48-caf61c95a5a2 tempest-ProjectReaderTests-1624724882 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:18:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-111736955',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f634f7a9-150a-4b61-a098-e40bdfada80d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86eb6c72cbf945018024d60d86244af3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:18:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:18:18Z,use_quota=True,user_id='7b43430a779343b78bf657cb3c191723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-a8782e49-2513-4a33-9b48-caf61c95a5a2 tempest-ProjectReaderTests-1624724882 None] Creating volume f634f7a9-150a-4b61-a098-e40bdfada80d {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a8782e49-2513-4a33-9b48-caf61c95a5a2 tempest-ProjectReaderTests-1624724882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a8782e49-2513-4a33-9b48-caf61c95a5a2 tempest-ProjectReaderTests-1624724882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a8782e49-2513-4a33-9b48-caf61c95a5a2 tempest-ProjectReaderTests-1624724882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a8782e49-2513-4a33-9b48-caf61c95a5a2 tempest-ProjectReaderTests-1624724882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a8782e49-2513-4a33-9b48-caf61c95a5a2 tempest-ProjectReaderTests-1624724882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a8782e49-2513-4a33-9b48-caf61c95a5a2 tempest-ProjectReaderTests-1624724882 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:18:18 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-a8782e49-2513-4a33-9b48-caf61c95a5a2 tempest-ProjectReaderTests-1624724882 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a8782e49-2513-4a33-9b48-caf61c95a5a2 tempest-ProjectReaderTests-1624724882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f634f7a9-150a-4b61-a098-e40bdfada80d 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:18 devstack sudo[98703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f634f7a9-150a-4b61-a098-e40bdfada80d 1073741824
Nov 04 12:18:18 devstack sudo[98703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:18 devstack sudo[98699]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fc96f34f-ff7a-475c-9d0e-4437637f50d2 tempest-VolumesTestJSON-1001488751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d0843832-65d1-42e8-828a-191030bc67fd" returned: 0 in 0.389s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:18 devstack sudo[98700]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fc96f34f-ff7a-475c-9d0e-4437637f50d2 tempest-VolumesTestJSON-1001488751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d0843832-65d1-42e8-828a-191030bc67fd {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1b478d8c-5486-488e-b476-55a181dbc230 tempest-VolumesExtendTest-418001118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce" returned: 0 in 0.381s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1b478d8c-5486-488e-b476-55a181dbc230 tempest-VolumesExtendTest-418001118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce.f32c653a-8988-4106-8665-ada4a813bff2 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:18 devstack sudo[98713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d0843832-65d1-42e8-828a-191030bc67fd
Nov 04 12:18:18 devstack sudo[98713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:18 devstack sudo[98714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce.f32c653a-8988-4106-8665-ada4a813bff2
Nov 04 12:18:18 devstack sudo[98714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:18 devstack sudo[98703]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a8782e49-2513-4a33-9b48-caf61c95a5a2 tempest-ProjectReaderTests-1624724882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f634f7a9-150a-4b61-a098-e40bdfada80d 1073741824" returned: 0 in 0.488s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:18 devstack sudo[98713]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fc96f34f-ff7a-475c-9d0e-4437637f50d2 tempest-VolumesTestJSON-1001488751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d0843832-65d1-42e8-828a-191030bc67fd" returned: 0 in 0.286s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fc96f34f-ff7a-475c-9d0e-4437637f50d2 tempest-VolumesTestJSON-1001488751 None] Lock "cinder-quobyte-d0843832-65d1-42e8-828a-191030bc67fd" released by "delete_volume" :: held 0.732s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a8782e49-2513-4a33-9b48-caf61c95a5a2 tempest-ProjectReaderTests-1624724882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f634f7a9-150a-4b61-a098-e40bdfada80d {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:18 devstack sudo[98722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f634f7a9-150a-4b61-a098-e40bdfada80d
Nov 04 12:18:18 devstack sudo[98722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-fc96f34f-ff7a-475c-9d0e-4437637f50d2 tempest-VolumesTestJSON-1001488751 None] Created reservations ['55fbe489-7137-47f6-934a-efdffff477ca', '1e497bfd-c1d5-4493-ac0f-469c3c10ddb5', '93aa9689-b37a-47a4-9594-d42328ddd2bd', 'a746f2fe-02df-4416-91fd-84e0a92ac078'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:18:18 devstack sudo[98714]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1b478d8c-5486-488e-b476-55a181dbc230 tempest-VolumesExtendTest-418001118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce.f32c653a-8988-4106-8665-ada4a813bff2" returned: 0 in 0.412s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1b478d8c-5486-488e-b476-55a181dbc230 tempest-VolumesExtendTest-418001118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce.f32c653a-8988-4106-8665-ada4a813bff2 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:18 devstack sudo[98725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce.f32c653a-8988-4106-8665-ada4a813bff2
Nov 04 12:18:18 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-fc96f34f-ff7a-475c-9d0e-4437637f50d2 tempest-VolumesTestJSON-1001488751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-fc96f34f-ff7a-475c-9d0e-4437637f50d2 tempest-VolumesTestJSON-1001488751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-fc96f34f-ff7a-475c-9d0e-4437637f50d2 tempest-VolumesTestJSON-1001488751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-fc96f34f-ff7a-475c-9d0e-4437637f50d2 tempest-VolumesTestJSON-1001488751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-fc96f34f-ff7a-475c-9d0e-4437637f50d2 tempest-VolumesTestJSON-1001488751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fc96f34f-ff7a-475c-9d0e-4437637f50d2 tempest-VolumesTestJSON-1001488751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:19 devstack sudo[98727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:18:19 devstack sudo[98727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:19 devstack sudo[98722]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a8782e49-2513-4a33-9b48-caf61c95a5a2 tempest-ProjectReaderTests-1624724882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f634f7a9-150a-4b61-a098-e40bdfada80d" returned: 0 in 0.299s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:19 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a8782e49-2513-4a33-9b48-caf61c95a5a2 tempest-ProjectReaderTests-1624724882 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:18:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a8782e49-2513-4a33-9b48-caf61c95a5a2 tempest-ProjectReaderTests-1624724882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:19 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a8782e49-2513-4a33-9b48-caf61c95a5a2 tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cb69d1b-be54-4ba4-af2c-820fa5d9b4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f634f7a9-150a-4b61-a098-e40bdfada80d', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:19 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a8782e49-2513-4a33-9b48-caf61c95a5a2 tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7759c6c-bdf8-4f47-9b89-929754083d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:19 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-a8782e49-2513-4a33-9b48-caf61c95a5a2 tempest-ProjectReaderTests-1624724882 None] Volume volume-f634f7a9-150a-4b61-a098-e40bdfada80d (f634f7a9-150a-4b61-a098-e40bdfada80d): created successfully
Nov 04 12:18:19 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a8782e49-2513-4a33-9b48-caf61c95a5a2 tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7759c6c-bdf8-4f47-9b89-929754083d0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:19 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a8782e49-2513-4a33-9b48-caf61c95a5a2 tempest-ProjectReaderTests-1624724882 None] Flow 'volume_create_manager' (8ef0e37b-217d-44ad-91fa-d11cbacea32c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:18:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fac66b70-779b-4d4c-90f1-bbcdb6fb1aba tempest-VolumesTestJSON-1001488751 None] Acquiring lock "cinder-59195d0f-ccbb-4e93-817b-b4df61dea099-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:18:19 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-a8782e49-2513-4a33-9b48-caf61c95a5a2 tempest-ProjectReaderTests-1624724882 None] Created volume successfully.
Nov 04 12:18:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fac66b70-779b-4d4c-90f1-bbcdb6fb1aba tempest-VolumesTestJSON-1001488751 None] Lock "cinder-59195d0f-ccbb-4e93-817b-b4df61dea099-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:18:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fac66b70-779b-4d4c-90f1-bbcdb6fb1aba tempest-VolumesTestJSON-1001488751 None] Acquiring lock "cinder-quobyte-59195d0f-ccbb-4e93-817b-b4df61dea099" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:18:19 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1b478d8c-5486-488e-b476-55a181dbc230 tempest-VolumesExtendTest-418001118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce.f32c653a-8988-4106-8665-ada4a813bff2" returned: 0 in 0.334s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fac66b70-779b-4d4c-90f1-bbcdb6fb1aba tempest-VolumesTestJSON-1001488751 None] Lock "cinder-quobyte-59195d0f-ccbb-4e93-817b-b4df61dea099" acquired by "delete_volume" :: waited 0.020s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:18:19 devstack sudo[98727]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fc96f34f-ff7a-475c-9d0e-4437637f50d2 tempest-VolumesTestJSON-1001488751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.302s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:19 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-fc96f34f-ff7a-475c-9d0e-4437637f50d2 tempest-VolumesTestJSON-1001488751 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:18:19 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-fc96f34f-ff7a-475c-9d0e-4437637f50d2 tempest-VolumesTestJSON-1001488751 None] Deleted volume successfully.
Nov 04 12:18:19 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f10c034-53c5-4cf0-92a0-eb0196be47b3]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:18:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fac66b70-779b-4d4c-90f1-bbcdb6fb1aba tempest-VolumesTestJSON-1001488751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-59195d0f-ccbb-4e93-817b-b4df61dea099 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1b478d8c-5486-488e-b476-55a181dbc230 tempest-VolumesExtendTest-418001118 None] Lock "cinder-quobyte-f32c653a-8988-4106-8665-ada4a813bff2" released by "_delete_snapshot" :: held 1.833s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:18:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fc96f34f-ff7a-475c-9d0e-4437637f50d2 tempest-VolumesTestJSON-1001488751 None] Lock "cinder-d0843832-65d1-42e8-828a-191030bc67fd-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:18:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1b478d8c-5486-488e-b476-55a181dbc230 tempest-VolumesExtendTest-418001118 None] Lock "cinder-quobyte-1765732a-6a4d-4e49-84b2-1ab3772243ce" released by "delete_snapshot" :: held 1.868s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:18:19 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-1b478d8c-5486-488e-b476-55a181dbc230 tempest-VolumesExtendTest-418001118 None] Created reservations ['72995ad7-06f8-4add-885d-5588af6f1eb3', '99eea7a8-0060-4608-86d3-1ab882cca7c0', 'ab20c64f-77fb-401a-9cd3-f1501964c5a3', 'a225523b-3a63-4a82-afde-66805c2c2f3c'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:18:19 devstack sudo[98732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-59195d0f-ccbb-4e93-817b-b4df61dea099
Nov 04 12:18:19 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:19 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-1b478d8c-5486-488e-b476-55a181dbc230 tempest-VolumesExtendTest-418001118 None] Delete snapshot completed successfully.
Nov 04 12:18:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1b478d8c-5486-488e-b476-55a181dbc230 tempest-VolumesExtendTest-418001118 None] Lock "cinder-f32c653a-8988-4106-8665-ada4a813bff2-delete_snapshot" released by "delete_snapshot" :: held 2.000s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:18:19 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fac66b70-779b-4d4c-90f1-bbcdb6fb1aba tempest-VolumesTestJSON-1001488751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-59195d0f-ccbb-4e93-817b-b4df61dea099" returned: 0 in 0.383s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fac66b70-779b-4d4c-90f1-bbcdb6fb1aba tempest-VolumesTestJSON-1001488751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-59195d0f-ccbb-4e93-817b-b4df61dea099 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:19 devstack sudo[98737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-59195d0f-ccbb-4e93-817b-b4df61dea099
Nov 04 12:18:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d96ca7f2-7199-403a-abd9-ec0fa85767f6 tempest-VolumesExtendTest-418001118 None] Acquiring lock "cinder-1765732a-6a4d-4e49-84b2-1ab3772243ce-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:18:19 devstack sudo[98737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d96ca7f2-7199-403a-abd9-ec0fa85767f6 tempest-VolumesExtendTest-418001118 None] Lock "cinder-1765732a-6a4d-4e49-84b2-1ab3772243ce-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:18:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d96ca7f2-7199-403a-abd9-ec0fa85767f6 tempest-VolumesExtendTest-418001118 None] Acquiring lock "cinder-quobyte-1765732a-6a4d-4e49-84b2-1ab3772243ce" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:18:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d96ca7f2-7199-403a-abd9-ec0fa85767f6 tempest-VolumesExtendTest-418001118 None] Lock "cinder-quobyte-1765732a-6a4d-4e49-84b2-1ab3772243ce" acquired by "delete_volume" :: waited 0.024s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:18:19 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[27714bbb-8c62-4f8b-84bb-7f2f9e0ed1d4]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:18:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d96ca7f2-7199-403a-abd9-ec0fa85767f6 tempest-VolumesExtendTest-418001118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:19 devstack sudo[98739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce
Nov 04 12:18:19 devstack sudo[98737]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:19 devstack sudo[98739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fac66b70-779b-4d4c-90f1-bbcdb6fb1aba tempest-VolumesTestJSON-1001488751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-59195d0f-ccbb-4e93-817b-b4df61dea099" returned: 0 in 0.272s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fac66b70-779b-4d4c-90f1-bbcdb6fb1aba tempest-VolumesTestJSON-1001488751 None] Lock "cinder-quobyte-59195d0f-ccbb-4e93-817b-b4df61dea099" released by "delete_volume" :: held 0.702s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:18:20 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-fac66b70-779b-4d4c-90f1-bbcdb6fb1aba tempest-VolumesTestJSON-1001488751 None] Created reservations ['a4ae8676-8780-4067-8a5e-c7dbd3ca76bc', 'af35de1c-60ae-4f58-9ec8-09e1626a1638', 'ae6ebd47-c0a8-47a8-b515-13d58e2c779e', 'b38749d4-d4ae-40cc-8f1e-9cea23f77075'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:18:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-fac66b70-779b-4d4c-90f1-bbcdb6fb1aba tempest-VolumesTestJSON-1001488751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-fac66b70-779b-4d4c-90f1-bbcdb6fb1aba tempest-VolumesTestJSON-1001488751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:20 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-fac66b70-779b-4d4c-90f1-bbcdb6fb1aba tempest-VolumesTestJSON-1001488751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:18:20 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-fac66b70-779b-4d4c-90f1-bbcdb6fb1aba tempest-VolumesTestJSON-1001488751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:18:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-fac66b70-779b-4d4c-90f1-bbcdb6fb1aba tempest-VolumesTestJSON-1001488751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fac66b70-779b-4d4c-90f1-bbcdb6fb1aba tempest-VolumesTestJSON-1001488751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:20 devstack sudo[98742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:18:20 devstack sudo[98742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:20 devstack sudo[98739]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d96ca7f2-7199-403a-abd9-ec0fa85767f6 tempest-VolumesExtendTest-418001118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce" returned: 0 in 0.375s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d96ca7f2-7199-403a-abd9-ec0fa85767f6 tempest-VolumesExtendTest-418001118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:20 devstack sudo[98747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce
Nov 04 12:18:20 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:20 devstack sudo[98742]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-6ba06206-14fc-4a4e-9fa0-ef668082c6eb tempest-ProjectReaderTests-1624724882 None] Acquiring lock "cinder-f634f7a9-150a-4b61-a098-e40bdfada80d-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:18:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fac66b70-779b-4d4c-90f1-bbcdb6fb1aba tempest-VolumesTestJSON-1001488751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.258s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:20 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-fac66b70-779b-4d4c-90f1-bbcdb6fb1aba tempest-VolumesTestJSON-1001488751 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:18:20 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-fac66b70-779b-4d4c-90f1-bbcdb6fb1aba tempest-VolumesTestJSON-1001488751 None] Deleted volume successfully.
Nov 04 12:18:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-6ba06206-14fc-4a4e-9fa0-ef668082c6eb tempest-ProjectReaderTests-1624724882 None] Lock "cinder-f634f7a9-150a-4b61-a098-e40bdfada80d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:18:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-034b76a3-0717-4075-9f1d-c653102ff960 tempest-VolumesTestJSON-1001488751 None] Acquiring lock "cinder-fac9b5b5-45d1-455d-87a5-a155ce3c555c-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:18:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fac66b70-779b-4d4c-90f1-bbcdb6fb1aba tempest-VolumesTestJSON-1001488751 None] Lock "cinder-59195d0f-ccbb-4e93-817b-b4df61dea099-delete_volume" released by "delete_volume" :: held 1.190s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:18:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-034b76a3-0717-4075-9f1d-c653102ff960 tempest-VolumesTestJSON-1001488751 None] Lock "cinder-fac9b5b5-45d1-455d-87a5-a155ce3c555c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:18:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-6ba06206-14fc-4a4e-9fa0-ef668082c6eb tempest-ProjectReaderTests-1624724882 None] Acquiring lock "cinder-quobyte-f634f7a9-150a-4b61-a098-e40bdfada80d" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:18:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-6ba06206-14fc-4a4e-9fa0-ef668082c6eb tempest-ProjectReaderTests-1624724882 None] Lock "cinder-quobyte-f634f7a9-150a-4b61-a098-e40bdfada80d" acquired by "delete_volume" :: waited 0.020s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:18:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-034b76a3-0717-4075-9f1d-c653102ff960 tempest-VolumesTestJSON-1001488751 None] Acquiring lock "cinder-quobyte-fac9b5b5-45d1-455d-87a5-a155ce3c555c" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:18:20 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fac7c1-bb58-4201-9336-64e231195bb1]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:18:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6ba06206-14fc-4a4e-9fa0-ef668082c6eb tempest-ProjectReaderTests-1624724882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f634f7a9-150a-4b61-a098-e40bdfada80d {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-034b76a3-0717-4075-9f1d-c653102ff960 tempest-VolumesTestJSON-1001488751 None] Lock "cinder-quobyte-fac9b5b5-45d1-455d-87a5-a155ce3c555c" acquired by "delete_volume" :: waited 0.024s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:18:20 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[10d08eff-517b-49c8-8a09-6268b70b605f]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:18:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-034b76a3-0717-4075-9f1d-c653102ff960 tempest-VolumesTestJSON-1001488751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fac9b5b5-45d1-455d-87a5-a155ce3c555c {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:20 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d96ca7f2-7199-403a-abd9-ec0fa85767f6 tempest-VolumesExtendTest-418001118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1765732a-6a4d-4e49-84b2-1ab3772243ce" returned: 0 in 0.348s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:20 devstack sudo[98750]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f634f7a9-150a-4b61-a098-e40bdfada80d
Nov 04 12:18:20 devstack sudo[98750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d96ca7f2-7199-403a-abd9-ec0fa85767f6 tempest-VolumesExtendTest-418001118 None] Lock "cinder-quobyte-1765732a-6a4d-4e49-84b2-1ab3772243ce" released by "delete_volume" :: held 0.802s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:18:20 devstack sudo[98752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fac9b5b5-45d1-455d-87a5-a155ce3c555c
Nov 04 12:18:20 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:20 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-d96ca7f2-7199-403a-abd9-ec0fa85767f6 tempest-VolumesExtendTest-418001118 None] Created reservations ['1f42d284-cf66-4fd5-b324-e235cf076d5c', '4157e167-8754-4aef-98c6-ed79785ea58a', '7e38c802-1a14-4665-91fa-dfe6eaddf18e', '6fe45b20-7ed7-4de1-886c-0cc036e8c740'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:18:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d96ca7f2-7199-403a-abd9-ec0fa85767f6 tempest-VolumesExtendTest-418001118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d96ca7f2-7199-403a-abd9-ec0fa85767f6 tempest-VolumesExtendTest-418001118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:20 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d96ca7f2-7199-403a-abd9-ec0fa85767f6 tempest-VolumesExtendTest-418001118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:18:20 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d96ca7f2-7199-403a-abd9-ec0fa85767f6 tempest-VolumesExtendTest-418001118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:18:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d96ca7f2-7199-403a-abd9-ec0fa85767f6 tempest-VolumesExtendTest-418001118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d96ca7f2-7199-403a-abd9-ec0fa85767f6 tempest-VolumesExtendTest-418001118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:20 devstack sudo[98755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:18:20 devstack sudo[98755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:20 devstack sudo[98750]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6ba06206-14fc-4a4e-9fa0-ef668082c6eb tempest-ProjectReaderTests-1624724882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f634f7a9-150a-4b61-a098-e40bdfada80d" returned: 0 in 0.415s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6ba06206-14fc-4a4e-9fa0-ef668082c6eb tempest-ProjectReaderTests-1624724882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f634f7a9-150a-4b61-a098-e40bdfada80d {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:20 devstack sudo[98764]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f634f7a9-150a-4b61-a098-e40bdfada80d
Nov 04 12:18:20 devstack sudo[98764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:20 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-034b76a3-0717-4075-9f1d-c653102ff960 tempest-VolumesTestJSON-1001488751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fac9b5b5-45d1-455d-87a5-a155ce3c555c" returned: 0 in 0.435s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-034b76a3-0717-4075-9f1d-c653102ff960 tempest-VolumesTestJSON-1001488751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fac9b5b5-45d1-455d-87a5-a155ce3c555c {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:21 devstack sudo[98768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fac9b5b5-45d1-455d-87a5-a155ce3c555c
Nov 04 12:18:21 devstack sudo[98768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:21 devstack sudo[98755]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d96ca7f2-7199-403a-abd9-ec0fa85767f6 tempest-VolumesExtendTest-418001118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.294s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:21 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-d96ca7f2-7199-403a-abd9-ec0fa85767f6 tempest-VolumesExtendTest-418001118 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:18:21 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-d96ca7f2-7199-403a-abd9-ec0fa85767f6 tempest-VolumesExtendTest-418001118 None] Deleted volume successfully.
Nov 04 12:18:21 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d96ca7f2-7199-403a-abd9-ec0fa85767f6 tempest-VolumesExtendTest-418001118 None] Lock "cinder-1765732a-6a4d-4e49-84b2-1ab3772243ce-delete_volume" released by "delete_volume" :: held 1.328s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:18:21 devstack sudo[98764]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6ba06206-14fc-4a4e-9fa0-ef668082c6eb tempest-ProjectReaderTests-1624724882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f634f7a9-150a-4b61-a098-e40bdfada80d" returned: 0 in 0.277s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:21 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-6ba06206-14fc-4a4e-9fa0-ef668082c6eb tempest-ProjectReaderTests-1624724882 None] Lock "cinder-quobyte-f634f7a9-150a-4b61-a098-e40bdfada80d" released by "delete_volume" :: held 0.742s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:18:21 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-6ba06206-14fc-4a4e-9fa0-ef668082c6eb tempest-ProjectReaderTests-1624724882 None] Created reservations ['08f1f407-9134-4bea-80fb-752b1c941b47', '494a8ab9-68cd-41f8-be3f-e2c20cf11e59', 'a29e989b-908a-4a8b-ad23-655538df7905', '3ff3e52f-ea54-4d6f-babd-9a80b5b2dc18'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:18:21 devstack sudo[98768]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-034b76a3-0717-4075-9f1d-c653102ff960 tempest-VolumesTestJSON-1001488751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fac9b5b5-45d1-455d-87a5-a155ce3c555c" returned: 0 in 0.294s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:21 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-034b76a3-0717-4075-9f1d-c653102ff960 tempest-VolumesTestJSON-1001488751 None] Lock "cinder-quobyte-fac9b5b5-45d1-455d-87a5-a155ce3c555c" released by "delete_volume" :: held 0.786s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:18:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-6ba06206-14fc-4a4e-9fa0-ef668082c6eb tempest-ProjectReaderTests-1624724882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-6ba06206-14fc-4a4e-9fa0-ef668082c6eb tempest-ProjectReaderTests-1624724882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:21 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-6ba06206-14fc-4a4e-9fa0-ef668082c6eb tempest-ProjectReaderTests-1624724882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:18:21 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-6ba06206-14fc-4a4e-9fa0-ef668082c6eb tempest-ProjectReaderTests-1624724882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:18:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-6ba06206-14fc-4a4e-9fa0-ef668082c6eb tempest-ProjectReaderTests-1624724882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6ba06206-14fc-4a4e-9fa0-ef668082c6eb tempest-ProjectReaderTests-1624724882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:21 devstack sudo[98772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:18:21 devstack sudo[98772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:21 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-034b76a3-0717-4075-9f1d-c653102ff960 tempest-VolumesTestJSON-1001488751 None] Created reservations ['87773289-1322-4bb2-ac97-8911a7530072', '5d97cd18-cffe-40a9-948c-aca46e12ed52', 'e8021879-834d-41e3-95d9-239f42a991b2', '1aa3cc8b-15c2-441a-bd76-5b7ae4482751'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:18:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-034b76a3-0717-4075-9f1d-c653102ff960 tempest-VolumesTestJSON-1001488751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-034b76a3-0717-4075-9f1d-c653102ff960 tempest-VolumesTestJSON-1001488751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:21 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-034b76a3-0717-4075-9f1d-c653102ff960 tempest-VolumesTestJSON-1001488751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:18:21 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-034b76a3-0717-4075-9f1d-c653102ff960 tempest-VolumesTestJSON-1001488751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:18:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-034b76a3-0717-4075-9f1d-c653102ff960 tempest-VolumesTestJSON-1001488751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-034b76a3-0717-4075-9f1d-c653102ff960 tempest-VolumesTestJSON-1001488751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:21 devstack sudo[98774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:18:21 devstack sudo[98774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:21 devstack sudo[98772]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6ba06206-14fc-4a4e-9fa0-ef668082c6eb tempest-ProjectReaderTests-1624724882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.393s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:21 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-6ba06206-14fc-4a4e-9fa0-ef668082c6eb tempest-ProjectReaderTests-1624724882 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:18:21 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-6ba06206-14fc-4a4e-9fa0-ef668082c6eb tempest-ProjectReaderTests-1624724882 None] Deleted volume successfully.
Nov 04 12:18:21 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-6ba06206-14fc-4a4e-9fa0-ef668082c6eb tempest-ProjectReaderTests-1624724882 None] Lock "cinder-f634f7a9-150a-4b61-a098-e40bdfada80d-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:18:21 devstack sudo[98774]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-034b76a3-0717-4075-9f1d-c653102ff960 tempest-VolumesTestJSON-1001488751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.412s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:21 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-034b76a3-0717-4075-9f1d-c653102ff960 tempest-VolumesTestJSON-1001488751 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:18:21 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-034b76a3-0717-4075-9f1d-c653102ff960 tempest-VolumesTestJSON-1001488751 None] Deleted volume successfully.
Nov 04 12:18:21 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-034b76a3-0717-4075-9f1d-c653102ff960 tempest-VolumesTestJSON-1001488751 None] Lock "cinder-fac9b5b5-45d1-455d-87a5-a155ce3c555c-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:18:22 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-04c36875-229d-4b1f-a26a-96396bc238a2 tempest-ProjectReaderTests-1624724882 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:18:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-04c36875-229d-4b1f-a26a-96396bc238a2 tempest-ProjectReaderTests-1624724882 None] Flow 'volume_create_manager' (e4cc6aae-74f2-423f-9a68-d06f0e671e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:18:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-04c36875-229d-4b1f-a26a-96396bc238a2 tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba84b4e0-ca00-4bc5-aa05-110f468ff7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-04c36875-229d-4b1f-a26a-96396bc238a2 tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba84b4e0-ca00-4bc5-aa05-110f468ff7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:18:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-215023588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe67ac80-f6fa-4a94-991b-f8a0d323fd25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86eb6c72cbf945018024d60d86244af3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:18:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:18:22Z,use_quota=True,user_id='7b43430a779343b78bf657cb3c191723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-04c36875-229d-4b1f-a26a-96396bc238a2 tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ddac81c-ad19-4788-bfb8-68babef0212c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-04c36875-229d-4b1f-a26a-96396bc238a2 tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ddac81c-ad19-4788-bfb8-68babef0212c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-04c36875-229d-4b1f-a26a-96396bc238a2 tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81ce00ea-7fb8-40a1-a4e3-64f0daa5ad60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-04c36875-229d-4b1f-a26a-96396bc238a2 tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81ce00ea-7fb8-40a1-a4e3-64f0daa5ad60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe67ac80-f6fa-4a94-991b-f8a0d323fd25', 'volume_name': 'volume-fe67ac80-f6fa-4a94-991b-f8a0d323fd25', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-04c36875-229d-4b1f-a26a-96396bc238a2 tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e23b429-d428-4c9a-a957-56596cea30b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-04c36875-229d-4b1f-a26a-96396bc238a2 tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e23b429-d428-4c9a-a957-56596cea30b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-04c36875-229d-4b1f-a26a-96396bc238a2 tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9546b31d-3c5a-4939-96e0-a428b3eb70cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:22 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-04c36875-229d-4b1f-a26a-96396bc238a2 tempest-ProjectReaderTests-1624724882 None] Volume fe67ac80-f6fa-4a94-991b-f8a0d323fd25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe67ac80-f6fa-4a94-991b-f8a0d323fd25', 'volume_size': 1}
Nov 04 12:18:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-04c36875-229d-4b1f-a26a-96396bc238a2 tempest-ProjectReaderTests-1624724882 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-04c36875-229d-4b1f-a26a-96396bc238a2 tempest-ProjectReaderTests-1624724882 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:22 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-04c36875-229d-4b1f-a26a-96396bc238a2 tempest-ProjectReaderTests-1624724882 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:18:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-215023588',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe67ac80-f6fa-4a94-991b-f8a0d323fd25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86eb6c72cbf945018024d60d86244af3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:18:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:18:22Z,use_quota=True,user_id='7b43430a779343b78bf657cb3c191723',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:18:22 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-04c36875-229d-4b1f-a26a-96396bc238a2 tempest-ProjectReaderTests-1624724882 None] Creating volume fe67ac80-f6fa-4a94-991b-f8a0d323fd25 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:18:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-04c36875-229d-4b1f-a26a-96396bc238a2 tempest-ProjectReaderTests-1624724882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-04c36875-229d-4b1f-a26a-96396bc238a2 tempest-ProjectReaderTests-1624724882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:22 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-04c36875-229d-4b1f-a26a-96396bc238a2 tempest-ProjectReaderTests-1624724882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:18:22 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-04c36875-229d-4b1f-a26a-96396bc238a2 tempest-ProjectReaderTests-1624724882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:18:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-04c36875-229d-4b1f-a26a-96396bc238a2 tempest-ProjectReaderTests-1624724882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:22 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-04c36875-229d-4b1f-a26a-96396bc238a2 tempest-ProjectReaderTests-1624724882 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:18:22 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-04c36875-229d-4b1f-a26a-96396bc238a2 tempest-ProjectReaderTests-1624724882 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:18:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-04c36875-229d-4b1f-a26a-96396bc238a2 tempest-ProjectReaderTests-1624724882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fe67ac80-f6fa-4a94-991b-f8a0d323fd25 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:22 devstack sudo[98778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fe67ac80-f6fa-4a94-991b-f8a0d323fd25 1073741824
Nov 04 12:18:22 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:22 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-04c36875-229d-4b1f-a26a-96396bc238a2 tempest-ProjectReaderTests-1624724882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fe67ac80-f6fa-4a94-991b-f8a0d323fd25 1073741824" returned: 0 in 0.578s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-04c36875-229d-4b1f-a26a-96396bc238a2 tempest-ProjectReaderTests-1624724882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fe67ac80-f6fa-4a94-991b-f8a0d323fd25 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:22 devstack sudo[98785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fe67ac80-f6fa-4a94-991b-f8a0d323fd25
Nov 04 12:18:22 devstack sudo[98785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:23 devstack sudo[98785]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-04c36875-229d-4b1f-a26a-96396bc238a2 tempest-ProjectReaderTests-1624724882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fe67ac80-f6fa-4a94-991b-f8a0d323fd25" returned: 0 in 0.280s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:23 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-04c36875-229d-4b1f-a26a-96396bc238a2 tempest-ProjectReaderTests-1624724882 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:18:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-04c36875-229d-4b1f-a26a-96396bc238a2 tempest-ProjectReaderTests-1624724882 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:23 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-04c36875-229d-4b1f-a26a-96396bc238a2 tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9546b31d-3c5a-4939-96e0-a428b3eb70cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe67ac80-f6fa-4a94-991b-f8a0d323fd25', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:23 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-04c36875-229d-4b1f-a26a-96396bc238a2 tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83c5b054-4f5d-4587-bc5f-433bb252f492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:23 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-04c36875-229d-4b1f-a26a-96396bc238a2 tempest-ProjectReaderTests-1624724882 None] Volume volume-fe67ac80-f6fa-4a94-991b-f8a0d323fd25 (fe67ac80-f6fa-4a94-991b-f8a0d323fd25): created successfully
Nov 04 12:18:23 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-04c36875-229d-4b1f-a26a-96396bc238a2 tempest-ProjectReaderTests-1624724882 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83c5b054-4f5d-4587-bc5f-433bb252f492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:23 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-04c36875-229d-4b1f-a26a-96396bc238a2 tempest-ProjectReaderTests-1624724882 None] Flow 'volume_create_manager' (e4cc6aae-74f2-423f-9a68-d06f0e671e88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:18:23 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-04c36875-229d-4b1f-a26a-96396bc238a2 tempest-ProjectReaderTests-1624724882 None] Created volume successfully.
Nov 04 12:18:24 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-0f80c2ff-6969-423e-9e85-3470cbfb4630 tempest-ProjectReaderTests-1624724882 None] Acquiring lock "cinder-fe67ac80-f6fa-4a94-991b-f8a0d323fd25-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:18:24 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-0f80c2ff-6969-423e-9e85-3470cbfb4630 tempest-ProjectReaderTests-1624724882 None] Lock "cinder-fe67ac80-f6fa-4a94-991b-f8a0d323fd25-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:18:24 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-0f80c2ff-6969-423e-9e85-3470cbfb4630 tempest-ProjectReaderTests-1624724882 None] Acquiring lock "cinder-quobyte-fe67ac80-f6fa-4a94-991b-f8a0d323fd25" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:18:24 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-0f80c2ff-6969-423e-9e85-3470cbfb4630 tempest-ProjectReaderTests-1624724882 None] Lock "cinder-quobyte-fe67ac80-f6fa-4a94-991b-f8a0d323fd25" acquired by "delete_volume" :: waited 0.022s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:18:24 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e44fe6-9533-450a-9e85-8cc1f19fc026]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:18:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0f80c2ff-6969-423e-9e85-3470cbfb4630 tempest-ProjectReaderTests-1624724882 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fe67ac80-f6fa-4a94-991b-f8a0d323fd25 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:24 devstack sudo[98788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fe67ac80-f6fa-4a94-991b-f8a0d323fd25
Nov 04 12:18:24 devstack sudo[98788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:25 devstack sudo[98788]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0f80c2ff-6969-423e-9e85-3470cbfb4630 tempest-ProjectReaderTests-1624724882 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fe67ac80-f6fa-4a94-991b-f8a0d323fd25" returned: 0 in 0.564s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0f80c2ff-6969-423e-9e85-3470cbfb4630 tempest-ProjectReaderTests-1624724882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fe67ac80-f6fa-4a94-991b-f8a0d323fd25 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:25 devstack sudo[98794]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fe67ac80-f6fa-4a94-991b-f8a0d323fd25
Nov 04 12:18:25 devstack sudo[98794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:25 devstack sudo[98794]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0f80c2ff-6969-423e-9e85-3470cbfb4630 tempest-ProjectReaderTests-1624724882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fe67ac80-f6fa-4a94-991b-f8a0d323fd25" returned: 0 in 0.329s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:25 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-0f80c2ff-6969-423e-9e85-3470cbfb4630 tempest-ProjectReaderTests-1624724882 None] Lock "cinder-quobyte-fe67ac80-f6fa-4a94-991b-f8a0d323fd25" released by "delete_volume" :: held 0.999s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:18:25 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-0f80c2ff-6969-423e-9e85-3470cbfb4630 tempest-ProjectReaderTests-1624724882 None] Created reservations ['cd85c987-3769-40e6-82e2-ed163f19d769', 'd2af6804-b11d-4203-aa53-c4ecf1e0b04b', '3a43e9e2-f7e3-4918-b58c-c534e1406f75', '65b68235-0b95-4ce2-9587-635a8cc8b10a'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:18:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-0f80c2ff-6969-423e-9e85-3470cbfb4630 tempest-ProjectReaderTests-1624724882 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-0f80c2ff-6969-423e-9e85-3470cbfb4630 tempest-ProjectReaderTests-1624724882 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:25 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-0f80c2ff-6969-423e-9e85-3470cbfb4630 tempest-ProjectReaderTests-1624724882 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:18:25 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-0f80c2ff-6969-423e-9e85-3470cbfb4630 tempest-ProjectReaderTests-1624724882 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:18:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-0f80c2ff-6969-423e-9e85-3470cbfb4630 tempest-ProjectReaderTests-1624724882 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0f80c2ff-6969-423e-9e85-3470cbfb4630 tempest-ProjectReaderTests-1624724882 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:25 devstack sudo[98797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:18:25 devstack sudo[98797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:26 devstack sudo[98797]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0f80c2ff-6969-423e-9e85-3470cbfb4630 tempest-ProjectReaderTests-1624724882 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.288s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:26 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-0f80c2ff-6969-423e-9e85-3470cbfb4630 tempest-ProjectReaderTests-1624724882 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:18:26 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-0f80c2ff-6969-423e-9e85-3470cbfb4630 tempest-ProjectReaderTests-1624724882 None] Deleted volume successfully.
Nov 04 12:18:26 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-0f80c2ff-6969-423e-9e85-3470cbfb4630 tempest-ProjectReaderTests-1624724882 None] Lock "cinder-fe67ac80-f6fa-4a94-991b-f8a0d323fd25-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:18:26 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-50c51e04-241f-4a73-adf4-2e9f32c93aaa tempest-GroupsTest-1385499384 None] Group tempest-Group1-730322921: creating
Nov 04 12:18:26 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-50c51e04-241f-4a73-adf4-2e9f32c93aaa tempest-GroupsTest-1385499384 None] Group tempest-Group1-730322921: created successfully
Nov 04 12:18:26 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-50c51e04-241f-4a73-adf4-2e9f32c93aaa tempest-GroupsTest-1385499384 None] Create group completed successfully.
Nov 04 12:18:27 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3fd5c41-ab98-41e5-8f57-68fd2ea80723 tempest-AttachVolumeNegativeTest-1447430610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:18:27 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b3fd5c41-ab98-41e5-8f57-68fd2ea80723 tempest-AttachVolumeNegativeTest-1447430610 None] Flow 'volume_create_manager' (fe5accb0-a396-41c8-8772-8b686e33ba0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:18:27 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b3fd5c41-ab98-41e5-8f57-68fd2ea80723 tempest-AttachVolumeNegativeTest-1447430610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53004df9-b070-42d1-b2b2-53e920859d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:27 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b3fd5c41-ab98-41e5-8f57-68fd2ea80723 tempest-AttachVolumeNegativeTest-1447430610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53004df9-b070-42d1-b2b2-53e920859d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1437152869',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ef059dc-8680-4ae9-a280-b5df0d9a2f70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c984da2769343719eed28765103c79e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:18:28Z,use_quota=True,user_id='952c91a30ef946e08ee0498a11ff1a91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:27 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b3fd5c41-ab98-41e5-8f57-68fd2ea80723 tempest-AttachVolumeNegativeTest-1447430610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71d8dbfc-01e2-440c-8655-b26eaadfe5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:27 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b3fd5c41-ab98-41e5-8f57-68fd2ea80723 tempest-AttachVolumeNegativeTest-1447430610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71d8dbfc-01e2-440c-8655-b26eaadfe5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:27 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b3fd5c41-ab98-41e5-8f57-68fd2ea80723 tempest-AttachVolumeNegativeTest-1447430610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1682ee73-6619-4340-8dd5-f39db3bcd416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:27 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b3fd5c41-ab98-41e5-8f57-68fd2ea80723 tempest-AttachVolumeNegativeTest-1447430610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1682ee73-6619-4340-8dd5-f39db3bcd416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ef059dc-8680-4ae9-a280-b5df0d9a2f70', 'volume_name': 'volume-4ef059dc-8680-4ae9-a280-b5df0d9a2f70', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:27 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b3fd5c41-ab98-41e5-8f57-68fd2ea80723 tempest-AttachVolumeNegativeTest-1447430610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (390af77d-c65d-40c0-960d-afe56b9cb410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:27 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b3fd5c41-ab98-41e5-8f57-68fd2ea80723 tempest-AttachVolumeNegativeTest-1447430610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (390af77d-c65d-40c0-960d-afe56b9cb410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:27 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b3fd5c41-ab98-41e5-8f57-68fd2ea80723 tempest-AttachVolumeNegativeTest-1447430610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51547fd1-b3de-400a-adf4-66a8bf8f941d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:27 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-b3fd5c41-ab98-41e5-8f57-68fd2ea80723 tempest-AttachVolumeNegativeTest-1447430610 None] Volume 4ef059dc-8680-4ae9-a280-b5df0d9a2f70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ef059dc-8680-4ae9-a280-b5df0d9a2f70', 'volume_size': 1}
Nov 04 12:18:27 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b3fd5c41-ab98-41e5-8f57-68fd2ea80723 tempest-AttachVolumeNegativeTest-1447430610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b3fd5c41-ab98-41e5-8f57-68fd2ea80723 tempest-AttachVolumeNegativeTest-1447430610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:28 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-b3fd5c41-ab98-41e5-8f57-68fd2ea80723 tempest-AttachVolumeNegativeTest-1447430610 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1437152869',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ef059dc-8680-4ae9-a280-b5df0d9a2f70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c984da2769343719eed28765103c79e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:18:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:18:28Z,use_quota=True,user_id='952c91a30ef946e08ee0498a11ff1a91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:18:28 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-b3fd5c41-ab98-41e5-8f57-68fd2ea80723 tempest-AttachVolumeNegativeTest-1447430610 None] Creating volume 4ef059dc-8680-4ae9-a280-b5df0d9a2f70 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:18:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b3fd5c41-ab98-41e5-8f57-68fd2ea80723 tempest-AttachVolumeNegativeTest-1447430610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b3fd5c41-ab98-41e5-8f57-68fd2ea80723 tempest-AttachVolumeNegativeTest-1447430610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:28 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-b3fd5c41-ab98-41e5-8f57-68fd2ea80723 tempest-AttachVolumeNegativeTest-1447430610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:18:28 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-b3fd5c41-ab98-41e5-8f57-68fd2ea80723 tempest-AttachVolumeNegativeTest-1447430610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:18:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b3fd5c41-ab98-41e5-8f57-68fd2ea80723 tempest-AttachVolumeNegativeTest-1447430610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:28 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-b3fd5c41-ab98-41e5-8f57-68fd2ea80723 tempest-AttachVolumeNegativeTest-1447430610 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:18:28 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-b3fd5c41-ab98-41e5-8f57-68fd2ea80723 tempest-AttachVolumeNegativeTest-1447430610 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:18:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b3fd5c41-ab98-41e5-8f57-68fd2ea80723 tempest-AttachVolumeNegativeTest-1447430610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4ef059dc-8680-4ae9-a280-b5df0d9a2f70 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:28 devstack sudo[98803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4ef059dc-8680-4ae9-a280-b5df0d9a2f70 1073741824
Nov 04 12:18:28 devstack sudo[98803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:28 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-961eb688-d216-44df-b25d-ca5db530d4a0 tempest-GroupsTest-1385499384 None] Group tempest-Group2-416646165: creating
Nov 04 12:18:28 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-961eb688-d216-44df-b25d-ca5db530d4a0 tempest-GroupsTest-1385499384 None] Group tempest-Group2-416646165: created successfully
Nov 04 12:18:28 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-961eb688-d216-44df-b25d-ca5db530d4a0 tempest-GroupsTest-1385499384 None] Create group completed successfully.
Nov 04 12:18:28 devstack sudo[98803]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b3fd5c41-ab98-41e5-8f57-68fd2ea80723 tempest-AttachVolumeNegativeTest-1447430610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4ef059dc-8680-4ae9-a280-b5df0d9a2f70 1073741824" returned: 0 in 0.606s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b3fd5c41-ab98-41e5-8f57-68fd2ea80723 tempest-AttachVolumeNegativeTest-1447430610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4ef059dc-8680-4ae9-a280-b5df0d9a2f70 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:28 devstack sudo[98809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4ef059dc-8680-4ae9-a280-b5df0d9a2f70
Nov 04 12:18:28 devstack sudo[98809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:28 devstack sudo[98809]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b3fd5c41-ab98-41e5-8f57-68fd2ea80723 tempest-AttachVolumeNegativeTest-1447430610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4ef059dc-8680-4ae9-a280-b5df0d9a2f70" returned: 0 in 0.311s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:28 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-b3fd5c41-ab98-41e5-8f57-68fd2ea80723 tempest-AttachVolumeNegativeTest-1447430610 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:18:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b3fd5c41-ab98-41e5-8f57-68fd2ea80723 tempest-AttachVolumeNegativeTest-1447430610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:28 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b3fd5c41-ab98-41e5-8f57-68fd2ea80723 tempest-AttachVolumeNegativeTest-1447430610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51547fd1-b3de-400a-adf4-66a8bf8f941d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ef059dc-8680-4ae9-a280-b5df0d9a2f70', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:28 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b3fd5c41-ab98-41e5-8f57-68fd2ea80723 tempest-AttachVolumeNegativeTest-1447430610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (694f6f5d-6202-484b-9448-2543cc46c45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:29 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-b3fd5c41-ab98-41e5-8f57-68fd2ea80723 tempest-AttachVolumeNegativeTest-1447430610 None] Volume volume-4ef059dc-8680-4ae9-a280-b5df0d9a2f70 (4ef059dc-8680-4ae9-a280-b5df0d9a2f70): created successfully
Nov 04 12:18:29 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b3fd5c41-ab98-41e5-8f57-68fd2ea80723 tempest-AttachVolumeNegativeTest-1447430610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (694f6f5d-6202-484b-9448-2543cc46c45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:29 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b3fd5c41-ab98-41e5-8f57-68fd2ea80723 tempest-AttachVolumeNegativeTest-1447430610 None] Flow 'volume_create_manager' (fe5accb0-a396-41c8-8772-8b686e33ba0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:18:29 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-b3fd5c41-ab98-41e5-8f57-68fd2ea80723 tempest-AttachVolumeNegativeTest-1447430610 None] Created volume successfully.
Nov 04 12:18:29 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-ace1662f-3097-49df-9169-68769f8f159d tempest-GroupsTest-1385499384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:18:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ace1662f-3097-49df-9169-68769f8f159d tempest-GroupsTest-1385499384 None] Flow 'volume_create_manager' (da982014-7de2-4de3-b61a-496d51dade52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:18:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ace1662f-3097-49df-9169-68769f8f159d tempest-GroupsTest-1385499384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df3e8c1-65ee-4123-948b-e2c662fcb536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ace1662f-3097-49df-9169-68769f8f159d tempest-GroupsTest-1385499384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1df3e8c1-65ee-4123-948b-e2c662fcb536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:18:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1540708881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=86a03002-1fc6-45c6-ae04-064d33b4ad4e,host='devstack@QuobyteHD#QuobyteHD',id=7d196697-157a-4256-87e0-d808574ccbfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ca50bacc094b10800d218a287bf144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:18:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:18:30Z,use_quota=True,user_id='b9dc00949f3a4c98a7c14e6c8ba50397',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(475e9a9f-2d1e-45b1-98fd-051d3f7bf48b),volume_type_id=475e9a9f-2d1e-45b1-98fd-051d3f7bf48b)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ace1662f-3097-49df-9169-68769f8f159d tempest-GroupsTest-1385499384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b7bc4ab-eb52-4efa-967d-ebbb2fdc88f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ace1662f-3097-49df-9169-68769f8f159d tempest-GroupsTest-1385499384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b7bc4ab-eb52-4efa-967d-ebbb2fdc88f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ace1662f-3097-49df-9169-68769f8f159d tempest-GroupsTest-1385499384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b92a2d8a-d2ba-4944-92e0-873ae7b7b961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ace1662f-3097-49df-9169-68769f8f159d tempest-GroupsTest-1385499384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b92a2d8a-d2ba-4944-92e0-873ae7b7b961) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d196697-157a-4256-87e0-d808574ccbfe', 'volume_name': 'volume-7d196697-157a-4256-87e0-d808574ccbfe', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ace1662f-3097-49df-9169-68769f8f159d tempest-GroupsTest-1385499384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64507e67-29ec-46ef-8f4d-f85d118f9203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ace1662f-3097-49df-9169-68769f8f159d tempest-GroupsTest-1385499384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64507e67-29ec-46ef-8f4d-f85d118f9203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ace1662f-3097-49df-9169-68769f8f159d tempest-GroupsTest-1385499384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08bfbaac-b9c8-4b1e-bd4c-09c3460620c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:30 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-ace1662f-3097-49df-9169-68769f8f159d tempest-GroupsTest-1385499384 None] Volume 7d196697-157a-4256-87e0-d808574ccbfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d196697-157a-4256-87e0-d808574ccbfe', 'volume_size': 1}
Nov 04 12:18:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ace1662f-3097-49df-9169-68769f8f159d tempest-GroupsTest-1385499384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ace1662f-3097-49df-9169-68769f8f159d tempest-GroupsTest-1385499384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:30 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ace1662f-3097-49df-9169-68769f8f159d tempest-GroupsTest-1385499384 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=86a03002-1fc6-45c6-ae04-064d33b4ad4e,created_at=2026-11-04T11:18:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1540708881',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=86a03002-1fc6-45c6-ae04-064d33b4ad4e,host='devstack@QuobyteHD#QuobyteHD',id=7d196697-157a-4256-87e0-d808574ccbfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ca50bacc094b10800d218a287bf144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:18:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:18:30Z,use_quota=True,user_id='b9dc00949f3a4c98a7c14e6c8ba50397',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(475e9a9f-2d1e-45b1-98fd-051d3f7bf48b),volume_type_id=475e9a9f-2d1e-45b1-98fd-051d3f7bf48b)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:18:30 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-ace1662f-3097-49df-9169-68769f8f159d tempest-GroupsTest-1385499384 None] Creating volume 7d196697-157a-4256-87e0-d808574ccbfe {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:18:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ace1662f-3097-49df-9169-68769f8f159d tempest-GroupsTest-1385499384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ace1662f-3097-49df-9169-68769f8f159d tempest-GroupsTest-1385499384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:30 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ace1662f-3097-49df-9169-68769f8f159d tempest-GroupsTest-1385499384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:18:30 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ace1662f-3097-49df-9169-68769f8f159d tempest-GroupsTest-1385499384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:18:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ace1662f-3097-49df-9169-68769f8f159d tempest-GroupsTest-1385499384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:30 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ace1662f-3097-49df-9169-68769f8f159d tempest-GroupsTest-1385499384 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:18:30 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-ace1662f-3097-49df-9169-68769f8f159d tempest-GroupsTest-1385499384 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:18:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ace1662f-3097-49df-9169-68769f8f159d tempest-GroupsTest-1385499384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-7d196697-157a-4256-87e0-d808574ccbfe 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:30 devstack sudo[98814]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-7d196697-157a-4256-87e0-d808574ccbfe 1073741824
Nov 04 12:18:30 devstack sudo[98814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:30 devstack sudo[98814]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ace1662f-3097-49df-9169-68769f8f159d tempest-GroupsTest-1385499384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-7d196697-157a-4256-87e0-d808574ccbfe 1073741824" returned: 0 in 0.574s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:30 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:DELETE=15,cinder:SELECT=165,cinder:INSERT=59,cinder:UPDATE=203 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:18:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ace1662f-3097-49df-9169-68769f8f159d tempest-GroupsTest-1385499384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-7d196697-157a-4256-87e0-d808574ccbfe {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:30 devstack sudo[98829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-7d196697-157a-4256-87e0-d808574ccbfe
Nov 04 12:18:30 devstack sudo[98829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-c519fe71-0438-4190-85e2-1efe5f0780b1 req-37db9195-ef37-45d7-bc8e-f96256f50620 tempest-AttachVolumeNegativeTest-1447430610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:31 devstack sudo[98829]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ace1662f-3097-49df-9169-68769f8f159d tempest-GroupsTest-1385499384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-7d196697-157a-4256-87e0-d808574ccbfe" returned: 0 in 0.301s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:31 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ace1662f-3097-49df-9169-68769f8f159d tempest-GroupsTest-1385499384 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:18:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ace1662f-3097-49df-9169-68769f8f159d tempest-GroupsTest-1385499384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-c519fe71-0438-4190-85e2-1efe5f0780b1 req-37db9195-ef37-45d7-bc8e-f96256f50620 tempest-AttachVolumeNegativeTest-1447430610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.187s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ace1662f-3097-49df-9169-68769f8f159d tempest-GroupsTest-1385499384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08bfbaac-b9c8-4b1e-bd4c-09c3460620c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d196697-157a-4256-87e0-d808574ccbfe', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ace1662f-3097-49df-9169-68769f8f159d tempest-GroupsTest-1385499384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41ad9f79-fcfe-4264-bf02-8b4b71350b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-c519fe71-0438-4190-85e2-1efe5f0780b1 req-37db9195-ef37-45d7-bc8e-f96256f50620 tempest-AttachVolumeNegativeTest-1447430610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.042s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:31 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-ace1662f-3097-49df-9169-68769f8f159d tempest-GroupsTest-1385499384 None] Volume volume-7d196697-157a-4256-87e0-d808574ccbfe (7d196697-157a-4256-87e0-d808574ccbfe): created successfully
Nov 04 12:18:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ace1662f-3097-49df-9169-68769f8f159d tempest-GroupsTest-1385499384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41ad9f79-fcfe-4264-bf02-8b4b71350b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ace1662f-3097-49df-9169-68769f8f159d tempest-GroupsTest-1385499384 None] Flow 'volume_create_manager' (da982014-7de2-4de3-b61a-496d51dade52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:18:31 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-ace1662f-3097-49df-9169-68769f8f159d tempest-GroupsTest-1385499384 None] Created volume successfully.
Nov 04 12:18:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-c519fe71-0438-4190-85e2-1efe5f0780b1 req-37db9195-ef37-45d7-bc8e-f96256f50620 tempest-AttachVolumeNegativeTest-1447430610 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79', 'name': 'volume-4ef059dc-8680-4ae9-a280-b5df0d9a2f70', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7bf0ab18-8b96-4f5f-83e6-98b47a2ca147', 'enforce_multipath': True} {{(pid=87169) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 04 12:18:31 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-c519fe71-0438-4190-85e2-1efe5f0780b1 req-37db9195-ef37-45d7-bc8e-f96256f50620 tempest-AttachVolumeNegativeTest-1447430610 None] attachment_update completed successfully.
Nov 04 12:18:33 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-b32dda68-c32b-463e-a1e7-e82f4bef3be4 tempest-GroupsTest-1385499384 None] Acquiring lock "cinder-quobyte-7d196697-157a-4256-87e0-d808574ccbfe" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:18:33 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-b32dda68-c32b-463e-a1e7-e82f4bef3be4 tempest-GroupsTest-1385499384 None] Lock "cinder-quobyte-7d196697-157a-4256-87e0-d808574ccbfe" acquired by "delete_volume" :: waited 0.024s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:18:33 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[020014a3-40bf-4bb1-8cb1-540f4bf39bf1]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:18:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b32dda68-c32b-463e-a1e7-e82f4bef3be4 tempest-GroupsTest-1385499384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-7d196697-157a-4256-87e0-d808574ccbfe {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:33 devstack sudo[99291]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-7d196697-157a-4256-87e0-d808574ccbfe
Nov 04 12:18:33 devstack sudo[99291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:33 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-b9e3a91d-397f-489e-9992-8588b7edc9d4 req-f2786f0e-d9d7-4450-af91-674a217928b2 tempest-AttachVolumeNegativeTest-1447430610 None] Terminate volume connection completed successfully.
Nov 04 12:18:33 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-b9e3a91d-397f-489e-9992-8588b7edc9d4 req-f2786f0e-d9d7-4450-af91-674a217928b2 tempest-AttachVolumeNegativeTest-1447430610 None] Deleting attachment 7bf0ab18-8b96-4f5f-83e6-98b47a2ca147. {{(pid=87169) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 12:18:33 devstack sudo[99291]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b32dda68-c32b-463e-a1e7-e82f4bef3be4 tempest-GroupsTest-1385499384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-7d196697-157a-4256-87e0-d808574ccbfe" returned: 0 in 0.532s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b32dda68-c32b-463e-a1e7-e82f4bef3be4 tempest-GroupsTest-1385499384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-7d196697-157a-4256-87e0-d808574ccbfe {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:34 devstack sudo[99322]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-7d196697-157a-4256-87e0-d808574ccbfe
Nov 04 12:18:34 devstack sudo[99322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:34 devstack sudo[99322]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b32dda68-c32b-463e-a1e7-e82f4bef3be4 tempest-GroupsTest-1385499384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-7d196697-157a-4256-87e0-d808574ccbfe" returned: 0 in 0.281s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:34 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-b32dda68-c32b-463e-a1e7-e82f4bef3be4 tempest-GroupsTest-1385499384 None] Lock "cinder-quobyte-7d196697-157a-4256-87e0-d808574ccbfe" released by "delete_volume" :: held 0.877s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:18:34 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-b32dda68-c32b-463e-a1e7-e82f4bef3be4 tempest-GroupsTest-1385499384 None] Created reservations ['254808ad-dca8-402d-86e9-8606776c0901'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:18:34 devstack cinder-volume[87169]: WARNING cinder.quota [None req-b32dda68-c32b-463e-a1e7-e82f4bef3be4 tempest-GroupsTest-1385499384 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2040918820 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2040918820, it is now deprecated. Please use the default quota class for default quota.
Nov 04 12:18:34 devstack cinder-volume[87169]: WARNING cinder.quota [None req-b32dda68-c32b-463e-a1e7-e82f4bef3be4 tempest-GroupsTest-1385499384 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2040918820 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2040918820, it is now deprecated. Please use the default quota class for default quota.
Nov 04 12:18:34 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-b32dda68-c32b-463e-a1e7-e82f4bef3be4 tempest-GroupsTest-1385499384 None] Created reservations ['3de0db70-be3d-4ca1-84fe-41f7d819173f', '7934f82b-b7ae-46a8-b7ab-e1598f1ebfb2', 'fcd6b0c8-a630-402e-b905-52c26c48d90a', '98a30dd7-2783-418d-abd4-a055fc3a3f9b'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:18:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b32dda68-c32b-463e-a1e7-e82f4bef3be4 tempest-GroupsTest-1385499384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b32dda68-c32b-463e-a1e7-e82f4bef3be4 tempest-GroupsTest-1385499384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:34 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-b32dda68-c32b-463e-a1e7-e82f4bef3be4 tempest-GroupsTest-1385499384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:18:34 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-b32dda68-c32b-463e-a1e7-e82f4bef3be4 tempest-GroupsTest-1385499384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:18:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b32dda68-c32b-463e-a1e7-e82f4bef3be4 tempest-GroupsTest-1385499384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b32dda68-c32b-463e-a1e7-e82f4bef3be4 tempest-GroupsTest-1385499384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:34 devstack sudo[99325]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:18:34 devstack sudo[99325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:34 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-080df84b-d9e8-4491-855f-a4785d651ad0 tempest-GroupsTest-1385499384 None] Created reservations ['5c15b0b2-500c-40ce-b874-ec3abd698b9d'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:18:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-080df84b-d9e8-4491-855f-a4785d651ad0 tempest-GroupsTest-1385499384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-080df84b-d9e8-4491-855f-a4785d651ad0 tempest-GroupsTest-1385499384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:34 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-080df84b-d9e8-4491-855f-a4785d651ad0 tempest-GroupsTest-1385499384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:18:34 devstack sudo[99325]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:34 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-080df84b-d9e8-4491-855f-a4785d651ad0 tempest-GroupsTest-1385499384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:18:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-080df84b-d9e8-4491-855f-a4785d651ad0 tempest-GroupsTest-1385499384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-080df84b-d9e8-4491-855f-a4785d651ad0 tempest-GroupsTest-1385499384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b32dda68-c32b-463e-a1e7-e82f4bef3be4 tempest-GroupsTest-1385499384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.401s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:34 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-b32dda68-c32b-463e-a1e7-e82f4bef3be4 tempest-GroupsTest-1385499384 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:18:34 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-b32dda68-c32b-463e-a1e7-e82f4bef3be4 tempest-GroupsTest-1385499384 None] Delete group completed successfully.
Nov 04 12:18:34 devstack sudo[99328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:18:34 devstack sudo[99328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:35 devstack sudo[99328]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-080df84b-d9e8-4491-855f-a4785d651ad0 tempest-GroupsTest-1385499384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.382s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:35 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-080df84b-d9e8-4491-855f-a4785d651ad0 tempest-GroupsTest-1385499384 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:18:35 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-080df84b-d9e8-4491-855f-a4785d651ad0 tempest-GroupsTest-1385499384 None] Delete group completed successfully.
Nov 04 12:18:36 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-1661a45a-36d8-4233-a086-bab04bad7886 tempest-GroupsTest-1385499384 None] Group tempest-GroupsTest-Group-1339191969: creating
Nov 04 12:18:36 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-1661a45a-36d8-4233-a086-bab04bad7886 tempest-GroupsTest-1385499384 None] Group tempest-GroupsTest-Group-1339191969: created successfully
Nov 04 12:18:36 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-1661a45a-36d8-4233-a086-bab04bad7886 tempest-GroupsTest-1385499384 None] Create group completed successfully.
Nov 04 12:18:38 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-954a9c1d-95ab-4c6f-b7d1-cdba2d50ea02 tempest-GroupsTest-1385499384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:18:38 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-954a9c1d-95ab-4c6f-b7d1-cdba2d50ea02 tempest-GroupsTest-1385499384 None] Flow 'volume_create_manager' (0c6a8ffc-d150-4d60-bcd4-9e6be2762b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:18:38 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-954a9c1d-95ab-4c6f-b7d1-cdba2d50ea02 tempest-GroupsTest-1385499384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de2d8227-02d0-47b0-80e4-e57abc09ede0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:38 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-954a9c1d-95ab-4c6f-b7d1-cdba2d50ea02 tempest-GroupsTest-1385499384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de2d8227-02d0-47b0-80e4-e57abc09ede0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-365498083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=20c0b4d3-ab3b-4b6a-8307-3fcf63801566,host='devstack@QuobyteHD#QuobyteHD',id=6144a75a-e6cd-40a0-a6df-219c9a6b7a17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ca50bacc094b10800d218a287bf144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:18:38Z,use_quota=True,user_id='b9dc00949f3a4c98a7c14e6c8ba50397',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3959514-df0d-4219-b2d0-94399b7278a8),volume_type_id=b3959514-df0d-4219-b2d0-94399b7278a8)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:38 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-954a9c1d-95ab-4c6f-b7d1-cdba2d50ea02 tempest-GroupsTest-1385499384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f49c29-4ddf-4202-bc8c-8039eb5e2a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:38 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-954a9c1d-95ab-4c6f-b7d1-cdba2d50ea02 tempest-GroupsTest-1385499384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8f49c29-4ddf-4202-bc8c-8039eb5e2a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:38 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-954a9c1d-95ab-4c6f-b7d1-cdba2d50ea02 tempest-GroupsTest-1385499384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00358e31-32ff-4369-8009-98e73495d489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:38 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-954a9c1d-95ab-4c6f-b7d1-cdba2d50ea02 tempest-GroupsTest-1385499384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00358e31-32ff-4369-8009-98e73495d489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6144a75a-e6cd-40a0-a6df-219c9a6b7a17', 'volume_name': 'volume-6144a75a-e6cd-40a0-a6df-219c9a6b7a17', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:38 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-954a9c1d-95ab-4c6f-b7d1-cdba2d50ea02 tempest-GroupsTest-1385499384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb0206d4-9879-4387-94f1-8f97601d6b33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:38 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-954a9c1d-95ab-4c6f-b7d1-cdba2d50ea02 tempest-GroupsTest-1385499384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb0206d4-9879-4387-94f1-8f97601d6b33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:38 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-954a9c1d-95ab-4c6f-b7d1-cdba2d50ea02 tempest-GroupsTest-1385499384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d2a3fd2-6bec-41ad-a255-80071d6e9ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:38 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-954a9c1d-95ab-4c6f-b7d1-cdba2d50ea02 tempest-GroupsTest-1385499384 None] Volume 6144a75a-e6cd-40a0-a6df-219c9a6b7a17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6144a75a-e6cd-40a0-a6df-219c9a6b7a17', 'volume_size': 1}
Nov 04 12:18:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-954a9c1d-95ab-4c6f-b7d1-cdba2d50ea02 tempest-GroupsTest-1385499384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-954a9c1d-95ab-4c6f-b7d1-cdba2d50ea02 tempest-GroupsTest-1385499384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:38 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-954a9c1d-95ab-4c6f-b7d1-cdba2d50ea02 tempest-GroupsTest-1385499384 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=20c0b4d3-ab3b-4b6a-8307-3fcf63801566,created_at=2026-11-04T11:18:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-365498083',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=20c0b4d3-ab3b-4b6a-8307-3fcf63801566,host='devstack@QuobyteHD#QuobyteHD',id=6144a75a-e6cd-40a0-a6df-219c9a6b7a17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ca50bacc094b10800d218a287bf144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:18:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:18:38Z,use_quota=True,user_id='b9dc00949f3a4c98a7c14e6c8ba50397',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3959514-df0d-4219-b2d0-94399b7278a8),volume_type_id=b3959514-df0d-4219-b2d0-94399b7278a8)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:18:38 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-954a9c1d-95ab-4c6f-b7d1-cdba2d50ea02 tempest-GroupsTest-1385499384 None] Creating volume 6144a75a-e6cd-40a0-a6df-219c9a6b7a17 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:18:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-954a9c1d-95ab-4c6f-b7d1-cdba2d50ea02 tempest-GroupsTest-1385499384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-954a9c1d-95ab-4c6f-b7d1-cdba2d50ea02 tempest-GroupsTest-1385499384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:38 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-954a9c1d-95ab-4c6f-b7d1-cdba2d50ea02 tempest-GroupsTest-1385499384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:18:38 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-954a9c1d-95ab-4c6f-b7d1-cdba2d50ea02 tempest-GroupsTest-1385499384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:18:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-954a9c1d-95ab-4c6f-b7d1-cdba2d50ea02 tempest-GroupsTest-1385499384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:38 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-954a9c1d-95ab-4c6f-b7d1-cdba2d50ea02 tempest-GroupsTest-1385499384 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:18:38 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-954a9c1d-95ab-4c6f-b7d1-cdba2d50ea02 tempest-GroupsTest-1385499384 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:18:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-954a9c1d-95ab-4c6f-b7d1-cdba2d50ea02 tempest-GroupsTest-1385499384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6144a75a-e6cd-40a0-a6df-219c9a6b7a17 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:38 devstack sudo[99354]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6144a75a-e6cd-40a0-a6df-219c9a6b7a17 1073741824
Nov 04 12:18:38 devstack sudo[99354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:39 devstack sudo[99354]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-954a9c1d-95ab-4c6f-b7d1-cdba2d50ea02 tempest-GroupsTest-1385499384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6144a75a-e6cd-40a0-a6df-219c9a6b7a17 1073741824" returned: 0 in 0.652s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-954a9c1d-95ab-4c6f-b7d1-cdba2d50ea02 tempest-GroupsTest-1385499384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6144a75a-e6cd-40a0-a6df-219c9a6b7a17 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:39 devstack sudo[99360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6144a75a-e6cd-40a0-a6df-219c9a6b7a17
Nov 04 12:18:39 devstack sudo[99360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:39 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-bed7f276-f878-4d27-b28f-8f12c9c1a6c8 tempest-VolumesSnapshotTestJSON-434051366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:18:39 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bed7f276-f878-4d27-b28f-8f12c9c1a6c8 tempest-VolumesSnapshotTestJSON-434051366 None] Flow 'volume_create_manager' (5b69f145-af7a-4f17-8ef6-b61276fc4916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:18:39 devstack sudo[99360]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:39 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bed7f276-f878-4d27-b28f-8f12c9c1a6c8 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5a384e4-4605-4c8e-810f-12425c125808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-954a9c1d-95ab-4c6f-b7d1-cdba2d50ea02 tempest-GroupsTest-1385499384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6144a75a-e6cd-40a0-a6df-219c9a6b7a17" returned: 0 in 0.305s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:39 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-954a9c1d-95ab-4c6f-b7d1-cdba2d50ea02 tempest-GroupsTest-1385499384 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:18:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-954a9c1d-95ab-4c6f-b7d1-cdba2d50ea02 tempest-GroupsTest-1385499384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:39 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bed7f276-f878-4d27-b28f-8f12c9c1a6c8 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5a384e4-4605-4c8e-810f-12425c125808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-687722550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30f9da1d-5f61-4eb7-85d3-4a0f8d9318df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ca15df84b5a40ef9bab2894e931f47a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:18:40Z,use_quota=True,user_id='6da3b5f34fc64db69b23ab368664ba14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:39 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bed7f276-f878-4d27-b28f-8f12c9c1a6c8 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2402ad94-9f49-4e00-88a2-c7f47f664668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:39 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bed7f276-f878-4d27-b28f-8f12c9c1a6c8 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2402ad94-9f49-4e00-88a2-c7f47f664668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:39 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bed7f276-f878-4d27-b28f-8f12c9c1a6c8 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23855045-7c39-4388-ba1c-e79a005232ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:39 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bed7f276-f878-4d27-b28f-8f12c9c1a6c8 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23855045-7c39-4388-ba1c-e79a005232ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30f9da1d-5f61-4eb7-85d3-4a0f8d9318df', 'volume_name': 'volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:39 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bed7f276-f878-4d27-b28f-8f12c9c1a6c8 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0030cb18-b549-4d60-9bbd-6982b16cb4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:39 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bed7f276-f878-4d27-b28f-8f12c9c1a6c8 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0030cb18-b549-4d60-9bbd-6982b16cb4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:39 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bed7f276-f878-4d27-b28f-8f12c9c1a6c8 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23349f49-19f5-481b-bcc8-fbcc5d77de22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:39 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-bed7f276-f878-4d27-b28f-8f12c9c1a6c8 tempest-VolumesSnapshotTestJSON-434051366 None] Volume 30f9da1d-5f61-4eb7-85d3-4a0f8d9318df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df', 'volume_size': 1}
Nov 04 12:18:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-bed7f276-f878-4d27-b28f-8f12c9c1a6c8 tempest-VolumesSnapshotTestJSON-434051366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-bed7f276-f878-4d27-b28f-8f12c9c1a6c8 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:39 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-bed7f276-f878-4d27-b28f-8f12c9c1a6c8 tempest-VolumesSnapshotTestJSON-434051366 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:18:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-687722550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30f9da1d-5f61-4eb7-85d3-4a0f8d9318df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ca15df84b5a40ef9bab2894e931f47a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:18:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:18:40Z,use_quota=True,user_id='6da3b5f34fc64db69b23ab368664ba14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:18:39 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-bed7f276-f878-4d27-b28f-8f12c9c1a6c8 tempest-VolumesSnapshotTestJSON-434051366 None] Creating volume 30f9da1d-5f61-4eb7-85d3-4a0f8d9318df {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:18:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-bed7f276-f878-4d27-b28f-8f12c9c1a6c8 tempest-VolumesSnapshotTestJSON-434051366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-bed7f276-f878-4d27-b28f-8f12c9c1a6c8 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:39 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-bed7f276-f878-4d27-b28f-8f12c9c1a6c8 tempest-VolumesSnapshotTestJSON-434051366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:18:39 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-bed7f276-f878-4d27-b28f-8f12c9c1a6c8 tempest-VolumesSnapshotTestJSON-434051366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:18:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-bed7f276-f878-4d27-b28f-8f12c9c1a6c8 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:39 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-bed7f276-f878-4d27-b28f-8f12c9c1a6c8 tempest-VolumesSnapshotTestJSON-434051366 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:18:39 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-bed7f276-f878-4d27-b28f-8f12c9c1a6c8 tempest-VolumesSnapshotTestJSON-434051366 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:18:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bed7f276-f878-4d27-b28f-8f12c9c1a6c8 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:39 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-954a9c1d-95ab-4c6f-b7d1-cdba2d50ea02 tempest-GroupsTest-1385499384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d2a3fd2-6bec-41ad-a255-80071d6e9ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6144a75a-e6cd-40a0-a6df-219c9a6b7a17', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:39 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-954a9c1d-95ab-4c6f-b7d1-cdba2d50ea02 tempest-GroupsTest-1385499384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dce8b86-5e62-4630-bf59-b04a9d906f47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:39 devstack sudo[99363]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df 1073741824
Nov 04 12:18:39 devstack sudo[99363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:39 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-954a9c1d-95ab-4c6f-b7d1-cdba2d50ea02 tempest-GroupsTest-1385499384 None] Volume volume-6144a75a-e6cd-40a0-a6df-219c9a6b7a17 (6144a75a-e6cd-40a0-a6df-219c9a6b7a17): created successfully
Nov 04 12:18:39 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-954a9c1d-95ab-4c6f-b7d1-cdba2d50ea02 tempest-GroupsTest-1385499384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dce8b86-5e62-4630-bf59-b04a9d906f47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:39 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-954a9c1d-95ab-4c6f-b7d1-cdba2d50ea02 tempest-GroupsTest-1385499384 None] Flow 'volume_create_manager' (0c6a8ffc-d150-4d60-bcd4-9e6be2762b70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:18:39 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-954a9c1d-95ab-4c6f-b7d1-cdba2d50ea02 tempest-GroupsTest-1385499384 None] Created volume successfully.
Nov 04 12:18:40 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1a2fb1fb-44d4-49c9-a542-fbd3b25ba094 tempest-AttachVolumeNegativeTest-1447430610 None] Acquiring lock "cinder-4ef059dc-8680-4ae9-a280-b5df0d9a2f70-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:18:40 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1a2fb1fb-44d4-49c9-a542-fbd3b25ba094 tempest-AttachVolumeNegativeTest-1447430610 None] Lock "cinder-4ef059dc-8680-4ae9-a280-b5df0d9a2f70-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:18:40 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1a2fb1fb-44d4-49c9-a542-fbd3b25ba094 tempest-AttachVolumeNegativeTest-1447430610 None] Acquiring lock "cinder-quobyte-4ef059dc-8680-4ae9-a280-b5df0d9a2f70" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:18:40 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1a2fb1fb-44d4-49c9-a542-fbd3b25ba094 tempest-AttachVolumeNegativeTest-1447430610 None] Lock "cinder-quobyte-4ef059dc-8680-4ae9-a280-b5df0d9a2f70" acquired by "delete_volume" :: waited 0.019s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:18:40 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[c605f1aa-33a5-43ea-bb7b-2a5517b7715f]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:18:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1a2fb1fb-44d4-49c9-a542-fbd3b25ba094 tempest-AttachVolumeNegativeTest-1447430610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4ef059dc-8680-4ae9-a280-b5df0d9a2f70 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:40 devstack sudo[99363]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bed7f276-f878-4d27-b28f-8f12c9c1a6c8 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df 1073741824" returned: 0 in 0.490s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bed7f276-f878-4d27-b28f-8f12c9c1a6c8 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:40 devstack sudo[99370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df
Nov 04 12:18:40 devstack sudo[99370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:40 devstack sudo[99369]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4ef059dc-8680-4ae9-a280-b5df0d9a2f70
Nov 04 12:18:40 devstack sudo[99369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:40 devstack sudo[99370]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bed7f276-f878-4d27-b28f-8f12c9c1a6c8 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df" returned: 0 in 0.275s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:40 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-bed7f276-f878-4d27-b28f-8f12c9c1a6c8 tempest-VolumesSnapshotTestJSON-434051366 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:18:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-bed7f276-f878-4d27-b28f-8f12c9c1a6c8 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.816s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bed7f276-f878-4d27-b28f-8f12c9c1a6c8 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23349f49-19f5-481b-bcc8-fbcc5d77de22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bed7f276-f878-4d27-b28f-8f12c9c1a6c8 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c90b76-d053-4c5b-affd-88041a9e36bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:40 devstack sudo[99369]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1a2fb1fb-44d4-49c9-a542-fbd3b25ba094 tempest-AttachVolumeNegativeTest-1447430610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4ef059dc-8680-4ae9-a280-b5df0d9a2f70" returned: 0 in 0.394s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1a2fb1fb-44d4-49c9-a542-fbd3b25ba094 tempest-AttachVolumeNegativeTest-1447430610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4ef059dc-8680-4ae9-a280-b5df0d9a2f70 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:40 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-bed7f276-f878-4d27-b28f-8f12c9c1a6c8 tempest-VolumesSnapshotTestJSON-434051366 None] Volume volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df (30f9da1d-5f61-4eb7-85d3-4a0f8d9318df): created successfully
Nov 04 12:18:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bed7f276-f878-4d27-b28f-8f12c9c1a6c8 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86c90b76-d053-4c5b-affd-88041a9e36bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bed7f276-f878-4d27-b28f-8f12c9c1a6c8 tempest-VolumesSnapshotTestJSON-434051366 None] Flow 'volume_create_manager' (5b69f145-af7a-4f17-8ef6-b61276fc4916) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:18:40 devstack sudo[99377]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4ef059dc-8680-4ae9-a280-b5df0d9a2f70
Nov 04 12:18:40 devstack sudo[99377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:40 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-bed7f276-f878-4d27-b28f-8f12c9c1a6c8 tempest-VolumesSnapshotTestJSON-434051366 None] Created volume successfully.
Nov 04 12:18:40 devstack sudo[99377]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1a2fb1fb-44d4-49c9-a542-fbd3b25ba094 tempest-AttachVolumeNegativeTest-1447430610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4ef059dc-8680-4ae9-a280-b5df0d9a2f70" returned: 0 in 0.251s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:40 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1a2fb1fb-44d4-49c9-a542-fbd3b25ba094 tempest-AttachVolumeNegativeTest-1447430610 None] Lock "cinder-quobyte-4ef059dc-8680-4ae9-a280-b5df0d9a2f70" released by "delete_volume" :: held 0.687s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:18:40 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-1a2fb1fb-44d4-49c9-a542-fbd3b25ba094 tempest-AttachVolumeNegativeTest-1447430610 None] Created reservations ['8ea6e846-cfa4-4cf0-ad51-8944cfed415b', 'c041eea2-f591-47de-8390-092e6f0a9536', '65b8764b-0d73-459e-82b0-6863bcfa9f3f', 'ffd370a5-b0f2-421b-ac09-63c124e2e464'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:18:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1a2fb1fb-44d4-49c9-a542-fbd3b25ba094 tempest-AttachVolumeNegativeTest-1447430610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1a2fb1fb-44d4-49c9-a542-fbd3b25ba094 tempest-AttachVolumeNegativeTest-1447430610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:40 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1a2fb1fb-44d4-49c9-a542-fbd3b25ba094 tempest-AttachVolumeNegativeTest-1447430610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:18:40 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1a2fb1fb-44d4-49c9-a542-fbd3b25ba094 tempest-AttachVolumeNegativeTest-1447430610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:18:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1a2fb1fb-44d4-49c9-a542-fbd3b25ba094 tempest-AttachVolumeNegativeTest-1447430610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1a2fb1fb-44d4-49c9-a542-fbd3b25ba094 tempest-AttachVolumeNegativeTest-1447430610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:40 devstack sudo[99380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:18:40 devstack sudo[99380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:41 devstack sudo[99380]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1a2fb1fb-44d4-49c9-a542-fbd3b25ba094 tempest-AttachVolumeNegativeTest-1447430610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.253s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:41 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-1a2fb1fb-44d4-49c9-a542-fbd3b25ba094 tempest-AttachVolumeNegativeTest-1447430610 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:18:41 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-1a2fb1fb-44d4-49c9-a542-fbd3b25ba094 tempest-AttachVolumeNegativeTest-1447430610 None] Deleted volume successfully.
Nov 04 12:18:41 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1a2fb1fb-44d4-49c9-a542-fbd3b25ba094 tempest-AttachVolumeNegativeTest-1447430610 None] Lock "cinder-4ef059dc-8680-4ae9-a280-b5df0d9a2f70-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:18:41 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f6bd206a-f5fa-40ca-bb71-acfbe7a1f2e6 tempest-AttachVolumeNegativeTest-1447430610 None] Acquiring lock "cinder-d9b3a6c6-a1a0-41e4-95d2-0a48273d0ab7-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:18:41 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f6bd206a-f5fa-40ca-bb71-acfbe7a1f2e6 tempest-AttachVolumeNegativeTest-1447430610 None] Lock "cinder-d9b3a6c6-a1a0-41e4-95d2-0a48273d0ab7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:18:41 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f6bd206a-f5fa-40ca-bb71-acfbe7a1f2e6 tempest-AttachVolumeNegativeTest-1447430610 None] Acquiring lock "cinder-quobyte-d9b3a6c6-a1a0-41e4-95d2-0a48273d0ab7" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:18:41 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-624a6864-77f1-4576-bcda-3d4a9b3cf9d7 tempest-GroupsTest-1385499384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:18:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-624a6864-77f1-4576-bcda-3d4a9b3cf9d7 tempest-GroupsTest-1385499384 None] Flow 'volume_create_manager' (b0258617-fd33-418a-b676-4d2c330d3bd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:18:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-624a6864-77f1-4576-bcda-3d4a9b3cf9d7 tempest-GroupsTest-1385499384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f3fed88-c8d0-40b5-ae88-bd9a38d9f10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:41 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f6bd206a-f5fa-40ca-bb71-acfbe7a1f2e6 tempest-AttachVolumeNegativeTest-1447430610 None] Lock "cinder-quobyte-d9b3a6c6-a1a0-41e4-95d2-0a48273d0ab7" acquired by "delete_volume" :: waited 0.048s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:18:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-624a6864-77f1-4576-bcda-3d4a9b3cf9d7 tempest-GroupsTest-1385499384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f3fed88-c8d0-40b5-ae88-bd9a38d9f10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-221448198',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=20c0b4d3-ab3b-4b6a-8307-3fcf63801566,host='devstack@QuobyteHD#QuobyteHD',id=c65ad697-ab85-4cfe-b517-6939d850ea05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ca50bacc094b10800d218a287bf144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:18:41Z,use_quota=True,user_id='b9dc00949f3a4c98a7c14e6c8ba50397',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3959514-df0d-4219-b2d0-94399b7278a8),volume_type_id=b3959514-df0d-4219-b2d0-94399b7278a8)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-624a6864-77f1-4576-bcda-3d4a9b3cf9d7 tempest-GroupsTest-1385499384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acd479e7-424c-41a5-8dde-0e815fdbd08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-624a6864-77f1-4576-bcda-3d4a9b3cf9d7 tempest-GroupsTest-1385499384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acd479e7-424c-41a5-8dde-0e815fdbd08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-624a6864-77f1-4576-bcda-3d4a9b3cf9d7 tempest-GroupsTest-1385499384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca74e4fd-aa79-4a6c-ab7d-b392a0851499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-624a6864-77f1-4576-bcda-3d4a9b3cf9d7 tempest-GroupsTest-1385499384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca74e4fd-aa79-4a6c-ab7d-b392a0851499) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c65ad697-ab85-4cfe-b517-6939d850ea05', 'volume_name': 'volume-c65ad697-ab85-4cfe-b517-6939d850ea05', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-624a6864-77f1-4576-bcda-3d4a9b3cf9d7 tempest-GroupsTest-1385499384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51e62414-5e75-4f42-9611-7ad9b47680d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-624a6864-77f1-4576-bcda-3d4a9b3cf9d7 tempest-GroupsTest-1385499384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51e62414-5e75-4f42-9611-7ad9b47680d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-624a6864-77f1-4576-bcda-3d4a9b3cf9d7 tempest-GroupsTest-1385499384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c823f3f-090c-4125-af74-0a649757c32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:41 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-624a6864-77f1-4576-bcda-3d4a9b3cf9d7 tempest-GroupsTest-1385499384 None] Volume c65ad697-ab85-4cfe-b517-6939d850ea05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c65ad697-ab85-4cfe-b517-6939d850ea05', 'volume_size': 1}
Nov 04 12:18:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-624a6864-77f1-4576-bcda-3d4a9b3cf9d7 tempest-GroupsTest-1385499384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-624a6864-77f1-4576-bcda-3d4a9b3cf9d7 tempest-GroupsTest-1385499384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:41 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-624a6864-77f1-4576-bcda-3d4a9b3cf9d7 tempest-GroupsTest-1385499384 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=20c0b4d3-ab3b-4b6a-8307-3fcf63801566,created_at=2026-11-04T11:18:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-221448198',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=20c0b4d3-ab3b-4b6a-8307-3fcf63801566,host='devstack@QuobyteHD#QuobyteHD',id=c65ad697-ab85-4cfe-b517-6939d850ea05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ca50bacc094b10800d218a287bf144',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:18:41Z,use_quota=True,user_id='b9dc00949f3a4c98a7c14e6c8ba50397',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b3959514-df0d-4219-b2d0-94399b7278a8),volume_type_id=b3959514-df0d-4219-b2d0-94399b7278a8)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:18:41 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-624a6864-77f1-4576-bcda-3d4a9b3cf9d7 tempest-GroupsTest-1385499384 None] Creating volume c65ad697-ab85-4cfe-b517-6939d850ea05 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:18:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-624a6864-77f1-4576-bcda-3d4a9b3cf9d7 tempest-GroupsTest-1385499384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-624a6864-77f1-4576-bcda-3d4a9b3cf9d7 tempest-GroupsTest-1385499384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:41 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-624a6864-77f1-4576-bcda-3d4a9b3cf9d7 tempest-GroupsTest-1385499384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:18:41 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-624a6864-77f1-4576-bcda-3d4a9b3cf9d7 tempest-GroupsTest-1385499384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:18:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-624a6864-77f1-4576-bcda-3d4a9b3cf9d7 tempest-GroupsTest-1385499384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:41 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-624a6864-77f1-4576-bcda-3d4a9b3cf9d7 tempest-GroupsTest-1385499384 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:18:41 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-624a6864-77f1-4576-bcda-3d4a9b3cf9d7 tempest-GroupsTest-1385499384 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:18:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-624a6864-77f1-4576-bcda-3d4a9b3cf9d7 tempest-GroupsTest-1385499384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c65ad697-ab85-4cfe-b517-6939d850ea05 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:41 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c92b90-9a6a-4e6f-a656-c44b588bb405]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:18:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f6bd206a-f5fa-40ca-bb71-acfbe7a1f2e6 tempest-AttachVolumeNegativeTest-1447430610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d9b3a6c6-a1a0-41e4-95d2-0a48273d0ab7 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:41 devstack sudo[99384]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c65ad697-ab85-4cfe-b517-6939d850ea05 1073741824
Nov 04 12:18:41 devstack sudo[99384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:41 devstack sudo[99385]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d9b3a6c6-a1a0-41e4-95d2-0a48273d0ab7
Nov 04 12:18:41 devstack sudo[99385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c79b5cc9-9fb7-4310-a0d8-dcea4d6070e3 tempest-VolumesSnapshotTestJSON-434051366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:41 devstack sudo[99385]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f6bd206a-f5fa-40ca-bb71-acfbe7a1f2e6 tempest-AttachVolumeNegativeTest-1447430610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d9b3a6c6-a1a0-41e4-95d2-0a48273d0ab7" returned: 0 in 0.424s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f6bd206a-f5fa-40ca-bb71-acfbe7a1f2e6 tempest-AttachVolumeNegativeTest-1447430610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d9b3a6c6-a1a0-41e4-95d2-0a48273d0ab7 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:42 devstack sudo[99396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d9b3a6c6-a1a0-41e4-95d2-0a48273d0ab7
Nov 04 12:18:42 devstack sudo[99396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:42 devstack sudo[99384]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-624a6864-77f1-4576-bcda-3d4a9b3cf9d7 tempest-GroupsTest-1385499384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c65ad697-ab85-4cfe-b517-6939d850ea05 1073741824" returned: 0 in 0.498s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-624a6864-77f1-4576-bcda-3d4a9b3cf9d7 tempest-GroupsTest-1385499384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c65ad697-ab85-4cfe-b517-6939d850ea05 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:42 devstack sudo[99398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c65ad697-ab85-4cfe-b517-6939d850ea05
Nov 04 12:18:42 devstack sudo[99398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:42 devstack sudo[99396]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f6bd206a-f5fa-40ca-bb71-acfbe7a1f2e6 tempest-AttachVolumeNegativeTest-1447430610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d9b3a6c6-a1a0-41e4-95d2-0a48273d0ab7" returned: 0 in 0.244s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:42 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f6bd206a-f5fa-40ca-bb71-acfbe7a1f2e6 tempest-AttachVolumeNegativeTest-1447430610 None] Lock "cinder-quobyte-d9b3a6c6-a1a0-41e4-95d2-0a48273d0ab7" released by "delete_volume" :: held 0.780s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:18:42 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-f6bd206a-f5fa-40ca-bb71-acfbe7a1f2e6 tempest-AttachVolumeNegativeTest-1447430610 None] Created reservations ['84b72b9e-285b-452b-8095-2415c3127c4e', '7bb541eb-9a8f-4450-8794-27e8c88bd13c', '1d61cf79-fe0c-4434-927a-189cd4bb5c20', 'c1e02f26-9fd3-435b-99bc-950093fbb4ec'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:18:42 devstack sudo[99398]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-624a6864-77f1-4576-bcda-3d4a9b3cf9d7 tempest-GroupsTest-1385499384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c65ad697-ab85-4cfe-b517-6939d850ea05" returned: 0 in 0.262s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:42 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-624a6864-77f1-4576-bcda-3d4a9b3cf9d7 tempest-GroupsTest-1385499384 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:18:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-624a6864-77f1-4576-bcda-3d4a9b3cf9d7 tempest-GroupsTest-1385499384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c79b5cc9-9fb7-4310-a0d8-dcea4d6070e3 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.369s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-624a6864-77f1-4576-bcda-3d4a9b3cf9d7 tempest-GroupsTest-1385499384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c823f3f-090c-4125-af74-0a649757c32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c65ad697-ab85-4cfe-b517-6939d850ea05', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-624a6864-77f1-4576-bcda-3d4a9b3cf9d7 tempest-GroupsTest-1385499384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d139fb-c612-412c-9e8e-e49ddbff10be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f6bd206a-f5fa-40ca-bb71-acfbe7a1f2e6 tempest-AttachVolumeNegativeTest-1447430610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f6bd206a-f5fa-40ca-bb71-acfbe7a1f2e6 tempest-AttachVolumeNegativeTest-1447430610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:42 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f6bd206a-f5fa-40ca-bb71-acfbe7a1f2e6 tempest-AttachVolumeNegativeTest-1447430610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:18:42 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f6bd206a-f5fa-40ca-bb71-acfbe7a1f2e6 tempest-AttachVolumeNegativeTest-1447430610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:18:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f6bd206a-f5fa-40ca-bb71-acfbe7a1f2e6 tempest-AttachVolumeNegativeTest-1447430610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f6bd206a-f5fa-40ca-bb71-acfbe7a1f2e6 tempest-AttachVolumeNegativeTest-1447430610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:42 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-c79b5cc9-9fb7-4310-a0d8-dcea4d6070e3 tempest-VolumesSnapshotTestJSON-434051366 None] Creating offline snapshot 3cd754ed-64cc-490f-942c-007c798ef4c0 of volume 30f9da1d-5f61-4eb7-85d3-4a0f8d9318df {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:18:42 devstack sudo[99402]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:18:42 devstack sudo[99402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:42 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-624a6864-77f1-4576-bcda-3d4a9b3cf9d7 tempest-GroupsTest-1385499384 None] Volume volume-c65ad697-ab85-4cfe-b517-6939d850ea05 (c65ad697-ab85-4cfe-b517-6939d850ea05): created successfully
Nov 04 12:18:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-624a6864-77f1-4576-bcda-3d4a9b3cf9d7 tempest-GroupsTest-1385499384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59d139fb-c612-412c-9e8e-e49ddbff10be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-624a6864-77f1-4576-bcda-3d4a9b3cf9d7 tempest-GroupsTest-1385499384 None] Flow 'volume_create_manager' (b0258617-fd33-418a-b676-4d2c330d3bd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:18:42 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[c024545a-e701-4ca0-b1f0-00589839377c]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:18:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c79b5cc9-9fb7-4310-a0d8-dcea4d6070e3 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:42 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-624a6864-77f1-4576-bcda-3d4a9b3cf9d7 tempest-GroupsTest-1385499384 None] Created volume successfully.
Nov 04 12:18:42 devstack sudo[99404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df
Nov 04 12:18:42 devstack sudo[99404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:42 devstack sudo[99402]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f6bd206a-f5fa-40ca-bb71-acfbe7a1f2e6 tempest-AttachVolumeNegativeTest-1447430610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.264s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:42 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-f6bd206a-f5fa-40ca-bb71-acfbe7a1f2e6 tempest-AttachVolumeNegativeTest-1447430610 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:18:42 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-f6bd206a-f5fa-40ca-bb71-acfbe7a1f2e6 tempest-AttachVolumeNegativeTest-1447430610 None] Deleted volume successfully.
Nov 04 12:18:42 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f6bd206a-f5fa-40ca-bb71-acfbe7a1f2e6 tempest-AttachVolumeNegativeTest-1447430610 None] Lock "cinder-d9b3a6c6-a1a0-41e4-95d2-0a48273d0ab7-delete_volume" released by "delete_volume" :: held 1.328s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:18:42 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9c949e02-d6e4-483f-8ec8-f5aedaa10039 tempest-AttachVolumeNegativeTest-1447430610 None] Acquiring lock "cinder-053ecea3-f1c1-413d-8367-60380535ae67-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:18:42 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9c949e02-d6e4-483f-8ec8-f5aedaa10039 tempest-AttachVolumeNegativeTest-1447430610 None] Lock "cinder-053ecea3-f1c1-413d-8367-60380535ae67-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:18:42 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9c949e02-d6e4-483f-8ec8-f5aedaa10039 tempest-AttachVolumeNegativeTest-1447430610 None] Acquiring lock "cinder-quobyte-053ecea3-f1c1-413d-8367-60380535ae67" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:18:42 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9c949e02-d6e4-483f-8ec8-f5aedaa10039 tempest-AttachVolumeNegativeTest-1447430610 None] Lock "cinder-quobyte-053ecea3-f1c1-413d-8367-60380535ae67" acquired by "delete_volume" :: waited 0.020s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:18:42 devstack sudo[99404]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:42 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-dde66c82-859a-416e-9b73-19faacbda1c8 tempest-GroupsTest-1385499384 None] Update group completed successfully.
Nov 04 12:18:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c79b5cc9-9fb7-4310-a0d8-dcea4d6070e3 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df" returned: 0 in 0.457s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c79b5cc9-9fb7-4310-a0d8-dcea4d6070e3 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df.3cd754ed-64cc-490f-942c-007c798ef4c0 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:42 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33a80b5-95e5-48fb-a657-cfb90e5c7115]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:18:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9c949e02-d6e4-483f-8ec8-f5aedaa10039 tempest-AttachVolumeNegativeTest-1447430610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-053ecea3-f1c1-413d-8367-60380535ae67 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:42 devstack sudo[99410]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df.3cd754ed-64cc-490f-942c-007c798ef4c0 1G
Nov 04 12:18:42 devstack sudo[99410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:43 devstack sudo[99411]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-053ecea3-f1c1-413d-8367-60380535ae67
Nov 04 12:18:43 devstack sudo[99411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:43 devstack sudo[99411]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9c949e02-d6e4-483f-8ec8-f5aedaa10039 tempest-AttachVolumeNegativeTest-1447430610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-053ecea3-f1c1-413d-8367-60380535ae67" returned: 0 in 0.384s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9c949e02-d6e4-483f-8ec8-f5aedaa10039 tempest-AttachVolumeNegativeTest-1447430610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-053ecea3-f1c1-413d-8367-60380535ae67 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:43 devstack sudo[99410]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c79b5cc9-9fb7-4310-a0d8-dcea4d6070e3 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df.3cd754ed-64cc-490f-942c-007c798ef4c0 1G" returned: 0 in 0.410s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c79b5cc9-9fb7-4310-a0d8-dcea4d6070e3 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df.3cd754ed-64cc-490f-942c-007c798ef4c0 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:43 devstack sudo[99420]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-053ecea3-f1c1-413d-8367-60380535ae67
Nov 04 12:18:43 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:43 devstack sudo[99421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df.3cd754ed-64cc-490f-942c-007c798ef4c0
Nov 04 12:18:43 devstack sudo[99421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:43 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9c949e02-d6e4-483f-8ec8-f5aedaa10039 tempest-AttachVolumeNegativeTest-1447430610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-053ecea3-f1c1-413d-8367-60380535ae67" returned: 0 in 0.248s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:43 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9c949e02-d6e4-483f-8ec8-f5aedaa10039 tempest-AttachVolumeNegativeTest-1447430610 None] Lock "cinder-quobyte-053ecea3-f1c1-413d-8367-60380535ae67" released by "delete_volume" :: held 0.681s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:18:43 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-9c949e02-d6e4-483f-8ec8-f5aedaa10039 tempest-AttachVolumeNegativeTest-1447430610 None] Created reservations ['1a0034be-65af-488b-a46a-2caec91fc239', '450c77bd-6da7-4785-85f0-9949ce2c4431', 'aff79bd2-5e68-45ba-b4d8-8486fe358edf', '6abeb6ee-300b-4794-8b32-dd439b4b5aa3'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:18:43 devstack sudo[99421]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c79b5cc9-9fb7-4310-a0d8-dcea4d6070e3 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df.3cd754ed-64cc-490f-942c-007c798ef4c0" returned: 0 in 0.323s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:43 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-c79b5cc9-9fb7-4310-a0d8-dcea4d6070e3 tempest-VolumesSnapshotTestJSON-434051366 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df.3cd754ed-64cc-490f-942c-007c798ef4c0 is being set with open permissions: ugo+rw
Nov 04 12:18:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c79b5cc9-9fb7-4310-a0d8-dcea4d6070e3 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df.3cd754ed-64cc-490f-942c-007c798ef4c0 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:43 devstack sudo[99428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df.3cd754ed-64cc-490f-942c-007c798ef4c0
Nov 04 12:18:43 devstack sudo[99428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-9c949e02-d6e4-483f-8ec8-f5aedaa10039 tempest-AttachVolumeNegativeTest-1447430610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-9c949e02-d6e4-483f-8ec8-f5aedaa10039 tempest-AttachVolumeNegativeTest-1447430610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:43 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-9c949e02-d6e4-483f-8ec8-f5aedaa10039 tempest-AttachVolumeNegativeTest-1447430610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:18:43 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-9c949e02-d6e4-483f-8ec8-f5aedaa10039 tempest-AttachVolumeNegativeTest-1447430610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:18:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-9c949e02-d6e4-483f-8ec8-f5aedaa10039 tempest-AttachVolumeNegativeTest-1447430610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9c949e02-d6e4-483f-8ec8-f5aedaa10039 tempest-AttachVolumeNegativeTest-1447430610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:43 devstack sudo[99430]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:18:43 devstack sudo[99430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:43 devstack sudo[99428]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c79b5cc9-9fb7-4310-a0d8-dcea4d6070e3 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df.3cd754ed-64cc-490f-942c-007c798ef4c0" returned: 0 in 0.269s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c79b5cc9-9fb7-4310-a0d8-dcea4d6070e3 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:43 devstack sudo[99433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df.info
Nov 04 12:18:43 devstack sudo[99433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:44 devstack sudo[99430]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9c949e02-d6e4-483f-8ec8-f5aedaa10039 tempest-AttachVolumeNegativeTest-1447430610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.316s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:44 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-9c949e02-d6e4-483f-8ec8-f5aedaa10039 tempest-AttachVolumeNegativeTest-1447430610 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:18:44 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-9c949e02-d6e4-483f-8ec8-f5aedaa10039 tempest-AttachVolumeNegativeTest-1447430610 None] Deleted volume successfully.
Nov 04 12:18:44 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9c949e02-d6e4-483f-8ec8-f5aedaa10039 tempest-AttachVolumeNegativeTest-1447430610 None] Lock "cinder-053ecea3-f1c1-413d-8367-60380535ae67-delete_volume" released by "delete_volume" :: held 1.295s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:18:44 devstack sudo[99433]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c79b5cc9-9fb7-4310-a0d8-dcea4d6070e3 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df.info" returned: 0 in 0.339s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:44 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-c79b5cc9-9fb7-4310-a0d8-dcea4d6070e3 tempest-VolumesSnapshotTestJSON-434051366 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df.info is being set with open permissions: ugo+rw
Nov 04 12:18:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c79b5cc9-9fb7-4310-a0d8-dcea4d6070e3 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:44 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-d382bd19-a490-484d-a8ab-83586025cab2 tempest-GroupsTest-1385499384 None] Update group completed successfully.
Nov 04 12:18:44 devstack sudo[99437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df.info
Nov 04 12:18:44 devstack sudo[99437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:44 devstack sudo[99437]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c79b5cc9-9fb7-4310-a0d8-dcea4d6070e3 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df.info" returned: 0 in 0.249s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c79b5cc9-9fb7-4310-a0d8-dcea4d6070e3 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.215s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:44 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-c79b5cc9-9fb7-4310-a0d8-dcea4d6070e3 tempest-VolumesSnapshotTestJSON-434051366 None] Create snapshot completed successfully
Nov 04 12:18:45 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5dce99b8-de55-41c7-b355-a2564048108b tempest-VolumesSnapshotTestJSON-434051366 None] Acquiring lock "cinder-3cd754ed-64cc-490f-942c-007c798ef4c0-delete_snapshot" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:18:45 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5dce99b8-de55-41c7-b355-a2564048108b tempest-VolumesSnapshotTestJSON-434051366 None] Lock "cinder-3cd754ed-64cc-490f-942c-007c798ef4c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:18:45 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5dce99b8-de55-41c7-b355-a2564048108b tempest-VolumesSnapshotTestJSON-434051366 None] Acquiring lock "cinder-quobyte-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:18:45 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5dce99b8-de55-41c7-b355-a2564048108b tempest-VolumesSnapshotTestJSON-434051366 None] Lock "cinder-quobyte-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:18:45 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5dce99b8-de55-41c7-b355-a2564048108b tempest-VolumesSnapshotTestJSON-434051366 None] Acquiring lock "cinder-quobyte-3cd754ed-64cc-490f-942c-007c798ef4c0" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:18:45 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5dce99b8-de55-41c7-b355-a2564048108b tempest-VolumesSnapshotTestJSON-434051366 None] Lock "cinder-quobyte-3cd754ed-64cc-490f-942c-007c798ef4c0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:18:45 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-5dce99b8-de55-41c7-b355-a2564048108b tempest-VolumesSnapshotTestJSON-434051366 None] Deleting offline snapshot 3cd754ed-64cc-490f-942c-007c798ef4c0 of volume 30f9da1d-5f61-4eb7-85d3-4a0f8d9318df {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:18:45 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-5dce99b8-de55-41c7-b355-a2564048108b tempest-VolumesSnapshotTestJSON-434051366 None] snapshot_file for this snap is: volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df.3cd754ed-64cc-490f-942c-007c798ef4c0 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:18:45 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[940e53be-55f7-4b67-9e89-03638c31b2e8]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:18:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5dce99b8-de55-41c7-b355-a2564048108b tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df.3cd754ed-64cc-490f-942c-007c798ef4c0 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:45 devstack sudo[99440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df.3cd754ed-64cc-490f-942c-007c798ef4c0
Nov 04 12:18:45 devstack sudo[99440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:45 devstack sudo[99440]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5dce99b8-de55-41c7-b355-a2564048108b tempest-VolumesSnapshotTestJSON-434051366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df.3cd754ed-64cc-490f-942c-007c798ef4c0" returned: 0 in 0.451s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:45 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-5dce99b8-de55-41c7-b355-a2564048108b tempest-VolumesSnapshotTestJSON-434051366 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:18:45 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[26a1f34c-04fe-4a9d-8500-21044f7b63e8]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:18:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5dce99b8-de55-41c7-b355-a2564048108b tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:45 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-cd8b8a27-dd6b-41b7-8f21-a71d73a886e3 tempest-GroupsTest-1385499384 None] Acquiring lock "cinder-quobyte-6144a75a-e6cd-40a0-a6df-219c9a6b7a17" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:18:46 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-cd8b8a27-dd6b-41b7-8f21-a71d73a886e3 tempest-GroupsTest-1385499384 None] Lock "cinder-quobyte-6144a75a-e6cd-40a0-a6df-219c9a6b7a17" acquired by "delete_volume" :: waited 0.022s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:18:46 devstack sudo[99446]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df
Nov 04 12:18:46 devstack sudo[99446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:46 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[288f2954-97d0-44e3-b020-9bb4715d0377]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:18:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-cd8b8a27-dd6b-41b7-8f21-a71d73a886e3 tempest-GroupsTest-1385499384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6144a75a-e6cd-40a0-a6df-219c9a6b7a17 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:46 devstack sudo[99448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6144a75a-e6cd-40a0-a6df-219c9a6b7a17
Nov 04 12:18:46 devstack sudo[99448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:46 devstack sudo[99446]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5dce99b8-de55-41c7-b355-a2564048108b tempest-VolumesSnapshotTestJSON-434051366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df" returned: 0 in 0.405s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5dce99b8-de55-41c7-b355-a2564048108b tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df.3cd754ed-64cc-490f-942c-007c798ef4c0 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:46 devstack sudo[99453]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df.3cd754ed-64cc-490f-942c-007c798ef4c0
Nov 04 12:18:46 devstack sudo[99453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:46 devstack sudo[99448]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-cd8b8a27-dd6b-41b7-8f21-a71d73a886e3 tempest-GroupsTest-1385499384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6144a75a-e6cd-40a0-a6df-219c9a6b7a17" returned: 0 in 0.450s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-cd8b8a27-dd6b-41b7-8f21-a71d73a886e3 tempest-GroupsTest-1385499384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6144a75a-e6cd-40a0-a6df-219c9a6b7a17 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:46 devstack sudo[99458]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6144a75a-e6cd-40a0-a6df-219c9a6b7a17
Nov 04 12:18:46 devstack sudo[99458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:46 devstack sudo[99453]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5dce99b8-de55-41c7-b355-a2564048108b tempest-VolumesSnapshotTestJSON-434051366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df.3cd754ed-64cc-490f-942c-007c798ef4c0" returned: 0 in 0.407s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5dce99b8-de55-41c7-b355-a2564048108b tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df.3cd754ed-64cc-490f-942c-007c798ef4c0 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:46 devstack sudo[99464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df.3cd754ed-64cc-490f-942c-007c798ef4c0
Nov 04 12:18:46 devstack sudo[99464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:46 devstack sudo[99458]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-cd8b8a27-dd6b-41b7-8f21-a71d73a886e3 tempest-GroupsTest-1385499384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6144a75a-e6cd-40a0-a6df-219c9a6b7a17" returned: 0 in 0.309s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:46 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-cd8b8a27-dd6b-41b7-8f21-a71d73a886e3 tempest-GroupsTest-1385499384 None] Lock "cinder-quobyte-6144a75a-e6cd-40a0-a6df-219c9a6b7a17" released by "delete_volume" :: held 0.812s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:18:46 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-cd8b8a27-dd6b-41b7-8f21-a71d73a886e3 tempest-GroupsTest-1385499384 None] Acquiring lock "cinder-quobyte-c65ad697-ab85-4cfe-b517-6939d850ea05" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:18:46 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-cd8b8a27-dd6b-41b7-8f21-a71d73a886e3 tempest-GroupsTest-1385499384 None] Lock "cinder-quobyte-c65ad697-ab85-4cfe-b517-6939d850ea05" acquired by "delete_volume" :: waited 0.018s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:18:46 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dff1d6d-e604-4ff7-a169-925391f2d7ec]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:18:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-cd8b8a27-dd6b-41b7-8f21-a71d73a886e3 tempest-GroupsTest-1385499384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c65ad697-ab85-4cfe-b517-6939d850ea05 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:46 devstack sudo[99467]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c65ad697-ab85-4cfe-b517-6939d850ea05
Nov 04 12:18:46 devstack sudo[99467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:46 devstack sudo[99464]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5dce99b8-de55-41c7-b355-a2564048108b tempest-VolumesSnapshotTestJSON-434051366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df.3cd754ed-64cc-490f-942c-007c798ef4c0" returned: 0 in 0.276s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:47 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5dce99b8-de55-41c7-b355-a2564048108b tempest-VolumesSnapshotTestJSON-434051366 None] Lock "cinder-quobyte-3cd754ed-64cc-490f-942c-007c798ef4c0" released by "_delete_snapshot" :: held 1.685s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:18:47 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5dce99b8-de55-41c7-b355-a2564048108b tempest-VolumesSnapshotTestJSON-434051366 None] Lock "cinder-quobyte-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df" released by "delete_snapshot" :: held 1.710s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:18:47 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-5dce99b8-de55-41c7-b355-a2564048108b tempest-VolumesSnapshotTestJSON-434051366 None] Created reservations ['4ea17531-e564-469a-93ed-e50040bfa42f', '7030d03b-1c9a-4791-92bd-c08fc03bea19', '968704cc-d5e1-4069-bed1-98e4b50e439d', '6e48b523-eed6-462a-bf6d-557e3356f73f'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:18:47 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-5dce99b8-de55-41c7-b355-a2564048108b tempest-VolumesSnapshotTestJSON-434051366 None] Delete snapshot completed successfully.
Nov 04 12:18:47 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5dce99b8-de55-41c7-b355-a2564048108b tempest-VolumesSnapshotTestJSON-434051366 None] Lock "cinder-3cd754ed-64cc-490f-942c-007c798ef4c0-delete_snapshot" released by "delete_snapshot" :: held 1.902s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:18:47 devstack sudo[99467]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-cd8b8a27-dd6b-41b7-8f21-a71d73a886e3 tempest-GroupsTest-1385499384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c65ad697-ab85-4cfe-b517-6939d850ea05" returned: 0 in 0.369s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-cd8b8a27-dd6b-41b7-8f21-a71d73a886e3 tempest-GroupsTest-1385499384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c65ad697-ab85-4cfe-b517-6939d850ea05 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:47 devstack sudo[99473]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c65ad697-ab85-4cfe-b517-6939d850ea05
Nov 04 12:18:47 devstack sudo[99473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:47 devstack sudo[99473]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-cd8b8a27-dd6b-41b7-8f21-a71d73a886e3 tempest-GroupsTest-1385499384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c65ad697-ab85-4cfe-b517-6939d850ea05" returned: 0 in 0.266s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:47 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-cd8b8a27-dd6b-41b7-8f21-a71d73a886e3 tempest-GroupsTest-1385499384 None] Lock "cinder-quobyte-c65ad697-ab85-4cfe-b517-6939d850ea05" released by "delete_volume" :: held 0.696s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:18:47 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-cd8b8a27-dd6b-41b7-8f21-a71d73a886e3 tempest-GroupsTest-1385499384 None] Created reservations ['9c8d51b2-c30c-4f23-a475-6960fc55d381'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:18:47 devstack cinder-volume[87169]: WARNING cinder.quota [None req-cd8b8a27-dd6b-41b7-8f21-a71d73a886e3 tempest-GroupsTest-1385499384 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1597355731 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1597355731, it is now deprecated. Please use the default quota class for default quota.
Nov 04 12:18:47 devstack cinder-volume[87169]: WARNING cinder.quota [None req-cd8b8a27-dd6b-41b7-8f21-a71d73a886e3 tempest-GroupsTest-1385499384 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1597355731 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1597355731, it is now deprecated. Please use the default quota class for default quota.
Nov 04 12:18:47 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-cd8b8a27-dd6b-41b7-8f21-a71d73a886e3 tempest-GroupsTest-1385499384 None] Created reservations ['8693853e-1a88-4b34-bc78-c4bbbc4be957', 'b5ee7be8-1212-49f5-9395-6cec04f2a525', '2069323e-1f58-4d53-997b-4e8defe9c997', '7df95deb-43ab-4223-abbf-0ee8817995cf'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:18:47 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-cd8b8a27-dd6b-41b7-8f21-a71d73a886e3 tempest-GroupsTest-1385499384 None] Created reservations ['393cbfc5-8bca-409d-8b26-cf37fe0b1830', '11fe87bb-e5c1-4392-b607-913a9a40017e', '3b995ec3-2b2b-40bb-8014-8169566ca581', 'b3ac977f-dbdf-48b4-ba44-e45283f056d6'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:18:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-cd8b8a27-dd6b-41b7-8f21-a71d73a886e3 tempest-GroupsTest-1385499384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-cd8b8a27-dd6b-41b7-8f21-a71d73a886e3 tempest-GroupsTest-1385499384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:47 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-cd8b8a27-dd6b-41b7-8f21-a71d73a886e3 tempest-GroupsTest-1385499384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:18:47 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-cd8b8a27-dd6b-41b7-8f21-a71d73a886e3 tempest-GroupsTest-1385499384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:18:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-cd8b8a27-dd6b-41b7-8f21-a71d73a886e3 tempest-GroupsTest-1385499384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-cd8b8a27-dd6b-41b7-8f21-a71d73a886e3 tempest-GroupsTest-1385499384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:48 devstack sudo[99476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:18:48 devstack sudo[99476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:48 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-3fa2d6e3-766f-4287-80d6-3778aa499ca0 tempest-VolumesSnapshotTestJSON-434051366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:18:48 devstack sudo[99476]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:48 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3fa2d6e3-766f-4287-80d6-3778aa499ca0 tempest-VolumesSnapshotTestJSON-434051366 None] Flow 'volume_create_manager' (fa9f9d6e-21c4-42f0-8d3c-a5237d1235c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:18:48 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3fa2d6e3-766f-4287-80d6-3778aa499ca0 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d917ed-51b8-4ad0-bb10-1bf18a1f22c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-cd8b8a27-dd6b-41b7-8f21-a71d73a886e3 tempest-GroupsTest-1385499384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.301s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:48 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-cd8b8a27-dd6b-41b7-8f21-a71d73a886e3 tempest-GroupsTest-1385499384 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:18:48 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-cd8b8a27-dd6b-41b7-8f21-a71d73a886e3 tempest-GroupsTest-1385499384 None] Delete group completed successfully.
Nov 04 12:18:48 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3fa2d6e3-766f-4287-80d6-3778aa499ca0 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d917ed-51b8-4ad0-bb10-1bf18a1f22c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-407186177',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6da3bee0-4468-48d3-b3e6-7029239d873d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ca15df84b5a40ef9bab2894e931f47a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:18:48Z,use_quota=True,user_id='6da3b5f34fc64db69b23ab368664ba14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:48 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3fa2d6e3-766f-4287-80d6-3778aa499ca0 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76c596c6-5bf6-4c0b-bcb4-e5b2c4b9c50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:48 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3fa2d6e3-766f-4287-80d6-3778aa499ca0 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76c596c6-5bf6-4c0b-bcb4-e5b2c4b9c50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:48 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3fa2d6e3-766f-4287-80d6-3778aa499ca0 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f65431a-7004-4559-9067-6b321db02d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:48 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3fa2d6e3-766f-4287-80d6-3778aa499ca0 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f65431a-7004-4559-9067-6b321db02d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6da3bee0-4468-48d3-b3e6-7029239d873d', 'volume_name': 'volume-6da3bee0-4468-48d3-b3e6-7029239d873d', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:48 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3fa2d6e3-766f-4287-80d6-3778aa499ca0 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a3246b7-10b5-46a4-96f9-77c663a770db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:48 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3fa2d6e3-766f-4287-80d6-3778aa499ca0 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a3246b7-10b5-46a4-96f9-77c663a770db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:48 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3fa2d6e3-766f-4287-80d6-3778aa499ca0 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (820e6ddf-76bb-4e27-9706-841951b6f8f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:48 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-3fa2d6e3-766f-4287-80d6-3778aa499ca0 tempest-VolumesSnapshotTestJSON-434051366 None] Volume 6da3bee0-4468-48d3-b3e6-7029239d873d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6da3bee0-4468-48d3-b3e6-7029239d873d', 'volume_size': 1}
Nov 04 12:18:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3fa2d6e3-766f-4287-80d6-3778aa499ca0 tempest-VolumesSnapshotTestJSON-434051366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3fa2d6e3-766f-4287-80d6-3778aa499ca0 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:48 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3fa2d6e3-766f-4287-80d6-3778aa499ca0 tempest-VolumesSnapshotTestJSON-434051366 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:18:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-407186177',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6da3bee0-4468-48d3-b3e6-7029239d873d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ca15df84b5a40ef9bab2894e931f47a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:18:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:18:48Z,use_quota=True,user_id='6da3b5f34fc64db69b23ab368664ba14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:18:48 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-3fa2d6e3-766f-4287-80d6-3778aa499ca0 tempest-VolumesSnapshotTestJSON-434051366 None] Creating volume 6da3bee0-4468-48d3-b3e6-7029239d873d {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:18:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3fa2d6e3-766f-4287-80d6-3778aa499ca0 tempest-VolumesSnapshotTestJSON-434051366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3fa2d6e3-766f-4287-80d6-3778aa499ca0 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:48 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3fa2d6e3-766f-4287-80d6-3778aa499ca0 tempest-VolumesSnapshotTestJSON-434051366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:18:48 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3fa2d6e3-766f-4287-80d6-3778aa499ca0 tempest-VolumesSnapshotTestJSON-434051366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:18:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3fa2d6e3-766f-4287-80d6-3778aa499ca0 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:48 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3fa2d6e3-766f-4287-80d6-3778aa499ca0 tempest-VolumesSnapshotTestJSON-434051366 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:18:48 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-3fa2d6e3-766f-4287-80d6-3778aa499ca0 tempest-VolumesSnapshotTestJSON-434051366 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:18:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3fa2d6e3-766f-4287-80d6-3778aa499ca0 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:48 devstack sudo[99479]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d 1073741824
Nov 04 12:18:48 devstack sudo[99479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:48 devstack sudo[99479]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3fa2d6e3-766f-4287-80d6-3778aa499ca0 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d 1073741824" returned: 0 in 0.590s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3fa2d6e3-766f-4287-80d6-3778aa499ca0 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:49 devstack sudo[99486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d
Nov 04 12:18:49 devstack sudo[99486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:49 devstack sudo[99486]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3fa2d6e3-766f-4287-80d6-3778aa499ca0 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d" returned: 0 in 0.284s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3fa2d6e3-766f-4287-80d6-3778aa499ca0 tempest-VolumesSnapshotTestJSON-434051366 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:18:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3fa2d6e3-766f-4287-80d6-3778aa499ca0 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:49 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3fa2d6e3-766f-4287-80d6-3778aa499ca0 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (820e6ddf-76bb-4e27-9706-841951b6f8f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6da3bee0-4468-48d3-b3e6-7029239d873d', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:49 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3fa2d6e3-766f-4287-80d6-3778aa499ca0 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1ee7a3f-4a6f-4dda-aea1-52ce1aaeaed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:49 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-3fa2d6e3-766f-4287-80d6-3778aa499ca0 tempest-VolumesSnapshotTestJSON-434051366 None] Volume volume-6da3bee0-4468-48d3-b3e6-7029239d873d (6da3bee0-4468-48d3-b3e6-7029239d873d): created successfully
Nov 04 12:18:49 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3fa2d6e3-766f-4287-80d6-3778aa499ca0 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1ee7a3f-4a6f-4dda-aea1-52ce1aaeaed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:49 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3fa2d6e3-766f-4287-80d6-3778aa499ca0 tempest-VolumesSnapshotTestJSON-434051366 None] Flow 'volume_create_manager' (fa9f9d6e-21c4-42f0-8d3c-a5237d1235c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:18:49 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-3fa2d6e3-766f-4287-80d6-3778aa499ca0 tempest-VolumesSnapshotTestJSON-434051366 None] Created volume successfully.
Nov 04 12:18:49 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:18:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:18:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:18:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:49 devstack sudo[99489]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:18:49 devstack sudo[99489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:50 devstack sudo[99489]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.280s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:50 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:18:50 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager._thread_info {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:18:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread count: 28 {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 12:18:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread info: [<_MainThread(MainThread, started 137165867425920)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137165754678912)>, <Thread(Thread-3 (stat_writer), started daemon 137165754130752)>, <Thread(Rabbit-heartbeat, started daemon 137165752997504)>, <Thread(Thread-5 (_runner), started daemon 137165753227712)>, <Thread(Thread-7 (_runner), started daemon 137165751273856)>, <Thread(fd_logger, started daemon 137165755322048)>, <Thread(privsep_reader, started daemon 137165748896704)>, <Thread(tpool_thread_0, started daemon 137165742520000)>, <Thread(tpool_thread_1, started daemon 137165734127296)>, <Thread(tpool_thread_2, started daemon 137165725734592)>, <Thread(tpool_thread_3, started daemon 137165717341888)>, <Thread(tpool_thread_4, started daemon 137165708949184)>, <Thread(tpool_thread_5, started daemon 137165700556480)>, <Thread(tpool_thread_6, started daemon 137165692163776)>, <Thread(tpool_thread_7, started daemon 137165683771072)>, <Thread(tpool_thread_8, started daemon 137165675378368)>, <Thread(tpool_thread_9, started daemon 137165666985664)>, <Thread(tpool_thread_10, started daemon 137165658592960)>, <Thread(tpool_thread_11, started daemon 137165650183872)>, <Thread(tpool_thread_12, started daemon 137165641774784)>, <Thread(tpool_thread_13, started daemon 137165633365696)>, <Thread(tpool_thread_14, started daemon 137165624956608)>, <Thread(tpool_thread_15, started daemon 137165616547520)>, <Thread(tpool_thread_16, started daemon 137165608138432)>, <Thread(tpool_thread_17, started daemon 137165599729344)>, <Thread(tpool_thread_18, started daemon 137165591320256)>, <Thread(tpool_thread_19, started daemon 137165582911168)>] {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 12:18:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-507b329f-ffce-40e9-a39c-5c121f1479f9 tempest-VolumesSnapshotTestJSON-434051366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-507b329f-ffce-40e9-a39c-5c121f1479f9 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:50 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-507b329f-ffce-40e9-a39c-5c121f1479f9 tempest-VolumesSnapshotTestJSON-434051366 None] Creating offline snapshot 38c1fdc9-af77-4637-8ef3-4a47ff9c6cb4 of volume 6da3bee0-4468-48d3-b3e6-7029239d873d {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:18:50 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[590f667f-3f51-46a0-86c9-0b5c0b2bf4b9]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:18:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-507b329f-ffce-40e9-a39c-5c121f1479f9 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:50 devstack sudo[99492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d
Nov 04 12:18:50 devstack sudo[99492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:50 devstack sudo[99492]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-507b329f-ffce-40e9-a39c-5c121f1479f9 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d" returned: 0 in 0.424s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-507b329f-ffce-40e9-a39c-5c121f1479f9 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d.38c1fdc9-af77-4637-8ef3-4a47ff9c6cb4 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:51 devstack sudo[99498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d.38c1fdc9-af77-4637-8ef3-4a47ff9c6cb4 1G
Nov 04 12:18:51 devstack sudo[99498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:51 devstack sudo[99498]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-507b329f-ffce-40e9-a39c-5c121f1479f9 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d.38c1fdc9-af77-4637-8ef3-4a47ff9c6cb4 1G" returned: 0 in 0.500s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-507b329f-ffce-40e9-a39c-5c121f1479f9 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6da3bee0-4468-48d3-b3e6-7029239d873d -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d.38c1fdc9-af77-4637-8ef3-4a47ff9c6cb4 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:51 devstack sudo[99504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6da3bee0-4468-48d3-b3e6-7029239d873d -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d.38c1fdc9-af77-4637-8ef3-4a47ff9c6cb4
Nov 04 12:18:51 devstack sudo[99504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:51 devstack sudo[99504]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-507b329f-ffce-40e9-a39c-5c121f1479f9 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6da3bee0-4468-48d3-b3e6-7029239d873d -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d.38c1fdc9-af77-4637-8ef3-4a47ff9c6cb4" returned: 0 in 0.347s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:51 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-507b329f-ffce-40e9-a39c-5c121f1479f9 tempest-VolumesSnapshotTestJSON-434051366 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d.38c1fdc9-af77-4637-8ef3-4a47ff9c6cb4 is being set with open permissions: ugo+rw
Nov 04 12:18:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-507b329f-ffce-40e9-a39c-5c121f1479f9 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d.38c1fdc9-af77-4637-8ef3-4a47ff9c6cb4 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:51 devstack sudo[99510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d.38c1fdc9-af77-4637-8ef3-4a47ff9c6cb4
Nov 04 12:18:51 devstack sudo[99510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:52 devstack sudo[99510]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-507b329f-ffce-40e9-a39c-5c121f1479f9 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d.38c1fdc9-af77-4637-8ef3-4a47ff9c6cb4" returned: 0 in 0.272s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-507b329f-ffce-40e9-a39c-5c121f1479f9 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:52 devstack sudo[99513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d.info
Nov 04 12:18:52 devstack sudo[99513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:52 devstack sudo[99513]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-507b329f-ffce-40e9-a39c-5c121f1479f9 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d.info" returned: 0 in 0.305s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:52 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-507b329f-ffce-40e9-a39c-5c121f1479f9 tempest-VolumesSnapshotTestJSON-434051366 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d.info is being set with open permissions: ugo+rw
Nov 04 12:18:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-507b329f-ffce-40e9-a39c-5c121f1479f9 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:52 devstack sudo[99516]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d.info
Nov 04 12:18:52 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:52 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-507b329f-ffce-40e9-a39c-5c121f1479f9 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d.info" returned: 0 in 0.292s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-507b329f-ffce-40e9-a39c-5c121f1479f9 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.254s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:52 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-507b329f-ffce-40e9-a39c-5c121f1479f9 tempest-VolumesSnapshotTestJSON-434051366 None] Create snapshot completed successfully
Nov 04 12:18:53 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-7c952ed3-e74f-4b43-a024-b5005211b607 tempest-GroupSnapshotsV319Test-550762948 None] Group tempest-GroupSnapshotsV319Test-Group-1560068336: creating
Nov 04 12:18:53 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-7c952ed3-e74f-4b43-a024-b5005211b607 tempest-GroupSnapshotsV319Test-550762948 None] Group tempest-GroupSnapshotsV319Test-Group-1560068336: created successfully
Nov 04 12:18:53 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-7c952ed3-e74f-4b43-a024-b5005211b607 tempest-GroupSnapshotsV319Test-550762948 None] Create group completed successfully.
Nov 04 12:18:54 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:18:54 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Flow 'volume_create_manager' (add48d13-ff7b-4605-afad-2c67cd07b21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:18:54 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e404a74e-7fa6-44d2-ae5c-e01b3cad6ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:54 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e404a74e-7fa6-44d2-ae5c-e01b3cad6ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:18:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1675100496',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d21b6938-a26b-48e1-abe9-1f6ebbe8bdd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ca15df84b5a40ef9bab2894e931f47a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:18:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=38c1fdc9-af77-4637-8ef3-4a47ff9c6cb4,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:18:54Z,use_quota=True,user_id='6da3b5f34fc64db69b23ab368664ba14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:54 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84dd6b33-1a5d-49c8-b8dc-e49dbb9d3643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:54 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84dd6b33-1a5d-49c8-b8dc-e49dbb9d3643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:54 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2daa1021-bd94-4018-ba4a-d8e8f5eafa92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:54 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2daa1021-bd94-4018-ba4a-d8e8f5eafa92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd21b6938-a26b-48e1-abe9-1f6ebbe8bdd1', 'volume_name': 'volume-d21b6938-a26b-48e1-abe9-1f6ebbe8bdd1', 'volume_size': 2, 'snapshot_id': '38c1fdc9-af77-4637-8ef3-4a47ff9c6cb4'}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:54 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4cca05c-39d0-4705-8842-00bfcbe58f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:54 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4cca05c-39d0-4705-8842-00bfcbe58f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:54 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0525babb-220d-4cfc-8c0e-9dacbac34d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:54 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Volume d21b6938-a26b-48e1-abe9-1f6ebbe8bdd1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d21b6938-a26b-48e1-abe9-1f6ebbe8bdd1', 'volume_size': 2, 'snapshot_id': '38c1fdc9-af77-4637-8ef3-4a47ff9c6cb4'}
Nov 04 12:18:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:54 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Acquiring lock "cinder-quobyte-38c1fdc9-af77-4637-8ef3-4a47ff9c6cb4-d21b6938-a26b-48e1-abe9-1f6ebbe8bdd1" by "_create_volume_from_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:18:54 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "cinder-quobyte-38c1fdc9-af77-4637-8ef3-4a47ff9c6cb4-d21b6938-a26b-48e1-abe9-1f6ebbe8bdd1" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:18:54 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Creating volume d21b6938-a26b-48e1-abe9-1f6ebbe8bdd1 from snapshot 38c1fdc9-af77-4637-8ef3-4a47ff9c6cb4 {{(pid=87169) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 04 12:18:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:54 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:18:54 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:18:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:54 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:18:54 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Acquiring lock "cinder-quobyte-d21b6938-a26b-48e1-abe9-1f6ebbe8bdd1" by "_copy_volume_from_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:18:54 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "cinder-quobyte-d21b6938-a26b-48e1-abe9-1f6ebbe8bdd1" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:18:54 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] snapshot: 38c1fdc9-af77-4637-8ef3-4a47ff9c6cb4, volume: d21b6938-a26b-48e1-abe9-1f6ebbe8bdd1,  {{(pid=87169) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 04 12:18:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:18:54 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:18:54 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:18:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:18:54 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e8e8a4-9df6-45b3-aa85-d3f16afa79d8]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:18:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d.38c1fdc9-af77-4637-8ef3-4a47ff9c6cb4 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:54 devstack sudo[99520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d.38c1fdc9-af77-4637-8ef3-4a47ff9c6cb4
Nov 04 12:18:54 devstack sudo[99520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:54 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-8931f5dd-0633-4207-8d15-0d98e16e9001 tempest-GroupSnapshotsV319Test-550762948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:18:54 devstack sudo[99520]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:54 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8931f5dd-0633-4207-8d15-0d98e16e9001 tempest-GroupSnapshotsV319Test-550762948 None] Flow 'volume_create_manager' (f200f183-ed61-44ca-b813-efd25a2d4c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:18:54 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8931f5dd-0633-4207-8d15-0d98e16e9001 tempest-GroupSnapshotsV319Test-550762948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a8126a3-90bd-40f6-992b-17ad0d1281ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d.38c1fdc9-af77-4637-8ef3-4a47ff9c6cb4" returned: 0 in 0.522s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:54 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6da3bee0-4468-48d3-b3e6-7029239d873d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:18:54 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8931f5dd-0633-4207-8d15-0d98e16e9001 tempest-GroupSnapshotsV319Test-550762948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a8126a3-90bd-40f6-992b-17ad0d1281ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1763954858',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f6f74e7c-e456-41f6-a675-d5727bc28958,host='devstack@QuobyteHD#QuobyteHD',id=65108e54-1ffb-4ef3-95c5-cfc506b7b676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67f2bff3a9cc4960af16264b3203081b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:18:55Z,use_quota=True,user_id='6b1be33368b544c6999a8a9d3f3cb907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dcc0c31-5988-49b0-ac91-3b69b9bb2321),volume_type_id=6dcc0c31-5988-49b0-ac91-3b69b9bb2321)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:54 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8931f5dd-0633-4207-8d15-0d98e16e9001 tempest-GroupSnapshotsV319Test-550762948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29ea4720-3d13-4fc9-8b75-30c895cc482c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:55 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8931f5dd-0633-4207-8d15-0d98e16e9001 tempest-GroupSnapshotsV319Test-550762948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29ea4720-3d13-4fc9-8b75-30c895cc482c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:55 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8931f5dd-0633-4207-8d15-0d98e16e9001 tempest-GroupSnapshotsV319Test-550762948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5feaabcb-0dd7-445c-b6fc-7bbab6490a21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:55 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8931f5dd-0633-4207-8d15-0d98e16e9001 tempest-GroupSnapshotsV319Test-550762948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5feaabcb-0dd7-445c-b6fc-7bbab6490a21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65108e54-1ffb-4ef3-95c5-cfc506b7b676', 'volume_name': 'volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:55 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8931f5dd-0633-4207-8d15-0d98e16e9001 tempest-GroupSnapshotsV319Test-550762948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93894eff-381b-4d91-9354-7a7e69007a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:55 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8931f5dd-0633-4207-8d15-0d98e16e9001 tempest-GroupSnapshotsV319Test-550762948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93894eff-381b-4d91-9354-7a7e69007a63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:55 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8931f5dd-0633-4207-8d15-0d98e16e9001 tempest-GroupSnapshotsV319Test-550762948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df0d0854-9056-4384-bb4a-379f3a4731ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:55 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-8931f5dd-0633-4207-8d15-0d98e16e9001 tempest-GroupSnapshotsV319Test-550762948 None] Volume 65108e54-1ffb-4ef3-95c5-cfc506b7b676: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676', 'volume_size': 1}
Nov 04 12:18:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8931f5dd-0633-4207-8d15-0d98e16e9001 tempest-GroupSnapshotsV319Test-550762948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:18:55 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[e027b2f7-9288-4420-a5ef-541446dd7377]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:18:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:55 devstack sudo[99525]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d
Nov 04 12:18:55 devstack sudo[99525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:55 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-ea1ef58d-be02-4520-9302-37f6111353e1 tempest-GroupsV314Test-1176320581 None] Group tempest-GroupsV314Test-Group-726778579: creating
Nov 04 12:18:55 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-ea1ef58d-be02-4520-9302-37f6111353e1 tempest-GroupsV314Test-1176320581 None] Group tempest-GroupsV314Test-Group-726778579: created successfully
Nov 04 12:18:55 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-ea1ef58d-be02-4520-9302-37f6111353e1 tempest-GroupsV314Test-1176320581 None] Create group completed successfully.
Nov 04 12:18:55 devstack sudo[99525]: pam_unix(sudo:session): session closed for user root
Nov 04 12:18:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d" returned: 0 in 0.373s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:18:55 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d {{(pid=87169) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 04 12:18:55 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Creating direct copy from snapshot {{(pid=87169) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 04 12:18:55 devstack cinder-volume[87169]: DEBUG cinder.utils [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Path /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d21b6938-a26b-48e1-abe9-1f6ebbe8bdd1 not found in is_blk_device check {{(pid=87169) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 04 12:18:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d21b6938-a26b-48e1-abe9-1f6ebbe8bdd1 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:18:55 devstack sudo[99530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d21b6938-a26b-48e1-abe9-1f6ebbe8bdd1
Nov 04 12:18:55 devstack sudo[99530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:18:57 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7840691-4aa3-4307-abc2-80951cf25018 tempest-GroupsV314Test-1176320581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:18:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e7840691-4aa3-4307-abc2-80951cf25018 tempest-GroupsV314Test-1176320581 None] Flow 'volume_create_manager' (84ae2c93-fca7-4197-82bc-77c7288f7c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:18:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e7840691-4aa3-4307-abc2-80951cf25018 tempest-GroupsV314Test-1176320581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22ff20e5-1f09-4750-8e03-6ec8d17bd494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e7840691-4aa3-4307-abc2-80951cf25018 tempest-GroupsV314Test-1176320581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22ff20e5-1f09-4750-8e03-6ec8d17bd494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:18:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2095450713',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1ac0ba05-7434-4f13-8e29-40271eb81d0e,host='devstack@QuobyteHD#QuobyteHD',id=ebc9d34e-6368-4236-9384-74c16b4112bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27fd5bcb3b80441fa087994d78927038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:18:57Z,use_quota=True,user_id='f9e4d782758c483f84816fb37c18d95f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(439d3185-14c5-4a39-855a-57ccae79e661),volume_type_id=439d3185-14c5-4a39-855a-57ccae79e661)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e7840691-4aa3-4307-abc2-80951cf25018 tempest-GroupsV314Test-1176320581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20d52716-2db8-4525-a017-6c57c85bc797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e7840691-4aa3-4307-abc2-80951cf25018 tempest-GroupsV314Test-1176320581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20d52716-2db8-4525-a017-6c57c85bc797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e7840691-4aa3-4307-abc2-80951cf25018 tempest-GroupsV314Test-1176320581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc64a0ef-94d0-46a7-aacc-64eea1f1673a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e7840691-4aa3-4307-abc2-80951cf25018 tempest-GroupsV314Test-1176320581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc64a0ef-94d0-46a7-aacc-64eea1f1673a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebc9d34e-6368-4236-9384-74c16b4112bf', 'volume_name': 'volume-ebc9d34e-6368-4236-9384-74c16b4112bf', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e7840691-4aa3-4307-abc2-80951cf25018 tempest-GroupsV314Test-1176320581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66bda809-754d-4553-84b4-3771d78b65dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e7840691-4aa3-4307-abc2-80951cf25018 tempest-GroupsV314Test-1176320581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66bda809-754d-4553-84b4-3771d78b65dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:18:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e7840691-4aa3-4307-abc2-80951cf25018 tempest-GroupsV314Test-1176320581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (912d004f-6b98-4320-9e76-9c0defce1f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:18:57 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-e7840691-4aa3-4307-abc2-80951cf25018 tempest-GroupsV314Test-1176320581 None] Volume ebc9d34e-6368-4236-9384-74c16b4112bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebc9d34e-6368-4236-9384-74c16b4112bf', 'volume_size': 1}
Nov 04 12:18:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e7840691-4aa3-4307-abc2-80951cf25018 tempest-GroupsV314Test-1176320581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:19:01 devstack sudo[99530]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d21b6938-a26b-48e1-abe9-1f6ebbe8bdd1" returned: 0 in 6.472s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:01 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Image conversion details: src /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d, size 1024.00 MB, duration 6.47 sec, destination /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d21b6938-a26b-48e1-abe9-1f6ebbe8bdd1 {{(pid=87169) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 12:19:01 devstack cinder-volume[87169]: INFO cinder.image.image_utils [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Converted 1024.00 MB image at 158.19 MB/s
Nov 04 12:19:01 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d21b6938-a26b-48e1-abe9-1f6ebbe8bdd1 is being set with open permissions: ugo+rw
Nov 04 12:19:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d21b6938-a26b-48e1-abe9-1f6ebbe8bdd1 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:01 devstack sudo[99548]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d21b6938-a26b-48e1-abe9-1f6ebbe8bdd1
Nov 04 12:19:01 devstack sudo[99548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:02 devstack sudo[99548]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d21b6938-a26b-48e1-abe9-1f6ebbe8bdd1" returned: 0 in 0.237s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:02 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "cinder-quobyte-d21b6938-a26b-48e1-abe9-1f6ebbe8bdd1" released by "_copy_volume_from_snapshot" :: held 7.747s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:19:02 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "cinder-quobyte-38c1fdc9-af77-4637-8ef3-4a47ff9c6cb4-d21b6938-a26b-48e1-abe9-1f6ebbe8bdd1" released by "_create_volume_from_snapshot" :: held 7.815s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:19:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.831s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:19:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8931f5dd-0633-4207-8d15-0d98e16e9001 tempest-GroupSnapshotsV319Test-550762948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.141s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:19:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-8931f5dd-0633-4207-8d15-0d98e16e9001 tempest-GroupSnapshotsV319Test-550762948 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=f6f74e7c-e456-41f6-a675-d5727bc28958,created_at=2026-11-04T11:18:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1763954858',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=f6f74e7c-e456-41f6-a675-d5727bc28958,host='devstack@QuobyteHD#QuobyteHD',id=65108e54-1ffb-4ef3-95c5-cfc506b7b676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67f2bff3a9cc4960af16264b3203081b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:18:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:18:55Z,use_quota=True,user_id='6b1be33368b544c6999a8a9d3f3cb907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6dcc0c31-5988-49b0-ac91-3b69b9bb2321),volume_type_id=6dcc0c31-5988-49b0-ac91-3b69b9bb2321)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:19:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-8931f5dd-0633-4207-8d15-0d98e16e9001 tempest-GroupSnapshotsV319Test-550762948 None] Creating volume 65108e54-1ffb-4ef3-95c5-cfc506b7b676 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:19:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8931f5dd-0633-4207-8d15-0d98e16e9001 tempest-GroupSnapshotsV319Test-550762948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:19:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8931f5dd-0633-4207-8d15-0d98e16e9001 tempest-GroupSnapshotsV319Test-550762948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:19:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-8931f5dd-0633-4207-8d15-0d98e16e9001 tempest-GroupSnapshotsV319Test-550762948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:19:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-8931f5dd-0633-4207-8d15-0d98e16e9001 tempest-GroupSnapshotsV319Test-550762948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:19:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8931f5dd-0633-4207-8d15-0d98e16e9001 tempest-GroupSnapshotsV319Test-550762948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:19:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-8931f5dd-0633-4207-8d15-0d98e16e9001 tempest-GroupSnapshotsV319Test-550762948 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:19:02 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-8931f5dd-0633-4207-8d15-0d98e16e9001 tempest-GroupSnapshotsV319Test-550762948 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:19:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8931f5dd-0633-4207-8d15-0d98e16e9001 tempest-GroupSnapshotsV319Test-550762948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:02 devstack sudo[99551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676 1073741824
Nov 04 12:19:02 devstack sudo[99551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0525babb-220d-4cfc-8c0e-9dacbac34d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d21b6938-a26b-48e1-abe9-1f6ebbe8bdd1', 'volume_size': 2, 'snapshot_id': '38c1fdc9-af77-4637-8ef3-4a47ff9c6cb4'}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (195e4c7a-bb9c-4347-8c26-661127897450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:02 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Volume volume-d21b6938-a26b-48e1-abe9-1f6ebbe8bdd1 (d21b6938-a26b-48e1-abe9-1f6ebbe8bdd1): created successfully
Nov 04 12:19:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (195e4c7a-bb9c-4347-8c26-661127897450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Flow 'volume_create_manager' (add48d13-ff7b-4605-afad-2c67cd07b21d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:19:02 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-e23eefd9-48b5-4cc5-ba32-1651e1b201f3 tempest-VolumesSnapshotTestJSON-434051366 None] Created volume successfully.
Nov 04 12:19:02 devstack sudo[99551]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8931f5dd-0633-4207-8d15-0d98e16e9001 tempest-GroupSnapshotsV319Test-550762948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676 1073741824" returned: 0 in 0.418s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8931f5dd-0633-4207-8d15-0d98e16e9001 tempest-GroupSnapshotsV319Test-550762948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:02 devstack sudo[99557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676
Nov 04 12:19:02 devstack sudo[99557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:02 devstack sudo[99557]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8931f5dd-0633-4207-8d15-0d98e16e9001 tempest-GroupSnapshotsV319Test-550762948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676" returned: 0 in 0.232s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-8931f5dd-0633-4207-8d15-0d98e16e9001 tempest-GroupSnapshotsV319Test-550762948 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:19:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8931f5dd-0633-4207-8d15-0d98e16e9001 tempest-GroupSnapshotsV319Test-550762948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:19:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e7840691-4aa3-4307-abc2-80951cf25018 tempest-GroupsV314Test-1176320581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.608s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:19:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e7840691-4aa3-4307-abc2-80951cf25018 tempest-GroupsV314Test-1176320581 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=1ac0ba05-7434-4f13-8e29-40271eb81d0e,created_at=2026-11-04T11:18:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2095450713',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=1ac0ba05-7434-4f13-8e29-40271eb81d0e,host='devstack@QuobyteHD#QuobyteHD',id=ebc9d34e-6368-4236-9384-74c16b4112bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='27fd5bcb3b80441fa087994d78927038',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:18:57Z,use_quota=True,user_id='f9e4d782758c483f84816fb37c18d95f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(439d3185-14c5-4a39-855a-57ccae79e661),volume_type_id=439d3185-14c5-4a39-855a-57ccae79e661)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:19:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-e7840691-4aa3-4307-abc2-80951cf25018 tempest-GroupsV314Test-1176320581 None] Creating volume ebc9d34e-6368-4236-9384-74c16b4112bf {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:19:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e7840691-4aa3-4307-abc2-80951cf25018 tempest-GroupsV314Test-1176320581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:19:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e7840691-4aa3-4307-abc2-80951cf25018 tempest-GroupsV314Test-1176320581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:19:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e7840691-4aa3-4307-abc2-80951cf25018 tempest-GroupsV314Test-1176320581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:19:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e7840691-4aa3-4307-abc2-80951cf25018 tempest-GroupsV314Test-1176320581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:19:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e7840691-4aa3-4307-abc2-80951cf25018 tempest-GroupsV314Test-1176320581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:19:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e7840691-4aa3-4307-abc2-80951cf25018 tempest-GroupsV314Test-1176320581 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:19:02 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-e7840691-4aa3-4307-abc2-80951cf25018 tempest-GroupsV314Test-1176320581 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:19:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e7840691-4aa3-4307-abc2-80951cf25018 tempest-GroupsV314Test-1176320581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8931f5dd-0633-4207-8d15-0d98e16e9001 tempest-GroupSnapshotsV319Test-550762948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df0d0854-9056-4384-bb4a-379f3a4731ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:02 devstack sudo[99560]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf 1073741824
Nov 04 12:19:02 devstack sudo[99560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8931f5dd-0633-4207-8d15-0d98e16e9001 tempest-GroupSnapshotsV319Test-550762948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6555a1c-dff2-4464-8021-5e44ee80bf82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:02 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-8931f5dd-0633-4207-8d15-0d98e16e9001 tempest-GroupSnapshotsV319Test-550762948 None] Volume volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676 (65108e54-1ffb-4ef3-95c5-cfc506b7b676): created successfully
Nov 04 12:19:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8931f5dd-0633-4207-8d15-0d98e16e9001 tempest-GroupSnapshotsV319Test-550762948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6555a1c-dff2-4464-8021-5e44ee80bf82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8931f5dd-0633-4207-8d15-0d98e16e9001 tempest-GroupSnapshotsV319Test-550762948 None] Flow 'volume_create_manager' (f200f183-ed61-44ca-b813-efd25a2d4c1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:19:02 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-8931f5dd-0633-4207-8d15-0d98e16e9001 tempest-GroupSnapshotsV319Test-550762948 None] Created volume successfully.
Nov 04 12:19:03 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d94263fa-95ae-418e-8b05-db5ef0c49a99 tempest-VolumesSnapshotTestJSON-434051366 None] Acquiring lock "cinder-d21b6938-a26b-48e1-abe9-1f6ebbe8bdd1-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:19:03 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d94263fa-95ae-418e-8b05-db5ef0c49a99 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "cinder-d21b6938-a26b-48e1-abe9-1f6ebbe8bdd1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:19:03 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d94263fa-95ae-418e-8b05-db5ef0c49a99 tempest-VolumesSnapshotTestJSON-434051366 None] Acquiring lock "cinder-quobyte-d21b6938-a26b-48e1-abe9-1f6ebbe8bdd1" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:19:03 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d94263fa-95ae-418e-8b05-db5ef0c49a99 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "cinder-quobyte-d21b6938-a26b-48e1-abe9-1f6ebbe8bdd1" acquired by "delete_volume" :: waited 0.017s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:19:03 devstack sudo[99560]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e7840691-4aa3-4307-abc2-80951cf25018 tempest-GroupsV314Test-1176320581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf 1073741824" returned: 0 in 0.428s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:03 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[552314f1-7ac9-48d8-af59-db3dd941a3f1]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:19:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d94263fa-95ae-418e-8b05-db5ef0c49a99 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d21b6938-a26b-48e1-abe9-1f6ebbe8bdd1 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e7840691-4aa3-4307-abc2-80951cf25018 tempest-GroupsV314Test-1176320581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:03 devstack sudo[99567]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf
Nov 04 12:19:03 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:03 devstack sudo[99566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d21b6938-a26b-48e1-abe9-1f6ebbe8bdd1
Nov 04 12:19:03 devstack sudo[99566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:03 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e7840691-4aa3-4307-abc2-80951cf25018 tempest-GroupsV314Test-1176320581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf" returned: 0 in 0.265s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:03 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e7840691-4aa3-4307-abc2-80951cf25018 tempest-GroupsV314Test-1176320581 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:19:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e7840691-4aa3-4307-abc2-80951cf25018 tempest-GroupsV314Test-1176320581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:19:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e7840691-4aa3-4307-abc2-80951cf25018 tempest-GroupsV314Test-1176320581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (912d004f-6b98-4320-9e76-9c0defce1f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebc9d34e-6368-4236-9384-74c16b4112bf', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e7840691-4aa3-4307-abc2-80951cf25018 tempest-GroupsV314Test-1176320581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca8f7c4a-4e19-4755-8d00-226425f2e346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:03 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-e7840691-4aa3-4307-abc2-80951cf25018 tempest-GroupsV314Test-1176320581 None] Volume volume-ebc9d34e-6368-4236-9384-74c16b4112bf (ebc9d34e-6368-4236-9384-74c16b4112bf): created successfully
Nov 04 12:19:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e7840691-4aa3-4307-abc2-80951cf25018 tempest-GroupsV314Test-1176320581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca8f7c4a-4e19-4755-8d00-226425f2e346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e7840691-4aa3-4307-abc2-80951cf25018 tempest-GroupsV314Test-1176320581 None] Flow 'volume_create_manager' (84ae2c93-fca7-4197-82bc-77c7288f7c59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:19:03 devstack sudo[99566]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d94263fa-95ae-418e-8b05-db5ef0c49a99 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d21b6938-a26b-48e1-abe9-1f6ebbe8bdd1" returned: 0 in 0.375s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d94263fa-95ae-418e-8b05-db5ef0c49a99 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d21b6938-a26b-48e1-abe9-1f6ebbe8bdd1 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:03 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-e7840691-4aa3-4307-abc2-80951cf25018 tempest-GroupsV314Test-1176320581 None] Created volume successfully.
Nov 04 12:19:03 devstack sudo[99575]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d21b6938-a26b-48e1-abe9-1f6ebbe8bdd1
Nov 04 12:19:03 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:03 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-1f3e2d22-2a8b-4eac-b693-28b58c63fa87 tempest-GroupSnapshotsV319Test-550762948 None] GroupSnapshot b53d1553-91ca-4810-b75f-e48d265eacda: creating.
Nov 04 12:19:03 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d94263fa-95ae-418e-8b05-db5ef0c49a99 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d21b6938-a26b-48e1-abe9-1f6ebbe8bdd1" returned: 0 in 0.263s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1f3e2d22-2a8b-4eac-b693-28b58c63fa87 tempest-GroupSnapshotsV319Test-550762948 None] Group snapshot b53d1553-91ca-4810-b75f-e48d265eacda: creating. {{(pid=87169) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}}
Nov 04 12:19:03 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d94263fa-95ae-418e-8b05-db5ef0c49a99 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "cinder-quobyte-d21b6938-a26b-48e1-abe9-1f6ebbe8bdd1" released by "delete_volume" :: held 0.690s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:19:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1f3e2d22-2a8b-4eac-b693-28b58c63fa87 tempest-GroupSnapshotsV319Test-550762948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:19:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1f3e2d22-2a8b-4eac-b693-28b58c63fa87 tempest-GroupSnapshotsV319Test-550762948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:19:03 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-1f3e2d22-2a8b-4eac-b693-28b58c63fa87 tempest-GroupSnapshotsV319Test-550762948 None] Creating offline snapshot 2d6112b0-508b-41b2-b41b-b49a51d5297b of volume 65108e54-1ffb-4ef3-95c5-cfc506b7b676 {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:19:04 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1fea38-5d4c-4487-8cd1-d422015c30d5]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:19:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1f3e2d22-2a8b-4eac-b693-28b58c63fa87 tempest-GroupSnapshotsV319Test-550762948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:04 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-d94263fa-95ae-418e-8b05-db5ef0c49a99 tempest-VolumesSnapshotTestJSON-434051366 None] Created reservations ['9cd0ca04-55dc-46b9-b43e-2ffe3019da5e', 'b5066023-6e4c-4982-97ac-eb67729a41f2', '596199fd-bba0-47db-9e51-f31b86054b04', '35ef5441-99cc-4566-9f98-2ee074e980e4'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:19:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d94263fa-95ae-418e-8b05-db5ef0c49a99 tempest-VolumesSnapshotTestJSON-434051366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:19:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d94263fa-95ae-418e-8b05-db5ef0c49a99 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:19:04 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d94263fa-95ae-418e-8b05-db5ef0c49a99 tempest-VolumesSnapshotTestJSON-434051366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:19:04 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d94263fa-95ae-418e-8b05-db5ef0c49a99 tempest-VolumesSnapshotTestJSON-434051366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:19:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d94263fa-95ae-418e-8b05-db5ef0c49a99 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:19:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d94263fa-95ae-418e-8b05-db5ef0c49a99 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:04 devstack sudo[99578]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676
Nov 04 12:19:04 devstack sudo[99578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:04 devstack sudo[99579]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:19:04 devstack sudo[99579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:04 devstack sudo[99579]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d94263fa-95ae-418e-8b05-db5ef0c49a99 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.249s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:04 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-d94263fa-95ae-418e-8b05-db5ef0c49a99 tempest-VolumesSnapshotTestJSON-434051366 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:19:04 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-d94263fa-95ae-418e-8b05-db5ef0c49a99 tempest-VolumesSnapshotTestJSON-434051366 None] Deleted volume successfully.
Nov 04 12:19:04 devstack sudo[99578]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1f3e2d22-2a8b-4eac-b693-28b58c63fa87 tempest-GroupSnapshotsV319Test-550762948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676" returned: 0 in 0.371s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1f3e2d22-2a8b-4eac-b693-28b58c63fa87 tempest-GroupSnapshotsV319Test-550762948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676.2d6112b0-508b-41b2-b41b-b49a51d5297b 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:04 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d94263fa-95ae-418e-8b05-db5ef0c49a99 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "cinder-d21b6938-a26b-48e1-abe9-1f6ebbe8bdd1-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:19:04 devstack sudo[99586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676.2d6112b0-508b-41b2-b41b-b49a51d5297b 1G
Nov 04 12:19:04 devstack sudo[99586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:04 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-0f94ac16-6ea5-4d44-a8a9-2241478e3a68 tempest-VolumesSnapshotTestJSON-434051366 None] Acquiring lock "cinder-38c1fdc9-af77-4637-8ef3-4a47ff9c6cb4-delete_snapshot" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:19:04 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-0f94ac16-6ea5-4d44-a8a9-2241478e3a68 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "cinder-38c1fdc9-af77-4637-8ef3-4a47ff9c6cb4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:19:04 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-0f94ac16-6ea5-4d44-a8a9-2241478e3a68 tempest-VolumesSnapshotTestJSON-434051366 None] Acquiring lock "cinder-quobyte-6da3bee0-4468-48d3-b3e6-7029239d873d" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:19:04 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-0f94ac16-6ea5-4d44-a8a9-2241478e3a68 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "cinder-quobyte-6da3bee0-4468-48d3-b3e6-7029239d873d" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:19:04 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-0f94ac16-6ea5-4d44-a8a9-2241478e3a68 tempest-VolumesSnapshotTestJSON-434051366 None] Acquiring lock "cinder-quobyte-38c1fdc9-af77-4637-8ef3-4a47ff9c6cb4" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:19:04 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-0f94ac16-6ea5-4d44-a8a9-2241478e3a68 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "cinder-quobyte-38c1fdc9-af77-4637-8ef3-4a47ff9c6cb4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:19:04 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-0f94ac16-6ea5-4d44-a8a9-2241478e3a68 tempest-VolumesSnapshotTestJSON-434051366 None] Deleting offline snapshot 38c1fdc9-af77-4637-8ef3-4a47ff9c6cb4 of volume 6da3bee0-4468-48d3-b3e6-7029239d873d {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:19:04 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-0f94ac16-6ea5-4d44-a8a9-2241478e3a68 tempest-VolumesSnapshotTestJSON-434051366 None] snapshot_file for this snap is: volume-6da3bee0-4468-48d3-b3e6-7029239d873d.38c1fdc9-af77-4637-8ef3-4a47ff9c6cb4 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:19:04 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ea26f9-9166-4401-9248-e7c01b78cf13]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:19:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0f94ac16-6ea5-4d44-a8a9-2241478e3a68 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d.38c1fdc9-af77-4637-8ef3-4a47ff9c6cb4 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:04 devstack sudo[99588]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d.38c1fdc9-af77-4637-8ef3-4a47ff9c6cb4
Nov 04 12:19:04 devstack sudo[99588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:04 devstack sudo[99586]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1f3e2d22-2a8b-4eac-b693-28b58c63fa87 tempest-GroupSnapshotsV319Test-550762948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676.2d6112b0-508b-41b2-b41b-b49a51d5297b 1G" returned: 0 in 0.481s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1f3e2d22-2a8b-4eac-b693-28b58c63fa87 tempest-GroupSnapshotsV319Test-550762948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676.2d6112b0-508b-41b2-b41b-b49a51d5297b {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:04 devstack sudo[99595]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676.2d6112b0-508b-41b2-b41b-b49a51d5297b
Nov 04 12:19:04 devstack sudo[99595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:04 devstack sudo[99588]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0f94ac16-6ea5-4d44-a8a9-2241478e3a68 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d.38c1fdc9-af77-4637-8ef3-4a47ff9c6cb4" returned: 0 in 0.422s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:04 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-0f94ac16-6ea5-4d44-a8a9-2241478e3a68 tempest-VolumesSnapshotTestJSON-434051366 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6da3bee0-4468-48d3-b3e6-7029239d873d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:19:04 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c068462-8acd-4936-a0fc-461404675035]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:19:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0f94ac16-6ea5-4d44-a8a9-2241478e3a68 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:05 devstack sudo[99599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d
Nov 04 12:19:05 devstack sudo[99599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:05 devstack sudo[99595]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1f3e2d22-2a8b-4eac-b693-28b58c63fa87 tempest-GroupSnapshotsV319Test-550762948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676.2d6112b0-508b-41b2-b41b-b49a51d5297b" returned: 0 in 0.326s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:05 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-1f3e2d22-2a8b-4eac-b693-28b58c63fa87 tempest-GroupSnapshotsV319Test-550762948 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676.2d6112b0-508b-41b2-b41b-b49a51d5297b is being set with open permissions: ugo+rw: NotImplementedError
Nov 04 12:19:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1f3e2d22-2a8b-4eac-b693-28b58c63fa87 tempest-GroupSnapshotsV319Test-550762948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676.2d6112b0-508b-41b2-b41b-b49a51d5297b {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:05 devstack sudo[99605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676.2d6112b0-508b-41b2-b41b-b49a51d5297b
Nov 04 12:19:05 devstack sudo[99605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:19:05 devstack sudo[99605]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1f3e2d22-2a8b-4eac-b693-28b58c63fa87 tempest-GroupSnapshotsV319Test-550762948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676.2d6112b0-508b-41b2-b41b-b49a51d5297b" returned: 0 in 0.270s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1f3e2d22-2a8b-4eac-b693-28b58c63fa87 tempest-GroupSnapshotsV319Test-550762948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:05 devstack sudo[99610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676.info
Nov 04 12:19:05 devstack sudo[99610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:05 devstack sudo[99599]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0f94ac16-6ea5-4d44-a8a9-2241478e3a68 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d" returned: 0 in 0.625s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0f94ac16-6ea5-4d44-a8a9-2241478e3a68 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d.38c1fdc9-af77-4637-8ef3-4a47ff9c6cb4 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:05 devstack sudo[99613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d.38c1fdc9-af77-4637-8ef3-4a47ff9c6cb4
Nov 04 12:19:05 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:05 devstack sudo[99610]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1f3e2d22-2a8b-4eac-b693-28b58c63fa87 tempest-GroupSnapshotsV319Test-550762948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676.info" returned: 0 in 0.261s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:05 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-1f3e2d22-2a8b-4eac-b693-28b58c63fa87 tempest-GroupSnapshotsV319Test-550762948 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 04 12:19:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1f3e2d22-2a8b-4eac-b693-28b58c63fa87 tempest-GroupSnapshotsV319Test-550762948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:05 devstack sudo[99616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676.info
Nov 04 12:19:05 devstack sudo[99616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:05 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0f94ac16-6ea5-4d44-a8a9-2241478e3a68 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d.38c1fdc9-af77-4637-8ef3-4a47ff9c6cb4" returned: 0 in 0.348s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0f94ac16-6ea5-4d44-a8a9-2241478e3a68 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d.38c1fdc9-af77-4637-8ef3-4a47ff9c6cb4 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:05 devstack sudo[99616]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1f3e2d22-2a8b-4eac-b693-28b58c63fa87 tempest-GroupSnapshotsV319Test-550762948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676.info" returned: 0 in 0.244s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:06 devstack sudo[99622]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d.38c1fdc9-af77-4637-8ef3-4a47ff9c6cb4
Nov 04 12:19:06 devstack sudo[99622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1f3e2d22-2a8b-4eac-b693-28b58c63fa87 tempest-GroupSnapshotsV319Test-550762948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.053s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:19:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.755s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:19:06 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] Cloning volume ebc9d34e-6368-4236-9384-74c16b4112bf to volume 2eff6469-4d9d-4b93-9ded-b4442a8fde2b
Nov 04 12:19:06 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] Creating offline snapshot 2c0b10a8-2915-4abb-85e2-71505036926d of volume ebc9d34e-6368-4236-9384-74c16b4112bf {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:19:06 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c24b1b-08c8-4af6-b9f5-a9b6a1033985]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:19:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:06 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-1f3e2d22-2a8b-4eac-b693-28b58c63fa87 tempest-GroupSnapshotsV319Test-550762948 None] group_snapshot b53d1553-91ca-4810-b75f-e48d265eacda: created successfully
Nov 04 12:19:06 devstack sudo[99624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf
Nov 04 12:19:06 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:06 devstack sudo[99622]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0f94ac16-6ea5-4d44-a8a9-2241478e3a68 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d.38c1fdc9-af77-4637-8ef3-4a47ff9c6cb4" returned: 0 in 0.257s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:06 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-0f94ac16-6ea5-4d44-a8a9-2241478e3a68 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "cinder-quobyte-38c1fdc9-af77-4637-8ef3-4a47ff9c6cb4" released by "_delete_snapshot" :: held 1.783s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:19:06 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-0f94ac16-6ea5-4d44-a8a9-2241478e3a68 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "cinder-quobyte-6da3bee0-4468-48d3-b3e6-7029239d873d" released by "delete_snapshot" :: held 1.804s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:19:06 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-0f94ac16-6ea5-4d44-a8a9-2241478e3a68 tempest-VolumesSnapshotTestJSON-434051366 None] Created reservations ['726b2908-231f-437d-af80-0d85ce5b4aec', '9b47be24-ba56-404f-95ce-240ecac4b570', 'bf422445-71bc-4ccc-917c-ee3679e15b57', 'f5502742-a4d9-412d-88d6-191426ea0312'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:19:06 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-0f94ac16-6ea5-4d44-a8a9-2241478e3a68 tempest-VolumesSnapshotTestJSON-434051366 None] Delete snapshot completed successfully.
Nov 04 12:19:06 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-0f94ac16-6ea5-4d44-a8a9-2241478e3a68 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "cinder-38c1fdc9-af77-4637-8ef3-4a47ff9c6cb4-delete_snapshot" released by "delete_snapshot" :: held 1.929s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:19:06 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf" returned: 0 in 0.374s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf.2c0b10a8-2915-4abb-85e2-71505036926d 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:06 devstack sudo[99630]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf.2c0b10a8-2915-4abb-85e2-71505036926d 1G
Nov 04 12:19:06 devstack sudo[99630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:06 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-92a91569-be45-4c36-bcb7-24cda4ed4319 tempest-VolumesSnapshotTestJSON-434051366 None] Acquiring lock "cinder-6da3bee0-4468-48d3-b3e6-7029239d873d-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:19:06 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-92a91569-be45-4c36-bcb7-24cda4ed4319 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "cinder-6da3bee0-4468-48d3-b3e6-7029239d873d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:19:06 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=203,cinder:UPDATE=225,cinder:INSERT=49,cinder:DELETE=17 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:19:06 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-92a91569-be45-4c36-bcb7-24cda4ed4319 tempest-VolumesSnapshotTestJSON-434051366 None] Acquiring lock "cinder-quobyte-6da3bee0-4468-48d3-b3e6-7029239d873d" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:19:06 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-92a91569-be45-4c36-bcb7-24cda4ed4319 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "cinder-quobyte-6da3bee0-4468-48d3-b3e6-7029239d873d" acquired by "delete_volume" :: waited 0.019s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:19:06 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3ab65f-e06a-4285-9fd8-5142b9c4cd1f]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:19:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-92a91569-be45-4c36-bcb7-24cda4ed4319 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:06 devstack sudo[99630]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf.2c0b10a8-2915-4abb-85e2-71505036926d 1G" returned: 0 in 0.472s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebc9d34e-6368-4236-9384-74c16b4112bf -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf.2c0b10a8-2915-4abb-85e2-71505036926d {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:06 devstack sudo[99635]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d
Nov 04 12:19:06 devstack sudo[99635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:06 devstack sudo[99638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebc9d34e-6368-4236-9384-74c16b4112bf -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf.2c0b10a8-2915-4abb-85e2-71505036926d
Nov 04 12:19:06 devstack sudo[99638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:07 devstack sudo[99635]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-92a91569-be45-4c36-bcb7-24cda4ed4319 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d" returned: 0 in 0.409s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-92a91569-be45-4c36-bcb7-24cda4ed4319 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:07 devstack sudo[99638]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebc9d34e-6368-4236-9384-74c16b4112bf -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf.2c0b10a8-2915-4abb-85e2-71505036926d" returned: 0 in 0.303s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:07 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf.2c0b10a8-2915-4abb-85e2-71505036926d is being set with open permissions: ugo+rw: NotImplementedError
Nov 04 12:19:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf.2c0b10a8-2915-4abb-85e2-71505036926d {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:07 devstack sudo[99647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d
Nov 04 12:19:07 devstack sudo[99647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:07 devstack sudo[99648]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf.2c0b10a8-2915-4abb-85e2-71505036926d
Nov 04 12:19:07 devstack sudo[99648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:07 devstack sudo[99648]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf.2c0b10a8-2915-4abb-85e2-71505036926d" returned: 0 in 0.257s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:07 devstack sudo[99647]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-92a91569-be45-4c36-bcb7-24cda4ed4319 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6da3bee0-4468-48d3-b3e6-7029239d873d" returned: 0 in 0.287s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:07 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-92a91569-be45-4c36-bcb7-24cda4ed4319 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "cinder-quobyte-6da3bee0-4468-48d3-b3e6-7029239d873d" released by "delete_volume" :: held 0.761s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:19:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:07 devstack sudo[99653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf.info
Nov 04 12:19:07 devstack sudo[99653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:07 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-92a91569-be45-4c36-bcb7-24cda4ed4319 tempest-VolumesSnapshotTestJSON-434051366 None] Created reservations ['262c975a-0987-4687-bd8c-ed7e7e251a80', '6757cc42-e227-4207-98b5-bd091c47722c', 'ac58979b-4637-4f6c-aa45-7cb213144b79', 'b6f0dd55-5061-4f2c-804d-02ddba6bf1c3'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:19:07 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-2798d9dd-352e-474f-a26f-299846f714c6 tempest-GroupSnapshotsV319Test-550762948 None] group_snapshot b53d1553-91ca-4810-b75f-e48d265eacda: deleting
Nov 04 12:19:07 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2798d9dd-352e-474f-a26f-299846f714c6 tempest-GroupSnapshotsV319Test-550762948 None] group_snapshot b53d1553-91ca-4810-b75f-e48d265eacda: deleting {{(pid=87169) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}}
Nov 04 12:19:07 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-2798d9dd-352e-474f-a26f-299846f714c6 tempest-GroupSnapshotsV319Test-550762948 None] Acquiring lock "cinder-quobyte-65108e54-1ffb-4ef3-95c5-cfc506b7b676" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:19:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-92a91569-be45-4c36-bcb7-24cda4ed4319 tempest-VolumesSnapshotTestJSON-434051366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:19:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-92a91569-be45-4c36-bcb7-24cda4ed4319 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:19:07 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-92a91569-be45-4c36-bcb7-24cda4ed4319 tempest-VolumesSnapshotTestJSON-434051366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:19:07 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-92a91569-be45-4c36-bcb7-24cda4ed4319 tempest-VolumesSnapshotTestJSON-434051366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:19:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-92a91569-be45-4c36-bcb7-24cda4ed4319 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:19:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-92a91569-be45-4c36-bcb7-24cda4ed4319 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:07 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-2798d9dd-352e-474f-a26f-299846f714c6 tempest-GroupSnapshotsV319Test-550762948 None] Lock "cinder-quobyte-65108e54-1ffb-4ef3-95c5-cfc506b7b676" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:19:07 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-2798d9dd-352e-474f-a26f-299846f714c6 tempest-GroupSnapshotsV319Test-550762948 None] Acquiring lock "cinder-quobyte-2d6112b0-508b-41b2-b41b-b49a51d5297b" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:19:07 devstack sudo[99655]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:19:07 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-2798d9dd-352e-474f-a26f-299846f714c6 tempest-GroupSnapshotsV319Test-550762948 None] Lock "cinder-quobyte-2d6112b0-508b-41b2-b41b-b49a51d5297b" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:19:07 devstack sudo[99655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:07 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-2798d9dd-352e-474f-a26f-299846f714c6 tempest-GroupSnapshotsV319Test-550762948 None] Deleting offline snapshot 2d6112b0-508b-41b2-b41b-b49a51d5297b of volume 65108e54-1ffb-4ef3-95c5-cfc506b7b676 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:19:07 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-2798d9dd-352e-474f-a26f-299846f714c6 tempest-GroupSnapshotsV319Test-550762948 None] snapshot_file for this snap is: volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676.2d6112b0-508b-41b2-b41b-b49a51d5297b {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:19:07 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[411db9fe-83df-4336-a503-08ee6185318b]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:19:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2798d9dd-352e-474f-a26f-299846f714c6 tempest-GroupSnapshotsV319Test-550762948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676.2d6112b0-508b-41b2-b41b-b49a51d5297b {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:07 devstack sudo[99653]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf.info" returned: 0 in 0.372s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:07 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf.info is being set with open permissions: ugo+rw: NotImplementedError
Nov 04 12:19:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:07 devstack sudo[99659]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf.info
Nov 04 12:19:07 devstack sudo[99659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:08 devstack sudo[99658]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676.2d6112b0-508b-41b2-b41b-b49a51d5297b
Nov 04 12:19:08 devstack sudo[99658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:08 devstack sudo[99655]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-92a91569-be45-4c36-bcb7-24cda4ed4319 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.403s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:08 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-92a91569-be45-4c36-bcb7-24cda4ed4319 tempest-VolumesSnapshotTestJSON-434051366 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:19:08 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-92a91569-be45-4c36-bcb7-24cda4ed4319 tempest-VolumesSnapshotTestJSON-434051366 None] Deleted volume successfully.
Nov 04 12:19:08 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-92a91569-be45-4c36-bcb7-24cda4ed4319 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "cinder-6da3bee0-4468-48d3-b3e6-7029239d873d-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:19:08 devstack sudo[99659]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf.info" returned: 0 in 0.290s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:08 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] Acquiring lock "cinder-quobyte-2eff6469-4d9d-4b93-9ded-b4442a8fde2b" by "_copy_volume_from_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:19:08 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] Lock "cinder-quobyte-2eff6469-4d9d-4b93-9ded-b4442a8fde2b" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:19:08 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] snapshot: 2c0b10a8-2915-4abb-85e2-71505036926d, volume: 2eff6469-4d9d-4b93-9ded-b4442a8fde2b,  {{(pid=87169) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 04 12:19:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:19:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:19:08 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:19:08 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:19:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:19:08 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ed12a6-a207-4093-83a7-faf9e352bb90]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:19:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf.2c0b10a8-2915-4abb-85e2-71505036926d {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:08 devstack sudo[99658]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2798d9dd-352e-474f-a26f-299846f714c6 tempest-GroupSnapshotsV319Test-550762948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676.2d6112b0-508b-41b2-b41b-b49a51d5297b" returned: 0 in 0.466s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:08 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-2798d9dd-352e-474f-a26f-299846f714c6 tempest-GroupSnapshotsV319Test-550762948 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:19:08 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d422e8f-d62a-4c73-9712-4fe1dd06de4b]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:19:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2798d9dd-352e-474f-a26f-299846f714c6 tempest-GroupSnapshotsV319Test-550762948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:08 devstack sudo[99667]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf.2c0b10a8-2915-4abb-85e2-71505036926d
Nov 04 12:19:08 devstack sudo[99667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:08 devstack sudo[99668]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676
Nov 04 12:19:08 devstack sudo[99668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:08 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-c288aebf-e6c6-404c-8c22-5f68cffa88b9 tempest-VolumesSnapshotTestJSON-434051366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:19:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c288aebf-e6c6-404c-8c22-5f68cffa88b9 tempest-VolumesSnapshotTestJSON-434051366 None] Flow 'volume_create_manager' (17f7bfe0-e55b-4763-b690-c438947ee153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:19:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c288aebf-e6c6-404c-8c22-5f68cffa88b9 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8693ca09-bf23-4894-8688-03d3c97f798e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c288aebf-e6c6-404c-8c22-5f68cffa88b9 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8693ca09-bf23-4894-8688-03d3c97f798e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1529534547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeea561c-1b90-4f84-9a1b-f0337312a885,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ca15df84b5a40ef9bab2894e931f47a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:19:09Z,use_quota=True,user_id='6da3b5f34fc64db69b23ab368664ba14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c288aebf-e6c6-404c-8c22-5f68cffa88b9 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f42debd1-fc0b-4df9-a312-5a3701454199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c288aebf-e6c6-404c-8c22-5f68cffa88b9 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f42debd1-fc0b-4df9-a312-5a3701454199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c288aebf-e6c6-404c-8c22-5f68cffa88b9 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba2d9b2b-1e32-42a5-8141-37641bc4e001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c288aebf-e6c6-404c-8c22-5f68cffa88b9 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba2d9b2b-1e32-42a5-8141-37641bc4e001) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aeea561c-1b90-4f84-9a1b-f0337312a885', 'volume_name': 'volume-aeea561c-1b90-4f84-9a1b-f0337312a885', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c288aebf-e6c6-404c-8c22-5f68cffa88b9 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21815381-227c-4864-bede-6c1832cc0a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c288aebf-e6c6-404c-8c22-5f68cffa88b9 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21815381-227c-4864-bede-6c1832cc0a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c288aebf-e6c6-404c-8c22-5f68cffa88b9 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a12d68d-5603-427b-80ca-c250b375346d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:08 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-c288aebf-e6c6-404c-8c22-5f68cffa88b9 tempest-VolumesSnapshotTestJSON-434051366 None] Volume aeea561c-1b90-4f84-9a1b-f0337312a885: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aeea561c-1b90-4f84-9a1b-f0337312a885', 'volume_size': 1}
Nov 04 12:19:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c288aebf-e6c6-404c-8c22-5f68cffa88b9 tempest-VolumesSnapshotTestJSON-434051366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:19:08 devstack sudo[99667]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf.2c0b10a8-2915-4abb-85e2-71505036926d" returned: 0 in 0.381s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:08 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebc9d34e-6368-4236-9384-74c16b4112bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:19:08 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d10b625-fa68-4767-9ac5-12324c6f1483]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:19:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:08 devstack sudo[99668]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2798d9dd-352e-474f-a26f-299846f714c6 tempest-GroupSnapshotsV319Test-550762948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676" returned: 0 in 0.381s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2798d9dd-352e-474f-a26f-299846f714c6 tempest-GroupSnapshotsV319Test-550762948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676.2d6112b0-508b-41b2-b41b-b49a51d5297b {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:08 devstack sudo[99678]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676.2d6112b0-508b-41b2-b41b-b49a51d5297b
Nov 04 12:19:08 devstack sudo[99678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:08 devstack sudo[99676]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf
Nov 04 12:19:08 devstack sudo[99676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:09 devstack sudo[99676]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf" returned: 0 in 0.357s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:09 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf {{(pid=87169) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 04 12:19:09 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] Creating direct copy from snapshot {{(pid=87169) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 04 12:19:09 devstack cinder-volume[87169]: DEBUG cinder.utils [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] Path /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2eff6469-4d9d-4b93-9ded-b4442a8fde2b not found in is_blk_device check {{(pid=87169) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 04 12:19:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2eff6469-4d9d-4b93-9ded-b4442a8fde2b {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:09 devstack sudo[99687]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2eff6469-4d9d-4b93-9ded-b4442a8fde2b
Nov 04 12:19:09 devstack sudo[99687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:09 devstack sudo[99678]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2798d9dd-352e-474f-a26f-299846f714c6 tempest-GroupSnapshotsV319Test-550762948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676.2d6112b0-508b-41b2-b41b-b49a51d5297b" returned: 0 in 0.350s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2798d9dd-352e-474f-a26f-299846f714c6 tempest-GroupSnapshotsV319Test-550762948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676.2d6112b0-508b-41b2-b41b-b49a51d5297b {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:09 devstack sudo[99689]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676.2d6112b0-508b-41b2-b41b-b49a51d5297b
Nov 04 12:19:09 devstack sudo[99689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:09 devstack sudo[99689]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2798d9dd-352e-474f-a26f-299846f714c6 tempest-GroupSnapshotsV319Test-550762948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676.2d6112b0-508b-41b2-b41b-b49a51d5297b" returned: 0 in 0.256s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:09 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-2798d9dd-352e-474f-a26f-299846f714c6 tempest-GroupSnapshotsV319Test-550762948 None] Lock "cinder-quobyte-2d6112b0-508b-41b2-b41b-b49a51d5297b" released by "_delete_snapshot" :: held 1.612s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:19:09 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-2798d9dd-352e-474f-a26f-299846f714c6 tempest-GroupSnapshotsV319Test-550762948 None] Lock "cinder-quobyte-65108e54-1ffb-4ef3-95c5-cfc506b7b676" released by "delete_snapshot" :: held 1.653s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:19:09 devstack cinder-volume[87169]: WARNING cinder.quota [None req-2798d9dd-352e-474f-a26f-299846f714c6 tempest-GroupSnapshotsV319Test-550762948 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1525492466 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1525492466, it is now deprecated. Please use the default quota class for default quota.
Nov 04 12:19:09 devstack cinder-volume[87169]: WARNING cinder.quota [None req-2798d9dd-352e-474f-a26f-299846f714c6 tempest-GroupSnapshotsV319Test-550762948 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1525492466 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1525492466, it is now deprecated. Please use the default quota class for default quota.
Nov 04 12:19:09 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-2798d9dd-352e-474f-a26f-299846f714c6 tempest-GroupSnapshotsV319Test-550762948 None] Created reservations ['4356d22b-421a-4b04-b4aa-9da0f0fe5ca6', 'ff69740b-bb23-4130-b49e-f0d9ad3c40de', '8b95b669-bf2e-4ffb-84dc-2c8e732aa57e', '07635e9b-8760-4233-ab94-7a83384b233d'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:19:09 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-2798d9dd-352e-474f-a26f-299846f714c6 tempest-GroupSnapshotsV319Test-550762948 None] group_snapshot b53d1553-91ca-4810-b75f-e48d265eacda: deleted successfully
Nov 04 12:19:10 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-2f8420c3-8961-4679-bf9e-3afb27561707 tempest-GroupSnapshotsV319Test-550762948 None] Acquiring lock "cinder-quobyte-65108e54-1ffb-4ef3-95c5-cfc506b7b676" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:19:10 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-2f8420c3-8961-4679-bf9e-3afb27561707 tempest-GroupSnapshotsV319Test-550762948 None] Lock "cinder-quobyte-65108e54-1ffb-4ef3-95c5-cfc506b7b676" acquired by "delete_volume" :: waited 0.019s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:19:10 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1d4f87-aad5-4fa6-80c7-e1c6f4f41b6e]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:19:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2f8420c3-8961-4679-bf9e-3afb27561707 tempest-GroupSnapshotsV319Test-550762948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:10 devstack sudo[99703]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676
Nov 04 12:19:10 devstack sudo[99703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:11 devstack sudo[99703]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2f8420c3-8961-4679-bf9e-3afb27561707 tempest-GroupSnapshotsV319Test-550762948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676" returned: 0 in 0.588s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2f8420c3-8961-4679-bf9e-3afb27561707 tempest-GroupSnapshotsV319Test-550762948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:11 devstack sudo[99709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676
Nov 04 12:19:11 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:11 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2f8420c3-8961-4679-bf9e-3afb27561707 tempest-GroupSnapshotsV319Test-550762948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-65108e54-1ffb-4ef3-95c5-cfc506b7b676" returned: 0 in 0.602s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:11 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-2f8420c3-8961-4679-bf9e-3afb27561707 tempest-GroupSnapshotsV319Test-550762948 None] Lock "cinder-quobyte-65108e54-1ffb-4ef3-95c5-cfc506b7b676" released by "delete_volume" :: held 1.332s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:19:12 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-2f8420c3-8961-4679-bf9e-3afb27561707 tempest-GroupSnapshotsV319Test-550762948 None] Created reservations ['31201f7a-5c6b-43c1-a7c4-8c9683273a44'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:19:12 devstack cinder-volume[87169]: WARNING cinder.quota [None req-2f8420c3-8961-4679-bf9e-3afb27561707 tempest-GroupSnapshotsV319Test-550762948 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1525492466 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1525492466, it is now deprecated. Please use the default quota class for default quota.
Nov 04 12:19:12 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-2f8420c3-8961-4679-bf9e-3afb27561707 tempest-GroupSnapshotsV319Test-550762948 None] Created reservations ['916fde77-ac38-414b-a22f-dae5bce9a30e', 'fb48a4cb-19d1-452e-bf97-37767de1b2ee', 'aec78057-e854-4a3f-b7fa-079145c26343', '1c232b24-5557-4d0b-8f60-79000556d5b6'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:19:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2f8420c3-8961-4679-bf9e-3afb27561707 tempest-GroupSnapshotsV319Test-550762948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:19:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2f8420c3-8961-4679-bf9e-3afb27561707 tempest-GroupSnapshotsV319Test-550762948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:19:12 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-2f8420c3-8961-4679-bf9e-3afb27561707 tempest-GroupSnapshotsV319Test-550762948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:19:12 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-2f8420c3-8961-4679-bf9e-3afb27561707 tempest-GroupSnapshotsV319Test-550762948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:19:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2f8420c3-8961-4679-bf9e-3afb27561707 tempest-GroupSnapshotsV319Test-550762948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:19:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2f8420c3-8961-4679-bf9e-3afb27561707 tempest-GroupSnapshotsV319Test-550762948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:12 devstack sudo[99712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:19:12 devstack sudo[99712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:12 devstack sudo[99712]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2f8420c3-8961-4679-bf9e-3afb27561707 tempest-GroupSnapshotsV319Test-550762948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.323s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:12 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-2f8420c3-8961-4679-bf9e-3afb27561707 tempest-GroupSnapshotsV319Test-550762948 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:19:12 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-2f8420c3-8961-4679-bf9e-3afb27561707 tempest-GroupSnapshotsV319Test-550762948 None] Delete group completed successfully.
Nov 04 12:19:15 devstack sudo[99687]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2eff6469-4d9d-4b93-9ded-b4442a8fde2b" returned: 0 in 6.750s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:15 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] Image conversion details: src /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf, size 1024.00 MB, duration 6.75 sec, destination /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2eff6469-4d9d-4b93-9ded-b4442a8fde2b {{(pid=87169) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 12:19:15 devstack cinder-volume[87169]: INFO cinder.image.image_utils [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] Converted 1024.00 MB image at 151.68 MB/s
Nov 04 12:19:15 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2eff6469-4d9d-4b93-9ded-b4442a8fde2b is being set with open permissions: ugo+rw: NotImplementedError
Nov 04 12:19:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2eff6469-4d9d-4b93-9ded-b4442a8fde2b {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:15 devstack sudo[99715]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2eff6469-4d9d-4b93-9ded-b4442a8fde2b
Nov 04 12:19:15 devstack sudo[99715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:16 devstack sudo[99715]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2eff6469-4d9d-4b93-9ded-b4442a8fde2b" returned: 0 in 0.244s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:16 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] Lock "cinder-quobyte-2eff6469-4d9d-4b93-9ded-b4442a8fde2b" released by "_copy_volume_from_snapshot" :: held 7.805s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:19:16 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] Acquiring lock "cinder-quobyte-2c0b10a8-2915-4abb-85e2-71505036926d" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:19:16 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] Lock "cinder-quobyte-2c0b10a8-2915-4abb-85e2-71505036926d" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:19:16 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] Deleting offline snapshot 2c0b10a8-2915-4abb-85e2-71505036926d of volume ebc9d34e-6368-4236-9384-74c16b4112bf {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:19:16 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] snapshot_file for this snap is: volume-ebc9d34e-6368-4236-9384-74c16b4112bf.2c0b10a8-2915-4abb-85e2-71505036926d {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:19:16 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[863afca4-c481-4af8-82b2-af0912add031]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:19:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf.2c0b10a8-2915-4abb-85e2-71505036926d {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:16 devstack sudo[99718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf.2c0b10a8-2915-4abb-85e2-71505036926d
Nov 04 12:19:16 devstack sudo[99718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:16 devstack sudo[99718]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf.2c0b10a8-2915-4abb-85e2-71505036926d" returned: 0 in 0.396s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:16 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebc9d34e-6368-4236-9384-74c16b4112bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:19:16 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[264f8038-7513-47ce-8791-a8c54fe32486]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:19:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:16 devstack sudo[99724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf
Nov 04 12:19:16 devstack sudo[99724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:17 devstack sudo[99724]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf" returned: 0 in 0.590s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf.2c0b10a8-2915-4abb-85e2-71505036926d {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:17 devstack sudo[99729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf.2c0b10a8-2915-4abb-85e2-71505036926d
Nov 04 12:19:17 devstack sudo[99729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:17 devstack sudo[99729]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf.2c0b10a8-2915-4abb-85e2-71505036926d" returned: 0 in 0.358s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf.2c0b10a8-2915-4abb-85e2-71505036926d {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:17 devstack sudo[99734]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf.2c0b10a8-2915-4abb-85e2-71505036926d
Nov 04 12:19:17 devstack sudo[99734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:17 devstack sudo[99734]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf.2c0b10a8-2915-4abb-85e2-71505036926d" returned: 0 in 0.248s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:17 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] Lock "cinder-quobyte-2c0b10a8-2915-4abb-85e2-71505036926d" released by "_delete_snapshot" :: held 1.699s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:19:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.808s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:19:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c288aebf-e6c6-404c-8c22-5f68cffa88b9 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.163s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:19:17 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c288aebf-e6c6-404c-8c22-5f68cffa88b9 tempest-VolumesSnapshotTestJSON-434051366 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:19:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1529534547',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeea561c-1b90-4f84-9a1b-f0337312a885,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ca15df84b5a40ef9bab2894e931f47a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:19:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:19:09Z,use_quota=True,user_id='6da3b5f34fc64db69b23ab368664ba14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:19:17 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-c288aebf-e6c6-404c-8c22-5f68cffa88b9 tempest-VolumesSnapshotTestJSON-434051366 None] Creating volume aeea561c-1b90-4f84-9a1b-f0337312a885 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:19:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c288aebf-e6c6-404c-8c22-5f68cffa88b9 tempest-VolumesSnapshotTestJSON-434051366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:19:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c288aebf-e6c6-404c-8c22-5f68cffa88b9 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:19:17 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c288aebf-e6c6-404c-8c22-5f68cffa88b9 tempest-VolumesSnapshotTestJSON-434051366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:19:17 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c288aebf-e6c6-404c-8c22-5f68cffa88b9 tempest-VolumesSnapshotTestJSON-434051366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:19:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c288aebf-e6c6-404c-8c22-5f68cffa88b9 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:19:17 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c288aebf-e6c6-404c-8c22-5f68cffa88b9 tempest-VolumesSnapshotTestJSON-434051366 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:19:17 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-c288aebf-e6c6-404c-8c22-5f68cffa88b9 tempest-VolumesSnapshotTestJSON-434051366 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:19:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c288aebf-e6c6-404c-8c22-5f68cffa88b9 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:17 devstack sudo[99737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885 1073741824
Nov 04 12:19:17 devstack sudo[99737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:17 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-022b5607-bfb3-4557-92d4-3cf3082f18b9 tempest-GroupsV314Test-1176320581 None] Create group from source-group-1ac0ba05-7434-4f13-8e29-40271eb81d0e completed successfully.
Nov 04 12:19:18 devstack sudo[99737]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c288aebf-e6c6-404c-8c22-5f68cffa88b9 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885 1073741824" returned: 0 in 0.516s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c288aebf-e6c6-404c-8c22-5f68cffa88b9 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:18 devstack sudo[99743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885
Nov 04 12:19:18 devstack sudo[99743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:18 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-cd62f8f1-331d-48c8-bceb-a2b295170f8f tempest-GroupsV314Test-1176320581 None] Acquiring lock "cinder-quobyte-2eff6469-4d9d-4b93-9ded-b4442a8fde2b" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:19:18 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-cd62f8f1-331d-48c8-bceb-a2b295170f8f tempest-GroupsV314Test-1176320581 None] Lock "cinder-quobyte-2eff6469-4d9d-4b93-9ded-b4442a8fde2b" acquired by "delete_volume" :: waited 0.022s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:19:18 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[325dedfc-710a-4b77-be9f-157b43b5de4b]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:19:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-cd62f8f1-331d-48c8-bceb-a2b295170f8f tempest-GroupsV314Test-1176320581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2eff6469-4d9d-4b93-9ded-b4442a8fde2b {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:18 devstack sudo[99743]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c288aebf-e6c6-404c-8c22-5f68cffa88b9 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885" returned: 0 in 0.322s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:18 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c288aebf-e6c6-404c-8c22-5f68cffa88b9 tempest-VolumesSnapshotTestJSON-434051366 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:19:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c288aebf-e6c6-404c-8c22-5f68cffa88b9 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:19:18 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c288aebf-e6c6-404c-8c22-5f68cffa88b9 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a12d68d-5603-427b-80ca-c250b375346d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeea561c-1b90-4f84-9a1b-f0337312a885', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:18 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c288aebf-e6c6-404c-8c22-5f68cffa88b9 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f109b10f-b177-4c10-9995-46b83dc3138d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:18 devstack sudo[99745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2eff6469-4d9d-4b93-9ded-b4442a8fde2b
Nov 04 12:19:18 devstack sudo[99745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:18 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-c288aebf-e6c6-404c-8c22-5f68cffa88b9 tempest-VolumesSnapshotTestJSON-434051366 None] Volume volume-aeea561c-1b90-4f84-9a1b-f0337312a885 (aeea561c-1b90-4f84-9a1b-f0337312a885): created successfully
Nov 04 12:19:18 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c288aebf-e6c6-404c-8c22-5f68cffa88b9 tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f109b10f-b177-4c10-9995-46b83dc3138d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:18 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c288aebf-e6c6-404c-8c22-5f68cffa88b9 tempest-VolumesSnapshotTestJSON-434051366 None] Flow 'volume_create_manager' (17f7bfe0-e55b-4763-b690-c438947ee153) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:19:18 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-c288aebf-e6c6-404c-8c22-5f68cffa88b9 tempest-VolumesSnapshotTestJSON-434051366 None] Created volume successfully.
Nov 04 12:19:19 devstack sudo[99745]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-cd62f8f1-331d-48c8-bceb-a2b295170f8f tempest-GroupsV314Test-1176320581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2eff6469-4d9d-4b93-9ded-b4442a8fde2b" returned: 0 in 0.403s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-cd62f8f1-331d-48c8-bceb-a2b295170f8f tempest-GroupsV314Test-1176320581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2eff6469-4d9d-4b93-9ded-b4442a8fde2b {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:19 devstack sudo[99751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2eff6469-4d9d-4b93-9ded-b4442a8fde2b
Nov 04 12:19:19 devstack sudo[99751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:19 devstack sudo[99751]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-cd62f8f1-331d-48c8-bceb-a2b295170f8f tempest-GroupsV314Test-1176320581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2eff6469-4d9d-4b93-9ded-b4442a8fde2b" returned: 0 in 0.255s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-cd62f8f1-331d-48c8-bceb-a2b295170f8f tempest-GroupsV314Test-1176320581 None] Lock "cinder-quobyte-2eff6469-4d9d-4b93-9ded-b4442a8fde2b" released by "delete_volume" :: held 0.728s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:19:19 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-cd62f8f1-331d-48c8-bceb-a2b295170f8f tempest-GroupsV314Test-1176320581 None] Created reservations ['b41b708b-8829-43c8-8bad-13079fa207c0'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:19:19 devstack cinder-volume[87169]: WARNING cinder.quota [None req-cd62f8f1-331d-48c8-bceb-a2b295170f8f tempest-GroupsV314Test-1176320581 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1060010381 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1060010381, it is now deprecated. Please use the default quota class for default quota.
Nov 04 12:19:19 devstack cinder-volume[87169]: WARNING cinder.quota [None req-cd62f8f1-331d-48c8-bceb-a2b295170f8f tempest-GroupsV314Test-1176320581 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1060010381 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1060010381, it is now deprecated. Please use the default quota class for default quota.
Nov 04 12:19:19 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-cd62f8f1-331d-48c8-bceb-a2b295170f8f tempest-GroupsV314Test-1176320581 None] Created reservations ['2f07f2c9-0bda-4503-8cfe-064bc59456e1', 'a5c3e93b-5eb3-452e-b907-d2fc4875d73f', '06d1d012-8706-427c-a5f1-d9ad544a76dc', '7e7c7e99-c846-44a4-ae15-662aaf2e9cec'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:19:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-cd62f8f1-331d-48c8-bceb-a2b295170f8f tempest-GroupsV314Test-1176320581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:19:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-cd62f8f1-331d-48c8-bceb-a2b295170f8f tempest-GroupsV314Test-1176320581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:19:19 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-cd62f8f1-331d-48c8-bceb-a2b295170f8f tempest-GroupsV314Test-1176320581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:19:19 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-cd62f8f1-331d-48c8-bceb-a2b295170f8f tempest-GroupsV314Test-1176320581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:19:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-cd62f8f1-331d-48c8-bceb-a2b295170f8f tempest-GroupsV314Test-1176320581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:19:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-cd62f8f1-331d-48c8-bceb-a2b295170f8f tempest-GroupsV314Test-1176320581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:19 devstack sudo[99754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:19:19 devstack sudo[99754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8293cdf2-89a5-4a42-af2a-87c4389d1d38 tempest-VolumesSnapshotTestJSON-434051366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:19:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8293cdf2-89a5-4a42-af2a-87c4389d1d38 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:19:19 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-8293cdf2-89a5-4a42-af2a-87c4389d1d38 tempest-VolumesSnapshotTestJSON-434051366 None] Creating offline snapshot 254f830a-8259-4f7a-a923-9d4c0c66e02b of volume aeea561c-1b90-4f84-9a1b-f0337312a885 {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:19:19 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab7d0429-a181-4719-b4f1-1dd48bce6915]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:19:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8293cdf2-89a5-4a42-af2a-87c4389d1d38 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:19 devstack sudo[99754]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-cd62f8f1-331d-48c8-bceb-a2b295170f8f tempest-GroupsV314Test-1176320581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.314s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:19 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-cd62f8f1-331d-48c8-bceb-a2b295170f8f tempest-GroupsV314Test-1176320581 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:19:19 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-cd62f8f1-331d-48c8-bceb-a2b295170f8f tempest-GroupsV314Test-1176320581 None] Delete group completed successfully.
Nov 04 12:19:19 devstack sudo[99757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885
Nov 04 12:19:19 devstack sudo[99757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-4d27c82b-ee27-468a-a586-29fd1382144b tempest-GroupsV314Test-1176320581 None] Acquiring lock "cinder-quobyte-ebc9d34e-6368-4236-9384-74c16b4112bf" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:19:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-4d27c82b-ee27-468a-a586-29fd1382144b tempest-GroupsV314Test-1176320581 None] Lock "cinder-quobyte-ebc9d34e-6368-4236-9384-74c16b4112bf" acquired by "delete_volume" :: waited 0.029s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:19:20 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[9171ee6d-f68c-4702-a5a8-5c09dc3d1609]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:19:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4d27c82b-ee27-468a-a586-29fd1382144b tempest-GroupsV314Test-1176320581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:20 devstack sudo[99757]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8293cdf2-89a5-4a42-af2a-87c4389d1d38 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885" returned: 0 in 0.430s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8293cdf2-89a5-4a42-af2a-87c4389d1d38 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885.254f830a-8259-4f7a-a923-9d4c0c66e02b 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:20 devstack sudo[99763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885.254f830a-8259-4f7a-a923-9d4c0c66e02b 1G
Nov 04 12:19:20 devstack sudo[99763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:20 devstack sudo[99761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf
Nov 04 12:19:20 devstack sudo[99761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:20 devstack sudo[99761]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4d27c82b-ee27-468a-a586-29fd1382144b tempest-GroupsV314Test-1176320581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf" returned: 0 in 0.428s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4d27c82b-ee27-468a-a586-29fd1382144b tempest-GroupsV314Test-1176320581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:20 devstack sudo[99774]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf
Nov 04 12:19:20 devstack sudo[99774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:20 devstack sudo[99763]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8293cdf2-89a5-4a42-af2a-87c4389d1d38 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885.254f830a-8259-4f7a-a923-9d4c0c66e02b 1G" returned: 0 in 0.492s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8293cdf2-89a5-4a42-af2a-87c4389d1d38 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeea561c-1b90-4f84-9a1b-f0337312a885 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885.254f830a-8259-4f7a-a923-9d4c0c66e02b {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:20 devstack sudo[99777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeea561c-1b90-4f84-9a1b-f0337312a885 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885.254f830a-8259-4f7a-a923-9d4c0c66e02b
Nov 04 12:19:20 devstack sudo[99777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:20 devstack sudo[99774]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4d27c82b-ee27-468a-a586-29fd1382144b tempest-GroupsV314Test-1176320581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ebc9d34e-6368-4236-9384-74c16b4112bf" returned: 0 in 0.282s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-4d27c82b-ee27-468a-a586-29fd1382144b tempest-GroupsV314Test-1176320581 None] Lock "cinder-quobyte-ebc9d34e-6368-4236-9384-74c16b4112bf" released by "delete_volume" :: held 0.782s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:19:20 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-4d27c82b-ee27-468a-a586-29fd1382144b tempest-GroupsV314Test-1176320581 None] Created reservations ['23269953-02d8-4260-a7cd-618a4f58eafe'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:19:21 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-4d27c82b-ee27-468a-a586-29fd1382144b tempest-GroupsV314Test-1176320581 None] Created reservations ['1b4bd973-a422-494c-9e7a-3f3d84f14cd1', 'aa236d5d-f676-428e-a62f-8ba39b534f3b', '24990c33-2e00-417c-8f69-d70aa51c8f76', '5dc8364c-4098-4d2e-a2cd-eac3ff5a5abc'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:19:21 devstack sudo[99777]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8293cdf2-89a5-4a42-af2a-87c4389d1d38 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aeea561c-1b90-4f84-9a1b-f0337312a885 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885.254f830a-8259-4f7a-a923-9d4c0c66e02b" returned: 0 in 0.326s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:21 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-8293cdf2-89a5-4a42-af2a-87c4389d1d38 tempest-VolumesSnapshotTestJSON-434051366 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885.254f830a-8259-4f7a-a923-9d4c0c66e02b is being set with open permissions: ugo+rw
Nov 04 12:19:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8293cdf2-89a5-4a42-af2a-87c4389d1d38 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885.254f830a-8259-4f7a-a923-9d4c0c66e02b {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:21 devstack sudo[99786]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885.254f830a-8259-4f7a-a923-9d4c0c66e02b
Nov 04 12:19:21 devstack sudo[99786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-4d27c82b-ee27-468a-a586-29fd1382144b tempest-GroupsV314Test-1176320581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:19:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-4d27c82b-ee27-468a-a586-29fd1382144b tempest-GroupsV314Test-1176320581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:19:21 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-4d27c82b-ee27-468a-a586-29fd1382144b tempest-GroupsV314Test-1176320581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:19:21 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-4d27c82b-ee27-468a-a586-29fd1382144b tempest-GroupsV314Test-1176320581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:19:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-4d27c82b-ee27-468a-a586-29fd1382144b tempest-GroupsV314Test-1176320581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:19:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4d27c82b-ee27-468a-a586-29fd1382144b tempest-GroupsV314Test-1176320581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:21 devstack sudo[99788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:19:21 devstack sudo[99788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:21 devstack sudo[99786]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8293cdf2-89a5-4a42-af2a-87c4389d1d38 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885.254f830a-8259-4f7a-a923-9d4c0c66e02b" returned: 0 in 0.281s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8293cdf2-89a5-4a42-af2a-87c4389d1d38 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:21 devstack sudo[99791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885.info
Nov 04 12:19:21 devstack sudo[99791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:21 devstack sudo[99788]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4d27c82b-ee27-468a-a586-29fd1382144b tempest-GroupsV314Test-1176320581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.348s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:21 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-4d27c82b-ee27-468a-a586-29fd1382144b tempest-GroupsV314Test-1176320581 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:19:21 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-4d27c82b-ee27-468a-a586-29fd1382144b tempest-GroupsV314Test-1176320581 None] Delete group completed successfully.
Nov 04 12:19:21 devstack sudo[99791]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8293cdf2-89a5-4a42-af2a-87c4389d1d38 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885.info" returned: 0 in 0.345s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:21 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-8293cdf2-89a5-4a42-af2a-87c4389d1d38 tempest-VolumesSnapshotTestJSON-434051366 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885.info is being set with open permissions: ugo+rw
Nov 04 12:19:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8293cdf2-89a5-4a42-af2a-87c4389d1d38 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:21 devstack sudo[99795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885.info
Nov 04 12:19:21 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:22 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8293cdf2-89a5-4a42-af2a-87c4389d1d38 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885.info" returned: 0 in 0.272s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8293cdf2-89a5-4a42-af2a-87c4389d1d38 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.286s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:19:22 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-8293cdf2-89a5-4a42-af2a-87c4389d1d38 tempest-VolumesSnapshotTestJSON-434051366 None] Create snapshot completed successfully
Nov 04 12:19:23 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:19:23 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Flow 'volume_create_manager' (708c55f2-bc35-426e-9ddd-6b34ba8d1b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:19:23 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f5c4cb-0e2f-411d-aa2e-ab6315db21c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:23 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f5c4cb-0e2f-411d-aa2e-ab6315db21c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1561884433',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae85635d-1207-4c61-a271-a883b7e51596,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ca15df84b5a40ef9bab2894e931f47a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=254f830a-8259-4f7a-a923-9d4c0c66e02b,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:19:24Z,use_quota=True,user_id='6da3b5f34fc64db69b23ab368664ba14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:23 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13b22a2b-5b5f-4393-beaa-6bac2276fc61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:23 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13b22a2b-5b5f-4393-beaa-6bac2276fc61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:23 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (625c91f5-171c-4ebd-a723-fb73dec5b3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:23 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (625c91f5-171c-4ebd-a723-fb73dec5b3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ae85635d-1207-4c61-a271-a883b7e51596', 'volume_name': 'volume-ae85635d-1207-4c61-a271-a883b7e51596', 'volume_size': 1, 'snapshot_id': '254f830a-8259-4f7a-a923-9d4c0c66e02b'}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:23 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11744234-9d00-4e15-ae94-61995bf2a330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:23 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11744234-9d00-4e15-ae94-61995bf2a330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:23 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c323304-fd9e-4991-81c5-3d0626eb9e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:23 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Volume ae85635d-1207-4c61-a271-a883b7e51596: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ae85635d-1207-4c61-a271-a883b7e51596', 'volume_size': 1, 'snapshot_id': '254f830a-8259-4f7a-a923-9d4c0c66e02b'}
Nov 04 12:19:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:19:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:19:23 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Acquiring lock "cinder-quobyte-254f830a-8259-4f7a-a923-9d4c0c66e02b-ae85635d-1207-4c61-a271-a883b7e51596" by "_create_volume_from_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:19:23 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Lock "cinder-quobyte-254f830a-8259-4f7a-a923-9d4c0c66e02b-ae85635d-1207-4c61-a271-a883b7e51596" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:19:23 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Creating volume ae85635d-1207-4c61-a271-a883b7e51596 from snapshot 254f830a-8259-4f7a-a923-9d4c0c66e02b {{(pid=87169) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 04 12:19:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:19:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:19:23 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:19:23 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:19:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:19:23 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:19:23 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Acquiring lock "cinder-quobyte-ae85635d-1207-4c61-a271-a883b7e51596" by "_copy_volume_from_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:19:23 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Lock "cinder-quobyte-ae85635d-1207-4c61-a271-a883b7e51596" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:19:23 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] snapshot: 254f830a-8259-4f7a-a923-9d4c0c66e02b, volume: ae85635d-1207-4c61-a271-a883b7e51596,  {{(pid=87169) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 04 12:19:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:19:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:19:23 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:19:23 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:19:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:19:23 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f2dd1c-f490-45cf-90f0-a25739ff8611]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:19:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885.254f830a-8259-4f7a-a923-9d4c0c66e02b {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:23 devstack sudo[99799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885.254f830a-8259-4f7a-a923-9d4c0c66e02b
Nov 04 12:19:23 devstack sudo[99799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:24 devstack sudo[99799]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885.254f830a-8259-4f7a-a923-9d4c0c66e02b" returned: 0 in 0.446s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:24 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aeea561c-1b90-4f84-9a1b-f0337312a885(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:19:24 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[914cba4e-7a2a-4259-ab7f-ec78276cb98c]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:19:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:24 devstack sudo[99804]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885
Nov 04 12:19:24 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:24 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885" returned: 0 in 0.436s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:24 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885 {{(pid=87169) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 04 12:19:24 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Creating direct copy from snapshot {{(pid=87169) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 04 12:19:24 devstack cinder-volume[87169]: DEBUG cinder.utils [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Path /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ae85635d-1207-4c61-a271-a883b7e51596 not found in is_blk_device check {{(pid=87169) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 04 12:19:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ae85635d-1207-4c61-a271-a883b7e51596 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:24 devstack sudo[99810]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ae85635d-1207-4c61-a271-a883b7e51596
Nov 04 12:19:24 devstack sudo[99810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:31 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:UPDATE=159,cinder:SELECT=158,cinder:INSERT=39,cinder:DELETE=10 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:19:31 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ca3bd56-1bb7-4446-a06d-61429cc63967 tempest-VolumeQuotasAdminTestJSON-443004514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:19:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7ca3bd56-1bb7-4446-a06d-61429cc63967 tempest-VolumeQuotasAdminTestJSON-443004514 None] Flow 'volume_create_manager' (0c2b6b80-779e-4091-9e6a-4e3e0cf5179b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:19:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7ca3bd56-1bb7-4446-a06d-61429cc63967 tempest-VolumeQuotasAdminTestJSON-443004514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef7d9c76-31a4-4d8a-bc07-1a317524c3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7ca3bd56-1bb7-4446-a06d-61429cc63967 tempest-VolumeQuotasAdminTestJSON-443004514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef7d9c76-31a4-4d8a-bc07-1a317524c3f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1869952369',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eba2fa02-bf97-4df6-907a-e7e538ec6848,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa3413cf68b0401abee154cb6fd4f01b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:19:32Z,use_quota=True,user_id='ac7f3330e1fe41968d180db3ccd22f92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7ca3bd56-1bb7-4446-a06d-61429cc63967 tempest-VolumeQuotasAdminTestJSON-443004514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f9845ac-4731-4533-8f38-3087697c3ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7ca3bd56-1bb7-4446-a06d-61429cc63967 tempest-VolumeQuotasAdminTestJSON-443004514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f9845ac-4731-4533-8f38-3087697c3ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7ca3bd56-1bb7-4446-a06d-61429cc63967 tempest-VolumeQuotasAdminTestJSON-443004514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79a40f1a-6e87-458e-a0ff-18601a8e4376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7ca3bd56-1bb7-4446-a06d-61429cc63967 tempest-VolumeQuotasAdminTestJSON-443004514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79a40f1a-6e87-458e-a0ff-18601a8e4376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eba2fa02-bf97-4df6-907a-e7e538ec6848', 'volume_name': 'volume-eba2fa02-bf97-4df6-907a-e7e538ec6848', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7ca3bd56-1bb7-4446-a06d-61429cc63967 tempest-VolumeQuotasAdminTestJSON-443004514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b30cdfe-ab03-4853-b7cb-315fc8cc0ba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7ca3bd56-1bb7-4446-a06d-61429cc63967 tempest-VolumeQuotasAdminTestJSON-443004514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b30cdfe-ab03-4853-b7cb-315fc8cc0ba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7ca3bd56-1bb7-4446-a06d-61429cc63967 tempest-VolumeQuotasAdminTestJSON-443004514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfdcb648-66c9-4328-a2a5-d051946071fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:31 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-7ca3bd56-1bb7-4446-a06d-61429cc63967 tempest-VolumeQuotasAdminTestJSON-443004514 None] Volume eba2fa02-bf97-4df6-907a-e7e538ec6848: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eba2fa02-bf97-4df6-907a-e7e538ec6848', 'volume_size': 1}
Nov 04 12:19:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7ca3bd56-1bb7-4446-a06d-61429cc63967 tempest-VolumeQuotasAdminTestJSON-443004514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:19:32 devstack sudo[99810]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ae85635d-1207-4c61-a271-a883b7e51596" returned: 0 in 7.925s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:32 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Image conversion details: src /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885, size 1024.00 MB, duration 7.93 sec, destination /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ae85635d-1207-4c61-a271-a883b7e51596 {{(pid=87169) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 12:19:32 devstack cinder-volume[87169]: INFO cinder.image.image_utils [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Converted 1024.00 MB image at 129.20 MB/s
Nov 04 12:19:32 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ae85635d-1207-4c61-a271-a883b7e51596 is being set with open permissions: ugo+rw
Nov 04 12:19:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ae85635d-1207-4c61-a271-a883b7e51596 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:32 devstack sudo[99866]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ae85635d-1207-4c61-a271-a883b7e51596
Nov 04 12:19:32 devstack sudo[99866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:32 devstack sudo[99866]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ae85635d-1207-4c61-a271-a883b7e51596" returned: 0 in 0.255s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:32 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Lock "cinder-quobyte-ae85635d-1207-4c61-a271-a883b7e51596" released by "_copy_volume_from_snapshot" :: held 9.168s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:19:32 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Lock "cinder-quobyte-254f830a-8259-4f7a-a923-9d4c0c66e02b-ae85635d-1207-4c61-a271-a883b7e51596" released by "_create_volume_from_snapshot" :: held 9.239s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:19:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.267s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:19:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7ca3bd56-1bb7-4446-a06d-61429cc63967 tempest-VolumeQuotasAdminTestJSON-443004514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.022s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:19:32 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-7ca3bd56-1bb7-4446-a06d-61429cc63967 tempest-VolumeQuotasAdminTestJSON-443004514 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:19:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1869952369',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eba2fa02-bf97-4df6-907a-e7e538ec6848,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa3413cf68b0401abee154cb6fd4f01b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:19:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:19:32Z,use_quota=True,user_id='ac7f3330e1fe41968d180db3ccd22f92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:19:32 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-7ca3bd56-1bb7-4446-a06d-61429cc63967 tempest-VolumeQuotasAdminTestJSON-443004514 None] Creating volume eba2fa02-bf97-4df6-907a-e7e538ec6848 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:19:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7ca3bd56-1bb7-4446-a06d-61429cc63967 tempest-VolumeQuotasAdminTestJSON-443004514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:19:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7ca3bd56-1bb7-4446-a06d-61429cc63967 tempest-VolumeQuotasAdminTestJSON-443004514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:19:32 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-7ca3bd56-1bb7-4446-a06d-61429cc63967 tempest-VolumeQuotasAdminTestJSON-443004514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:19:32 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-7ca3bd56-1bb7-4446-a06d-61429cc63967 tempest-VolumeQuotasAdminTestJSON-443004514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:19:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7ca3bd56-1bb7-4446-a06d-61429cc63967 tempest-VolumeQuotasAdminTestJSON-443004514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:19:32 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-7ca3bd56-1bb7-4446-a06d-61429cc63967 tempest-VolumeQuotasAdminTestJSON-443004514 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:19:32 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-7ca3bd56-1bb7-4446-a06d-61429cc63967 tempest-VolumeQuotasAdminTestJSON-443004514 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:19:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7ca3bd56-1bb7-4446-a06d-61429cc63967 tempest-VolumeQuotasAdminTestJSON-443004514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-eba2fa02-bf97-4df6-907a-e7e538ec6848 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:33 devstack sudo[99869]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-eba2fa02-bf97-4df6-907a-e7e538ec6848 1073741824
Nov 04 12:19:33 devstack sudo[99869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:33 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c323304-fd9e-4991-81c5-3d0626eb9e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae85635d-1207-4c61-a271-a883b7e51596', 'volume_size': 1, 'snapshot_id': '254f830a-8259-4f7a-a923-9d4c0c66e02b'}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:33 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd5c3772-105a-41e0-b9bf-6dd75f5afc1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:33 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Volume volume-ae85635d-1207-4c61-a271-a883b7e51596 (ae85635d-1207-4c61-a271-a883b7e51596): created successfully
Nov 04 12:19:33 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd5c3772-105a-41e0-b9bf-6dd75f5afc1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:33 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Flow 'volume_create_manager' (708c55f2-bc35-426e-9ddd-6b34ba8d1b8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:19:33 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-798377b6-0f63-42af-a9d2-555e51eb2c0a tempest-VolumesSnapshotTestJSON-434051366 None] Created volume successfully.
Nov 04 12:19:33 devstack sudo[99869]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7ca3bd56-1bb7-4446-a06d-61429cc63967 tempest-VolumeQuotasAdminTestJSON-443004514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-eba2fa02-bf97-4df6-907a-e7e538ec6848 1073741824" returned: 0 in 0.485s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7ca3bd56-1bb7-4446-a06d-61429cc63967 tempest-VolumeQuotasAdminTestJSON-443004514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-eba2fa02-bf97-4df6-907a-e7e538ec6848 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:33 devstack sudo[99875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-eba2fa02-bf97-4df6-907a-e7e538ec6848
Nov 04 12:19:33 devstack sudo[99875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:33 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ee31539b-d454-4598-b4bc-93e7fa218ec2 tempest-VolumesSnapshotTestJSON-434051366 None] Acquiring lock "cinder-ae85635d-1207-4c61-a271-a883b7e51596-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:19:33 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ee31539b-d454-4598-b4bc-93e7fa218ec2 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "cinder-ae85635d-1207-4c61-a271-a883b7e51596-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:19:33 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ee31539b-d454-4598-b4bc-93e7fa218ec2 tempest-VolumesSnapshotTestJSON-434051366 None] Acquiring lock "cinder-quobyte-ae85635d-1207-4c61-a271-a883b7e51596" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:19:33 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ee31539b-d454-4598-b4bc-93e7fa218ec2 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "cinder-quobyte-ae85635d-1207-4c61-a271-a883b7e51596" acquired by "delete_volume" :: waited 0.028s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:19:33 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[30665d29-2142-489d-8a4d-0b46ae6d4b9e]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:19:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ee31539b-d454-4598-b4bc-93e7fa218ec2 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ae85635d-1207-4c61-a271-a883b7e51596 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:33 devstack sudo[99875]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7ca3bd56-1bb7-4446-a06d-61429cc63967 tempest-VolumeQuotasAdminTestJSON-443004514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-eba2fa02-bf97-4df6-907a-e7e538ec6848" returned: 0 in 0.321s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:33 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-7ca3bd56-1bb7-4446-a06d-61429cc63967 tempest-VolumeQuotasAdminTestJSON-443004514 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:19:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7ca3bd56-1bb7-4446-a06d-61429cc63967 tempest-VolumeQuotasAdminTestJSON-443004514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:19:33 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7ca3bd56-1bb7-4446-a06d-61429cc63967 tempest-VolumeQuotasAdminTestJSON-443004514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dfdcb648-66c9-4328-a2a5-d051946071fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eba2fa02-bf97-4df6-907a-e7e538ec6848', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:33 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7ca3bd56-1bb7-4446-a06d-61429cc63967 tempest-VolumeQuotasAdminTestJSON-443004514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c615b16d-782f-4487-9324-f3abb8d4c49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:33 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-7ca3bd56-1bb7-4446-a06d-61429cc63967 tempest-VolumeQuotasAdminTestJSON-443004514 None] Volume volume-eba2fa02-bf97-4df6-907a-e7e538ec6848 (eba2fa02-bf97-4df6-907a-e7e538ec6848): created successfully
Nov 04 12:19:33 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7ca3bd56-1bb7-4446-a06d-61429cc63967 tempest-VolumeQuotasAdminTestJSON-443004514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c615b16d-782f-4487-9324-f3abb8d4c49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:33 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7ca3bd56-1bb7-4446-a06d-61429cc63967 tempest-VolumeQuotasAdminTestJSON-443004514 None] Flow 'volume_create_manager' (0c2b6b80-779e-4091-9e6a-4e3e0cf5179b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:19:33 devstack sudo[99877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ae85635d-1207-4c61-a271-a883b7e51596
Nov 04 12:19:33 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:33 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-7ca3bd56-1bb7-4446-a06d-61429cc63967 tempest-VolumeQuotasAdminTestJSON-443004514 None] Created volume successfully.
Nov 04 12:19:34 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ee31539b-d454-4598-b4bc-93e7fa218ec2 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ae85635d-1207-4c61-a271-a883b7e51596" returned: 0 in 0.370s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ee31539b-d454-4598-b4bc-93e7fa218ec2 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ae85635d-1207-4c61-a271-a883b7e51596 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:34 devstack sudo[99883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ae85635d-1207-4c61-a271-a883b7e51596
Nov 04 12:19:34 devstack sudo[99883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:34 devstack sudo[99883]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ee31539b-d454-4598-b4bc-93e7fa218ec2 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ae85635d-1207-4c61-a271-a883b7e51596" returned: 0 in 0.245s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:34 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ee31539b-d454-4598-b4bc-93e7fa218ec2 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "cinder-quobyte-ae85635d-1207-4c61-a271-a883b7e51596" released by "delete_volume" :: held 0.672s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:19:34 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-ee31539b-d454-4598-b4bc-93e7fa218ec2 tempest-VolumesSnapshotTestJSON-434051366 None] Created reservations ['6300ecbe-d902-493c-b723-14747654ba7b', '052383f7-60dd-4388-86f5-b739e9b379a0', '1aa74dfa-1ad3-4c01-ac10-36dd3f67c9ee', '9c55e63d-2d14-4595-b4ad-e226e51c2e6a'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:19:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ee31539b-d454-4598-b4bc-93e7fa218ec2 tempest-VolumesSnapshotTestJSON-434051366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:19:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ee31539b-d454-4598-b4bc-93e7fa218ec2 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:19:34 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ee31539b-d454-4598-b4bc-93e7fa218ec2 tempest-VolumesSnapshotTestJSON-434051366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:19:34 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ee31539b-d454-4598-b4bc-93e7fa218ec2 tempest-VolumesSnapshotTestJSON-434051366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:19:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ee31539b-d454-4598-b4bc-93e7fa218ec2 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:19:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ee31539b-d454-4598-b4bc-93e7fa218ec2 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:34 devstack sudo[99886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:19:34 devstack sudo[99886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:34 devstack sudo[99886]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ee31539b-d454-4598-b4bc-93e7fa218ec2 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.273s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:34 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-ee31539b-d454-4598-b4bc-93e7fa218ec2 tempest-VolumesSnapshotTestJSON-434051366 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:19:34 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-ee31539b-d454-4598-b4bc-93e7fa218ec2 tempest-VolumesSnapshotTestJSON-434051366 None] Deleted volume successfully.
Nov 04 12:19:34 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ee31539b-d454-4598-b4bc-93e7fa218ec2 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "cinder-ae85635d-1207-4c61-a271-a883b7e51596-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:19:34 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-dc683264-4e1d-48d3-9953-3f2055f105bc tempest-VolumesSnapshotTestJSON-434051366 None] Acquiring lock "cinder-254f830a-8259-4f7a-a923-9d4c0c66e02b-delete_snapshot" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:19:34 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-dc683264-4e1d-48d3-9953-3f2055f105bc tempest-VolumesSnapshotTestJSON-434051366 None] Lock "cinder-254f830a-8259-4f7a-a923-9d4c0c66e02b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:19:34 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-dc683264-4e1d-48d3-9953-3f2055f105bc tempest-VolumesSnapshotTestJSON-434051366 None] Acquiring lock "cinder-quobyte-aeea561c-1b90-4f84-9a1b-f0337312a885" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:19:34 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-dc683264-4e1d-48d3-9953-3f2055f105bc tempest-VolumesSnapshotTestJSON-434051366 None] Lock "cinder-quobyte-aeea561c-1b90-4f84-9a1b-f0337312a885" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:19:34 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-dc683264-4e1d-48d3-9953-3f2055f105bc tempest-VolumesSnapshotTestJSON-434051366 None] Acquiring lock "cinder-quobyte-254f830a-8259-4f7a-a923-9d4c0c66e02b" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:19:34 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-dc683264-4e1d-48d3-9953-3f2055f105bc tempest-VolumesSnapshotTestJSON-434051366 None] Lock "cinder-quobyte-254f830a-8259-4f7a-a923-9d4c0c66e02b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:19:34 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-dc683264-4e1d-48d3-9953-3f2055f105bc tempest-VolumesSnapshotTestJSON-434051366 None] Deleting offline snapshot 254f830a-8259-4f7a-a923-9d4c0c66e02b of volume aeea561c-1b90-4f84-9a1b-f0337312a885 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:19:34 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-dc683264-4e1d-48d3-9953-3f2055f105bc tempest-VolumesSnapshotTestJSON-434051366 None] snapshot_file for this snap is: volume-aeea561c-1b90-4f84-9a1b-f0337312a885.254f830a-8259-4f7a-a923-9d4c0c66e02b {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:19:34 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[146db2ff-1260-411a-a652-23b455074454]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:19:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dc683264-4e1d-48d3-9953-3f2055f105bc tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885.254f830a-8259-4f7a-a923-9d4c0c66e02b {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:35 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-7f13f0c1-abd0-414b-a2ba-9930b724dd31 tempest-VolumeQuotasAdminTestJSON-443004514 None] Acquiring lock "cinder-eba2fa02-bf97-4df6-907a-e7e538ec6848-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:19:35 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-7f13f0c1-abd0-414b-a2ba-9930b724dd31 tempest-VolumeQuotasAdminTestJSON-443004514 None] Lock "cinder-eba2fa02-bf97-4df6-907a-e7e538ec6848-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:19:35 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-7f13f0c1-abd0-414b-a2ba-9930b724dd31 tempest-VolumeQuotasAdminTestJSON-443004514 None] Acquiring lock "cinder-quobyte-eba2fa02-bf97-4df6-907a-e7e538ec6848" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:19:35 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-7f13f0c1-abd0-414b-a2ba-9930b724dd31 tempest-VolumeQuotasAdminTestJSON-443004514 None] Lock "cinder-quobyte-eba2fa02-bf97-4df6-907a-e7e538ec6848" acquired by "delete_volume" :: waited 0.017s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:19:35 devstack sudo[99889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885.254f830a-8259-4f7a-a923-9d4c0c66e02b
Nov 04 12:19:35 devstack sudo[99889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:35 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6c3a1a-3b3c-4538-975a-2654e0cd3625]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:19:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7f13f0c1-abd0-414b-a2ba-9930b724dd31 tempest-VolumeQuotasAdminTestJSON-443004514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-eba2fa02-bf97-4df6-907a-e7e538ec6848 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:35 devstack sudo[99891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-eba2fa02-bf97-4df6-907a-e7e538ec6848
Nov 04 12:19:35 devstack sudo[99891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:35 devstack sudo[99889]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dc683264-4e1d-48d3-9953-3f2055f105bc tempest-VolumesSnapshotTestJSON-434051366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885.254f830a-8259-4f7a-a923-9d4c0c66e02b" returned: 0 in 0.417s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:35 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-dc683264-4e1d-48d3-9953-3f2055f105bc tempest-VolumesSnapshotTestJSON-434051366 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aeea561c-1b90-4f84-9a1b-f0337312a885(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:19:35 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76a10ed-8867-4fc0-b0cc-8fa205d701a4]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:19:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dc683264-4e1d-48d3-9953-3f2055f105bc tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:35 devstack sudo[99891]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7f13f0c1-abd0-414b-a2ba-9930b724dd31 tempest-VolumeQuotasAdminTestJSON-443004514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-eba2fa02-bf97-4df6-907a-e7e538ec6848" returned: 0 in 0.407s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7f13f0c1-abd0-414b-a2ba-9930b724dd31 tempest-VolumeQuotasAdminTestJSON-443004514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-eba2fa02-bf97-4df6-907a-e7e538ec6848 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:35 devstack sudo[99897]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885
Nov 04 12:19:35 devstack sudo[99897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:35 devstack sudo[99900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-eba2fa02-bf97-4df6-907a-e7e538ec6848
Nov 04 12:19:35 devstack sudo[99900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:35 devstack sudo[99900]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7f13f0c1-abd0-414b-a2ba-9930b724dd31 tempest-VolumeQuotasAdminTestJSON-443004514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-eba2fa02-bf97-4df6-907a-e7e538ec6848" returned: 0 in 0.275s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:35 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-7f13f0c1-abd0-414b-a2ba-9930b724dd31 tempest-VolumeQuotasAdminTestJSON-443004514 None] Lock "cinder-quobyte-eba2fa02-bf97-4df6-907a-e7e538ec6848" released by "delete_volume" :: held 0.734s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:19:35 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-7f13f0c1-abd0-414b-a2ba-9930b724dd31 tempest-VolumeQuotasAdminTestJSON-443004514 None] Created reservations ['f9080cae-a3ab-49df-a32e-b5b62e22b730', 'f843bac6-e532-48b7-b2dc-8c86d4cf627f', '16e483f2-eeae-4997-86ec-ca38a75af9d3', '60b953f7-13eb-41eb-82d2-c14c357422ef'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:19:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7f13f0c1-abd0-414b-a2ba-9930b724dd31 tempest-VolumeQuotasAdminTestJSON-443004514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:19:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7f13f0c1-abd0-414b-a2ba-9930b724dd31 tempest-VolumeQuotasAdminTestJSON-443004514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:19:35 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-7f13f0c1-abd0-414b-a2ba-9930b724dd31 tempest-VolumeQuotasAdminTestJSON-443004514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:19:35 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-7f13f0c1-abd0-414b-a2ba-9930b724dd31 tempest-VolumeQuotasAdminTestJSON-443004514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:19:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7f13f0c1-abd0-414b-a2ba-9930b724dd31 tempest-VolumeQuotasAdminTestJSON-443004514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:19:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7f13f0c1-abd0-414b-a2ba-9930b724dd31 tempest-VolumeQuotasAdminTestJSON-443004514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:36 devstack sudo[99907]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:19:36 devstack sudo[99907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:36 devstack sudo[99897]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dc683264-4e1d-48d3-9953-3f2055f105bc tempest-VolumesSnapshotTestJSON-434051366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885" returned: 0 in 0.591s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dc683264-4e1d-48d3-9953-3f2055f105bc tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885.254f830a-8259-4f7a-a923-9d4c0c66e02b {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:36 devstack sudo[99909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885.254f830a-8259-4f7a-a923-9d4c0c66e02b
Nov 04 12:19:36 devstack sudo[99909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:36 devstack sudo[99907]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7f13f0c1-abd0-414b-a2ba-9930b724dd31 tempest-VolumeQuotasAdminTestJSON-443004514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.293s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:36 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-7f13f0c1-abd0-414b-a2ba-9930b724dd31 tempest-VolumeQuotasAdminTestJSON-443004514 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:19:36 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-7f13f0c1-abd0-414b-a2ba-9930b724dd31 tempest-VolumeQuotasAdminTestJSON-443004514 None] Deleted volume successfully.
Nov 04 12:19:36 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-7f13f0c1-abd0-414b-a2ba-9930b724dd31 tempest-VolumeQuotasAdminTestJSON-443004514 None] Lock "cinder-eba2fa02-bf97-4df6-907a-e7e538ec6848-delete_volume" released by "delete_volume" :: held 1.282s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:19:36 devstack sudo[99909]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dc683264-4e1d-48d3-9953-3f2055f105bc tempest-VolumesSnapshotTestJSON-434051366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885.254f830a-8259-4f7a-a923-9d4c0c66e02b" returned: 0 in 0.439s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dc683264-4e1d-48d3-9953-3f2055f105bc tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885.254f830a-8259-4f7a-a923-9d4c0c66e02b {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:36 devstack sudo[99915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885.254f830a-8259-4f7a-a923-9d4c0c66e02b
Nov 04 12:19:36 devstack sudo[99915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:36 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:19:36 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Flow 'volume_create_manager' (d0d53e78-873f-463a-80cb-ba449adb010a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:19:36 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (968cd7d0-7c9b-4810-8de7-68141f4ced05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:36 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (968cd7d0-7c9b-4810-8de7-68141f4ced05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1641133936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0031ec30-639d-4563-86cb-bb6f72c40328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e0aeffe48c346b78f60ca2fd6f766b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:19:36Z,use_quota=True,user_id='7e71cb5436654f3dba7d69438f0ca36c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:36 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1925ce9-0526-4a8a-8c50-5f2c744b14a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:36 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1925ce9-0526-4a8a-8c50-5f2c744b14a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:36 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (101d9c4e-006e-4ab8-9016-82b0e02d1644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:36 devstack cinder-volume[87169]: DEBUG cinder.image.glance [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Creating Keystone auth plugin from conf {{(pid=87169) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 04 12:19:36 devstack sudo[99915]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dc683264-4e1d-48d3-9953-3f2055f105bc tempest-VolumesSnapshotTestJSON-434051366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885.254f830a-8259-4f7a-a923-9d4c0c66e02b" returned: 0 in 0.323s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:36 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-35e972d3-0190-4ee1-abf5-8d998ab28332 tempest-VolumeQuotasAdminTestJSON-443004514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:19:36 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-35e972d3-0190-4ee1-abf5-8d998ab28332 tempest-VolumeQuotasAdminTestJSON-443004514 None] Flow 'volume_create_manager' (5acff3b7-f23a-44a1-8456-7ce819e8e1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:19:36 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-35e972d3-0190-4ee1-abf5-8d998ab28332 tempest-VolumeQuotasAdminTestJSON-443004514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (594da6bf-ad95-40da-bb35-d5378654a988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:36 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-dc683264-4e1d-48d3-9953-3f2055f105bc tempest-VolumesSnapshotTestJSON-434051366 None] Lock "cinder-quobyte-254f830a-8259-4f7a-a923-9d4c0c66e02b" released by "_delete_snapshot" :: held 1.947s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:19:36 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-dc683264-4e1d-48d3-9953-3f2055f105bc tempest-VolumesSnapshotTestJSON-434051366 None] Lock "cinder-quobyte-aeea561c-1b90-4f84-9a1b-f0337312a885" released by "delete_snapshot" :: held 1.975s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:19:36 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-35e972d3-0190-4ee1-abf5-8d998ab28332 tempest-VolumeQuotasAdminTestJSON-443004514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (594da6bf-ad95-40da-bb35-d5378654a988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1718464007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e60ab88-9196-4119-8b40-7f64d6ebeb1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa3413cf68b0401abee154cb6fd4f01b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:19:37Z,use_quota=True,user_id='ac7f3330e1fe41968d180db3ccd22f92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:36 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-35e972d3-0190-4ee1-abf5-8d998ab28332 tempest-VolumeQuotasAdminTestJSON-443004514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e6cf1e5-4324-4fe4-8adb-d4c7cdfff9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:36 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-35e972d3-0190-4ee1-abf5-8d998ab28332 tempest-VolumeQuotasAdminTestJSON-443004514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e6cf1e5-4324-4fe4-8adb-d4c7cdfff9bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:36 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-35e972d3-0190-4ee1-abf5-8d998ab28332 tempest-VolumeQuotasAdminTestJSON-443004514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (408bd39e-4cd4-48c2-a1fd-fed595812722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:36 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-35e972d3-0190-4ee1-abf5-8d998ab28332 tempest-VolumeQuotasAdminTestJSON-443004514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (408bd39e-4cd4-48c2-a1fd-fed595812722) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e60ab88-9196-4119-8b40-7f64d6ebeb1c', 'volume_name': 'volume-0e60ab88-9196-4119-8b40-7f64d6ebeb1c', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:36 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-35e972d3-0190-4ee1-abf5-8d998ab28332 tempest-VolumeQuotasAdminTestJSON-443004514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8fd0668-7431-4a0f-9780-05804f99ff93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:36 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-35e972d3-0190-4ee1-abf5-8d998ab28332 tempest-VolumeQuotasAdminTestJSON-443004514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8fd0668-7431-4a0f-9780-05804f99ff93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:36 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-35e972d3-0190-4ee1-abf5-8d998ab28332 tempest-VolumeQuotasAdminTestJSON-443004514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e3cbe1a-9e7d-4ce0-bb53-c000ee6695bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:36 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-35e972d3-0190-4ee1-abf5-8d998ab28332 tempest-VolumeQuotasAdminTestJSON-443004514 None] Volume 0e60ab88-9196-4119-8b40-7f64d6ebeb1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e60ab88-9196-4119-8b40-7f64d6ebeb1c', 'volume_size': 1}
Nov 04 12:19:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-35e972d3-0190-4ee1-abf5-8d998ab28332 tempest-VolumeQuotasAdminTestJSON-443004514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:19:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-35e972d3-0190-4ee1-abf5-8d998ab28332 tempest-VolumeQuotasAdminTestJSON-443004514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:19:36 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-35e972d3-0190-4ee1-abf5-8d998ab28332 tempest-VolumeQuotasAdminTestJSON-443004514 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1718464007',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e60ab88-9196-4119-8b40-7f64d6ebeb1c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa3413cf68b0401abee154cb6fd4f01b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:19:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:19:37Z,use_quota=True,user_id='ac7f3330e1fe41968d180db3ccd22f92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:19:36 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-35e972d3-0190-4ee1-abf5-8d998ab28332 tempest-VolumeQuotasAdminTestJSON-443004514 None] Creating volume 0e60ab88-9196-4119-8b40-7f64d6ebeb1c {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:19:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-35e972d3-0190-4ee1-abf5-8d998ab28332 tempest-VolumeQuotasAdminTestJSON-443004514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:19:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-35e972d3-0190-4ee1-abf5-8d998ab28332 tempest-VolumeQuotasAdminTestJSON-443004514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:19:36 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-35e972d3-0190-4ee1-abf5-8d998ab28332 tempest-VolumeQuotasAdminTestJSON-443004514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:19:36 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-35e972d3-0190-4ee1-abf5-8d998ab28332 tempest-VolumeQuotasAdminTestJSON-443004514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:19:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-35e972d3-0190-4ee1-abf5-8d998ab28332 tempest-VolumeQuotasAdminTestJSON-443004514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:19:36 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-35e972d3-0190-4ee1-abf5-8d998ab28332 tempest-VolumeQuotasAdminTestJSON-443004514 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:19:36 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-35e972d3-0190-4ee1-abf5-8d998ab28332 tempest-VolumeQuotasAdminTestJSON-443004514 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:19:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-35e972d3-0190-4ee1-abf5-8d998ab28332 tempest-VolumeQuotasAdminTestJSON-443004514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0e60ab88-9196-4119-8b40-7f64d6ebeb1c 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (101d9c4e-006e-4ab8-9016-82b0e02d1644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0031ec30-639d-4563-86cb-bb6f72c40328', 'volume_name': 'volume-0031ec30-639d-4563-86cb-bb6f72c40328', 'volume_size': 1, 'image_id': '5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '52d49d1f3a4b47a8a8f060da8e0e2c02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'created_at': datetime.datetime(2026, 11, 4, 11, 3, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 3, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fd6a6ac-1614-4aa5-aedb-17a31996018d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cc0637501d0>}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:37 devstack sudo[99918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0e60ab88-9196-4119-8b40-7f64d6ebeb1c 1073741824
Nov 04 12:19:37 devstack sudo[99918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (399ada11-09c7-4fbc-8714-2cb63968290b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (399ada11-09c7-4fbc-8714-2cb63968290b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2381f52-68c8-4cee-9c8b-97d6d186d2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:37 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Volume 0031ec30-639d-4563-86cb-bb6f72c40328: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0031ec30-639d-4563-86cb-bb6f72c40328', 'volume_size': 1, 'image_id': '5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '52d49d1f3a4b47a8a8f060da8e0e2c02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'created_at': datetime.datetime(2026, 11, 4, 11, 3, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 3, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fd6a6ac-1614-4aa5-aedb-17a31996018d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cc0637501d0>}
Nov 04 12:19:37 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Trying to clone 0031ec30-639d-4563-86cb-bb6f72c40328 from image 5fd6a6ac-1614-4aa5-aedb-17a31996018d at location (None, [{'url': 'file:///opt/stack/data/glance/images/5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'metadata': {}}]). {{(pid=87169) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 04 12:19:37 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-dc683264-4e1d-48d3-9953-3f2055f105bc tempest-VolumesSnapshotTestJSON-434051366 None] Created reservations ['1ac43c4c-c9a3-49d8-9ae5-c49041930892', '595ae9c3-2bed-4ffa-9814-817be7d4296d', '71aad470-2f85-401f-bf7f-81e022f36593', 'ef46810c-1164-4db1-847b-5cff4ffd88b1'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:19:37 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-dc683264-4e1d-48d3-9953-3f2055f105bc tempest-VolumesSnapshotTestJSON-434051366 None] Delete snapshot completed successfully.
Nov 04 12:19:37 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-dc683264-4e1d-48d3-9953-3f2055f105bc tempest-VolumesSnapshotTestJSON-434051366 None] Lock "cinder-254f830a-8259-4f7a-a923-9d4c0c66e02b-delete_snapshot" released by "delete_snapshot" :: held 2.300s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:19:37 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_47mvyl0odevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87169) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 04 12:19:37 devstack cinder-volume[87169]: INFO cinder.image.image_utils [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Image download 20.69 MB at 20.69 MB/s
Nov 04 12:19:37 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bcc4af9-d691-444c-8b4f-2feaddf106fb]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:19:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_47mvyl0odevstack@QuobyteHD {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:37 devstack sudo[99918]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-35e972d3-0190-4ee1-abf5-8d998ab28332 tempest-VolumeQuotasAdminTestJSON-443004514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0e60ab88-9196-4119-8b40-7f64d6ebeb1c 1073741824" returned: 0 in 0.506s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-35e972d3-0190-4ee1-abf5-8d998ab28332 tempest-VolumeQuotasAdminTestJSON-443004514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0e60ab88-9196-4119-8b40-7f64d6ebeb1c {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:37 devstack sudo[99926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0e60ab88-9196-4119-8b40-7f64d6ebeb1c
Nov 04 12:19:37 devstack sudo[99926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:37 devstack sudo[99925]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_47mvyl0odevstack@QuobyteHD
Nov 04 12:19:37 devstack sudo[99925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:37 devstack sudo[99926]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-35e972d3-0190-4ee1-abf5-8d998ab28332 tempest-VolumeQuotasAdminTestJSON-443004514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0e60ab88-9196-4119-8b40-7f64d6ebeb1c" returned: 0 in 0.243s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:37 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-35e972d3-0190-4ee1-abf5-8d998ab28332 tempest-VolumeQuotasAdminTestJSON-443004514 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:19:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-35e972d3-0190-4ee1-abf5-8d998ab28332 tempest-VolumeQuotasAdminTestJSON-443004514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:19:37 devstack sudo[99925]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_47mvyl0odevstack@QuobyteHD" returned: 0 in 0.336s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:37 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Temporary image 5fd6a6ac-1614-4aa5-aedb-17a31996018d is fetched for user 7e71cb5436654f3dba7d69438f0ca36c. {{(pid=87169) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 04 12:19:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-35e972d3-0190-4ee1-abf5-8d998ab28332 tempest-VolumeQuotasAdminTestJSON-443004514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e3cbe1a-9e7d-4ce0-bb53-c000ee6695bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e60ab88-9196-4119-8b40-7f64d6ebeb1c', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-35e972d3-0190-4ee1-abf5-8d998ab28332 tempest-VolumeQuotasAdminTestJSON-443004514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8469c1d0-f7df-44a3-9023-87a3f3a421cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:37 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-35e972d3-0190-4ee1-abf5-8d998ab28332 tempest-VolumeQuotasAdminTestJSON-443004514 None] Volume volume-0e60ab88-9196-4119-8b40-7f64d6ebeb1c (0e60ab88-9196-4119-8b40-7f64d6ebeb1c): created successfully
Nov 04 12:19:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-35e972d3-0190-4ee1-abf5-8d998ab28332 tempest-VolumeQuotasAdminTestJSON-443004514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8469c1d0-f7df-44a3-9023-87a3f3a421cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-35e972d3-0190-4ee1-abf5-8d998ab28332 tempest-VolumeQuotasAdminTestJSON-443004514 None] Flow 'volume_create_manager' (5acff3b7-f23a-44a1-8456-7ce819e8e1cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:19:37 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-35e972d3-0190-4ee1-abf5-8d998ab28332 tempest-VolumeQuotasAdminTestJSON-443004514 None] Created volume successfully.
Nov 04 12:19:37 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4370ada-34f3-46ad-b3d0-20b57e8ab011]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:19:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_47mvyl0odevstack@QuobyteHD {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:37 devstack sudo[99933]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_47mvyl0odevstack@QuobyteHD
Nov 04 12:19:37 devstack sudo[99933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:38 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e5a207dd-2776-492d-95be-91dbf9eb5fb8 tempest-VolumesSnapshotTestJSON-434051366 None] Acquiring lock "cinder-aeea561c-1b90-4f84-9a1b-f0337312a885-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:19:38 devstack sudo[99933]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:38 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e5a207dd-2776-492d-95be-91dbf9eb5fb8 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "cinder-aeea561c-1b90-4f84-9a1b-f0337312a885-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:19:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_47mvyl0odevstack@QuobyteHD" returned: 0 in 0.328s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:19:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:19:38 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:19:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1641133936',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0031ec30-639d-4563-86cb-bb6f72c40328,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e0aeffe48c346b78f60ca2fd6f766b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:19:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:19:36Z,use_quota=True,user_id='7e71cb5436654f3dba7d69438f0ca36c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:19:38 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Creating volume 0031ec30-639d-4563-86cb-bb6f72c40328 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:19:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:19:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:19:38 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:19:38 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:19:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:19:38 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:19:38 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:19:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0031ec30-639d-4563-86cb-bb6f72c40328 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:38 devstack sudo[99939]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0031ec30-639d-4563-86cb-bb6f72c40328 1073741824
Nov 04 12:19:38 devstack sudo[99939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:38 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e5a207dd-2776-492d-95be-91dbf9eb5fb8 tempest-VolumesSnapshotTestJSON-434051366 None] Acquiring lock "cinder-quobyte-aeea561c-1b90-4f84-9a1b-f0337312a885" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:19:38 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e5a207dd-2776-492d-95be-91dbf9eb5fb8 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "cinder-quobyte-aeea561c-1b90-4f84-9a1b-f0337312a885" acquired by "delete_volume" :: waited 0.015s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:19:38 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[9587734d-525c-43d7-b713-3fd0b86f3ab2]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:19:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e5a207dd-2776-492d-95be-91dbf9eb5fb8 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:38 devstack sudo[99941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885
Nov 04 12:19:38 devstack sudo[99941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:38 devstack sudo[99939]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0031ec30-639d-4563-86cb-bb6f72c40328 1073741824" returned: 0 in 0.465s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:38 devstack sudo[99941]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e5a207dd-2776-492d-95be-91dbf9eb5fb8 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885" returned: 0 in 0.368s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e5a207dd-2776-492d-95be-91dbf9eb5fb8 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:38 devstack sudo[99950]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885
Nov 04 12:19:38 devstack sudo[99950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0031ec30-639d-4563-86cb-bb6f72c40328 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:38 devstack sudo[99952]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0031ec30-639d-4563-86cb-bb6f72c40328
Nov 04 12:19:38 devstack sudo[99952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:38 devstack sudo[99950]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e5a207dd-2776-492d-95be-91dbf9eb5fb8 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aeea561c-1b90-4f84-9a1b-f0337312a885" returned: 0 in 0.261s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:38 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e5a207dd-2776-492d-95be-91dbf9eb5fb8 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "cinder-quobyte-aeea561c-1b90-4f84-9a1b-f0337312a885" released by "delete_volume" :: held 0.702s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:19:38 devstack sudo[99952]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0031ec30-639d-4563-86cb-bb6f72c40328" returned: 0 in 0.280s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:38 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:19:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:19:39 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-e5a207dd-2776-492d-95be-91dbf9eb5fb8 tempest-VolumesSnapshotTestJSON-434051366 None] Created reservations ['28c16230-61b4-4e0b-89bb-c546b602f4b0', 'a9b4d086-912e-4be4-9b35-ef445ae97185', 'd26231e0-178f-4c9e-ba33-803bec4b111d', '04ecf4e1-41af-4b4d-9b24-93fbe43ed829'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:19:39 devstack cinder-volume[87169]: DEBUG cinder.volume.volume_utils [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Attempting download of 5fd6a6ac-1614-4aa5-aedb-17a31996018d ((None, [{'url': 'file:///opt/stack/data/glance/images/5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'metadata': {}}])) to volume 0031ec30-639d-4563-86cb-bb6f72c40328. {{(pid=87169) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 04 12:19:39 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[1242aa7c-540c-4617-bd8a-52b64cda4331]: (4, 'raw') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:19:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fd6a6ac-1614-4aa5-aedb-17a31996018d_8hdnqor_ {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e5a207dd-2776-492d-95be-91dbf9eb5fb8 tempest-VolumesSnapshotTestJSON-434051366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:19:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e5a207dd-2776-492d-95be-91dbf9eb5fb8 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:19:39 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e5a207dd-2776-492d-95be-91dbf9eb5fb8 tempest-VolumesSnapshotTestJSON-434051366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:19:39 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e5a207dd-2776-492d-95be-91dbf9eb5fb8 tempest-VolumesSnapshotTestJSON-434051366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:19:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e5a207dd-2776-492d-95be-91dbf9eb5fb8 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:19:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e5a207dd-2776-492d-95be-91dbf9eb5fb8 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:39 devstack sudo[99957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:19:39 devstack sudo[99957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:39 devstack sudo[99956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fd6a6ac-1614-4aa5-aedb-17a31996018d_8hdnqor_
Nov 04 12:19:39 devstack sudo[99956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:39 devstack sudo[99957]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:39 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-dba3dd6d-0e51-46bf-8b60-b76cf1ce9420 tempest-VolumesSnapshotTestJSON-434051366 None] Acquiring lock "cinder-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:19:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e5a207dd-2776-492d-95be-91dbf9eb5fb8 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.326s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:39 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-e5a207dd-2776-492d-95be-91dbf9eb5fb8 tempest-VolumesSnapshotTestJSON-434051366 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:19:39 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-e5a207dd-2776-492d-95be-91dbf9eb5fb8 tempest-VolumesSnapshotTestJSON-434051366 None] Deleted volume successfully.
Nov 04 12:19:39 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-dba3dd6d-0e51-46bf-8b60-b76cf1ce9420 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "cinder-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:19:39 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e5a207dd-2776-492d-95be-91dbf9eb5fb8 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "cinder-aeea561c-1b90-4f84-9a1b-f0337312a885-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:19:39 devstack sudo[99956]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fd6a6ac-1614-4aa5-aedb-17a31996018d_8hdnqor_" returned: 0 in 0.402s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fd6a6ac-1614-4aa5-aedb-17a31996018d_8hdnqor_ {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:39 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-dba3dd6d-0e51-46bf-8b60-b76cf1ce9420 tempest-VolumesSnapshotTestJSON-434051366 None] Acquiring lock "cinder-quobyte-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:19:39 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-dba3dd6d-0e51-46bf-8b60-b76cf1ce9420 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "cinder-quobyte-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df" acquired by "delete_volume" :: waited 0.019s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:19:39 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[032fc348-fa2c-43fd-bfc2-32e6c9bf74f9]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:19:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dba3dd6d-0e51-46bf-8b60-b76cf1ce9420 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:39 devstack sudo[99963]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fd6a6ac-1614-4aa5-aedb-17a31996018d_8hdnqor_
Nov 04 12:19:39 devstack sudo[99963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:39 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-bd4c5f33-a2d9-46d6-aa23-c3a5d1441340 tempest-VolumeQuotasAdminTestJSON-688100845 None] Transfer volume completed successfully.
Nov 04 12:19:39 devstack sudo[99964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df
Nov 04 12:19:39 devstack sudo[99964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:39 devstack sudo[99963]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fd6a6ac-1614-4aa5-aedb-17a31996018d_8hdnqor_" returned: 1 in 0.362s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fd6a6ac-1614-4aa5-aedb-17a31996018d_8hdnqor_' failed. Not Retrying. {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 12:19:39 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7362bd7-c31a-4b17-931a-5ab8303fd11f]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:19:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_47mvyl0odevstack@QuobyteHD {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:39 devstack sudo[99969]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_47mvyl0odevstack@QuobyteHD
Nov 04 12:19:39 devstack sudo[99969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:40 devstack sudo[99964]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dba3dd6d-0e51-46bf-8b60-b76cf1ce9420 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df" returned: 0 in 0.414s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dba3dd6d-0e51-46bf-8b60-b76cf1ce9420 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:40 devstack sudo[99974]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df
Nov 04 12:19:40 devstack sudo[99974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:40 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1e9542aa-5a76-446f-9dad-9eae6f21e62e tempest-VolumeQuotasAdminTestJSON-1204173671 None] Acquiring lock "cinder-0e60ab88-9196-4119-8b40-7f64d6ebeb1c-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:19:40 devstack sudo[99969]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_47mvyl0odevstack@QuobyteHD" returned: 0 in 0.375s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:40 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] 5fd6a6ac-1614-4aa5-aedb-17a31996018d was qcow2, converting to qcow2 {{(pid=87169) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 04 12:19:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_47mvyl0odevstack@QuobyteHD /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0031ec30-639d-4563-86cb-bb6f72c40328 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:40 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1e9542aa-5a76-446f-9dad-9eae6f21e62e tempest-VolumeQuotasAdminTestJSON-1204173671 None] Lock "cinder-0e60ab88-9196-4119-8b40-7f64d6ebeb1c-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:19:40 devstack sudo[99980]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_47mvyl0odevstack@QuobyteHD /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0031ec30-639d-4563-86cb-bb6f72c40328
Nov 04 12:19:40 devstack sudo[99980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:40 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1e9542aa-5a76-446f-9dad-9eae6f21e62e tempest-VolumeQuotasAdminTestJSON-1204173671 None] Acquiring lock "cinder-quobyte-0e60ab88-9196-4119-8b40-7f64d6ebeb1c" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:19:40 devstack sudo[99974]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dba3dd6d-0e51-46bf-8b60-b76cf1ce9420 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df" returned: 0 in 0.304s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:40 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1e9542aa-5a76-446f-9dad-9eae6f21e62e tempest-VolumeQuotasAdminTestJSON-1204173671 None] Lock "cinder-quobyte-0e60ab88-9196-4119-8b40-7f64d6ebeb1c" acquired by "delete_volume" :: waited 0.038s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:19:40 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-dba3dd6d-0e51-46bf-8b60-b76cf1ce9420 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "cinder-quobyte-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df" released by "delete_volume" :: held 0.829s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:19:40 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3396642-1c14-4cc7-b6bd-bd9c0c7d5af7]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:19:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1e9542aa-5a76-446f-9dad-9eae6f21e62e tempest-VolumeQuotasAdminTestJSON-1204173671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0e60ab88-9196-4119-8b40-7f64d6ebeb1c {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:40 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-dba3dd6d-0e51-46bf-8b60-b76cf1ce9420 tempest-VolumesSnapshotTestJSON-434051366 None] Created reservations ['8ec99220-de88-4edf-88ce-c06ab4935321', '05103999-4810-4f6d-907f-9404f8d8415a', '137018a1-0530-470b-8242-241e5494fe08', '325ba857-c389-4bb8-bb50-0b59c289e349'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:19:40 devstack sudo[99982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0e60ab88-9196-4119-8b40-7f64d6ebeb1c
Nov 04 12:19:40 devstack sudo[99982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-dba3dd6d-0e51-46bf-8b60-b76cf1ce9420 tempest-VolumesSnapshotTestJSON-434051366 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:19:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-dba3dd6d-0e51-46bf-8b60-b76cf1ce9420 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:19:40 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-dba3dd6d-0e51-46bf-8b60-b76cf1ce9420 tempest-VolumesSnapshotTestJSON-434051366 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:19:40 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-dba3dd6d-0e51-46bf-8b60-b76cf1ce9420 tempest-VolumesSnapshotTestJSON-434051366 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:19:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-dba3dd6d-0e51-46bf-8b60-b76cf1ce9420 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:19:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dba3dd6d-0e51-46bf-8b60-b76cf1ce9420 tempest-VolumesSnapshotTestJSON-434051366 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:40 devstack sudo[99987]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:19:40 devstack sudo[99987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:40 devstack sudo[99982]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1e9542aa-5a76-446f-9dad-9eae6f21e62e tempest-VolumeQuotasAdminTestJSON-1204173671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0e60ab88-9196-4119-8b40-7f64d6ebeb1c" returned: 0 in 0.416s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1e9542aa-5a76-446f-9dad-9eae6f21e62e tempest-VolumeQuotasAdminTestJSON-1204173671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0e60ab88-9196-4119-8b40-7f64d6ebeb1c {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:40 devstack sudo[99997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0e60ab88-9196-4119-8b40-7f64d6ebeb1c
Nov 04 12:19:40 devstack sudo[99997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:40 devstack sudo[99987]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dba3dd6d-0e51-46bf-8b60-b76cf1ce9420 tempest-VolumesSnapshotTestJSON-434051366 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.344s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:40 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-dba3dd6d-0e51-46bf-8b60-b76cf1ce9420 tempest-VolumesSnapshotTestJSON-434051366 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:19:40 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-dba3dd6d-0e51-46bf-8b60-b76cf1ce9420 tempest-VolumesSnapshotTestJSON-434051366 None] Deleted volume successfully.
Nov 04 12:19:40 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-dba3dd6d-0e51-46bf-8b60-b76cf1ce9420 tempest-VolumesSnapshotTestJSON-434051366 None] Lock "cinder-30f9da1d-5f61-4eb7-85d3-4a0f8d9318df-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:19:41 devstack sudo[99997]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1e9542aa-5a76-446f-9dad-9eae6f21e62e tempest-VolumeQuotasAdminTestJSON-1204173671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0e60ab88-9196-4119-8b40-7f64d6ebeb1c" returned: 0 in 0.344s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:41 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1e9542aa-5a76-446f-9dad-9eae6f21e62e tempest-VolumeQuotasAdminTestJSON-1204173671 None] Lock "cinder-quobyte-0e60ab88-9196-4119-8b40-7f64d6ebeb1c" released by "delete_volume" :: held 0.811s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:19:41 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-1e9542aa-5a76-446f-9dad-9eae6f21e62e tempest-VolumeQuotasAdminTestJSON-1204173671 None] Created reservations ['175a802c-8603-48b1-8e0b-48cda1fef991', '71fad357-ea08-4059-8b05-05e3c72bc38a', '016af1f2-1927-4312-b0b7-c4134147bd66', '2aeefbb2-ec7f-4897-9c7b-558570fd7bf8'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:19:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1e9542aa-5a76-446f-9dad-9eae6f21e62e tempest-VolumeQuotasAdminTestJSON-1204173671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:19:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1e9542aa-5a76-446f-9dad-9eae6f21e62e tempest-VolumeQuotasAdminTestJSON-1204173671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:19:41 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1e9542aa-5a76-446f-9dad-9eae6f21e62e tempest-VolumeQuotasAdminTestJSON-1204173671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:19:41 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1e9542aa-5a76-446f-9dad-9eae6f21e62e tempest-VolumeQuotasAdminTestJSON-1204173671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:19:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1e9542aa-5a76-446f-9dad-9eae6f21e62e tempest-VolumeQuotasAdminTestJSON-1204173671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:19:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1e9542aa-5a76-446f-9dad-9eae6f21e62e tempest-VolumeQuotasAdminTestJSON-1204173671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:41 devstack sudo[100001]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:19:41 devstack sudo[100001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:41 devstack sudo[100001]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1e9542aa-5a76-446f-9dad-9eae6f21e62e tempest-VolumeQuotasAdminTestJSON-1204173671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.344s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:41 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-1e9542aa-5a76-446f-9dad-9eae6f21e62e tempest-VolumeQuotasAdminTestJSON-1204173671 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:19:41 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-1e9542aa-5a76-446f-9dad-9eae6f21e62e tempest-VolumeQuotasAdminTestJSON-1204173671 None] Deleted volume successfully.
Nov 04 12:19:41 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1e9542aa-5a76-446f-9dad-9eae6f21e62e tempest-VolumeQuotasAdminTestJSON-1204173671 None] Lock "cinder-0e60ab88-9196-4119-8b40-7f64d6ebeb1c-delete_volume" released by "delete_volume" :: held 1.481s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:19:42 devstack sudo[99980]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_47mvyl0odevstack@QuobyteHD /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0031ec30-639d-4563-86cb-bb6f72c40328" returned: 0 in 2.549s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:42 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_47mvyl0odevstack@QuobyteHD, size 112.00 MB, duration 2.55 sec, destination /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0031ec30-639d-4563-86cb-bb6f72c40328 {{(pid=87169) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 12:19:42 devstack cinder-volume[87169]: INFO cinder.image.image_utils [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Converted 112.00 MB image at 43.89 MB/s
Nov 04 12:19:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0031ec30-639d-4563-86cb-bb6f72c40328 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:42 devstack sudo[100005]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0031ec30-639d-4563-86cb-bb6f72c40328 1G
Nov 04 12:19:42 devstack sudo[100005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:43 devstack sudo[100005]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0031ec30-639d-4563-86cb-bb6f72c40328 1G" returned: 0 in 0.421s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:43 devstack cinder-volume[87169]: DEBUG cinder.volume.volume_utils [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Downloaded image 5fd6a6ac-1614-4aa5-aedb-17a31996018d ((None, [{'url': 'file:///opt/stack/data/glance/images/5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'metadata': {}}])) to volume 0031ec30-639d-4563-86cb-bb6f72c40328 successfully. {{(pid=87169) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 04 12:19:43 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Temporary image 5fd6a6ac-1614-4aa5-aedb-17a31996018d for user 7e71cb5436654f3dba7d69438f0ca36c is deleted. {{(pid=87169) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 04 12:19:43 devstack cinder-volume[87169]: DEBUG cinder.volume.volume_utils [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Marking volume 0031ec30-639d-4563-86cb-bb6f72c40328 as bootable. {{(pid=87169) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 04 12:19:43 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Copying metadata from image 5fd6a6ac-1614-4aa5-aedb-17a31996018d to 0031ec30-639d-4563-86cb-bb6f72c40328. {{(pid=87169) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 04 12:19:43 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Creating volume glance metadata for volume 0031ec30-639d-4563-86cb-bb6f72c40328 backed by image 5fd6a6ac-1614-4aa5-aedb-17a31996018d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87169) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 04 12:19:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2381f52-68c8-4cee-9c8b-97d6d186d2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0031ec30-639d-4563-86cb-bb6f72c40328', 'volume_size': 1, 'image_id': '5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '52d49d1f3a4b47a8a8f060da8e0e2c02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'created_at': datetime.datetime(2026, 11, 4, 11, 3, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 3, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fd6a6ac-1614-4aa5-aedb-17a31996018d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cc0637501d0>}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f0b501d-4d8f-4bd7-b474-0ac78133e350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:43 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Volume volume-0031ec30-639d-4563-86cb-bb6f72c40328 (0031ec30-639d-4563-86cb-bb6f72c40328): created successfully
Nov 04 12:19:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f0b501d-4d8f-4bd7-b474-0ac78133e350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Flow 'volume_create_manager' (d0d53e78-873f-463a-80cb-ba449adb010a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:19:43 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-859ece99-0071-43f7-988c-1068f24c0fa7 tempest-VolumesImageMetadata-478861060 None] Created volume successfully.
Nov 04 12:19:44 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-974a2a7e-0496-4b6f-bffc-09f48ab06100 tempest-VolumesImageMetadata-478861060 None] Acquiring lock "cinder-0031ec30-639d-4563-86cb-bb6f72c40328-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:19:44 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-974a2a7e-0496-4b6f-bffc-09f48ab06100 tempest-VolumesImageMetadata-478861060 None] Lock "cinder-0031ec30-639d-4563-86cb-bb6f72c40328-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:19:44 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-974a2a7e-0496-4b6f-bffc-09f48ab06100 tempest-VolumesImageMetadata-478861060 None] Acquiring lock "cinder-quobyte-0031ec30-639d-4563-86cb-bb6f72c40328" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:19:44 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-974a2a7e-0496-4b6f-bffc-09f48ab06100 tempest-VolumesImageMetadata-478861060 None] Lock "cinder-quobyte-0031ec30-639d-4563-86cb-bb6f72c40328" acquired by "delete_volume" :: waited 0.023s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:19:44 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf8b49c-915f-4cea-a040-b60357f86998]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:19:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-974a2a7e-0496-4b6f-bffc-09f48ab06100 tempest-VolumesImageMetadata-478861060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0031ec30-639d-4563-86cb-bb6f72c40328 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:44 devstack sudo[100010]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0031ec30-639d-4563-86cb-bb6f72c40328
Nov 04 12:19:44 devstack sudo[100010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:45 devstack sudo[100010]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-974a2a7e-0496-4b6f-bffc-09f48ab06100 tempest-VolumesImageMetadata-478861060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0031ec30-639d-4563-86cb-bb6f72c40328" returned: 0 in 0.425s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-974a2a7e-0496-4b6f-bffc-09f48ab06100 tempest-VolumesImageMetadata-478861060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0031ec30-639d-4563-86cb-bb6f72c40328 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:45 devstack sudo[100015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0031ec30-639d-4563-86cb-bb6f72c40328
Nov 04 12:19:45 devstack sudo[100015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:45 devstack sudo[100015]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-974a2a7e-0496-4b6f-bffc-09f48ab06100 tempest-VolumesImageMetadata-478861060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0031ec30-639d-4563-86cb-bb6f72c40328" returned: 0 in 0.311s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:45 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-974a2a7e-0496-4b6f-bffc-09f48ab06100 tempest-VolumesImageMetadata-478861060 None] Lock "cinder-quobyte-0031ec30-639d-4563-86cb-bb6f72c40328" released by "delete_volume" :: held 0.792s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:19:45 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-974a2a7e-0496-4b6f-bffc-09f48ab06100 tempest-VolumesImageMetadata-478861060 None] Created reservations ['9729cfe9-961a-4cc9-811f-fe0713d306d7', '1c7ac2fd-d5db-4057-b242-6efa8217176a', 'f78e5500-0510-4b76-a859-4cad5b092c00', '7ce1d4df-fba7-4845-bc94-66da2e4ebe50'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:19:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-974a2a7e-0496-4b6f-bffc-09f48ab06100 tempest-VolumesImageMetadata-478861060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:19:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-974a2a7e-0496-4b6f-bffc-09f48ab06100 tempest-VolumesImageMetadata-478861060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:19:45 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-974a2a7e-0496-4b6f-bffc-09f48ab06100 tempest-VolumesImageMetadata-478861060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:19:45 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-974a2a7e-0496-4b6f-bffc-09f48ab06100 tempest-VolumesImageMetadata-478861060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:19:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-974a2a7e-0496-4b6f-bffc-09f48ab06100 tempest-VolumesImageMetadata-478861060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:19:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-974a2a7e-0496-4b6f-bffc-09f48ab06100 tempest-VolumesImageMetadata-478861060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:45 devstack sudo[100019]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:19:45 devstack sudo[100019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:46 devstack sudo[100019]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-974a2a7e-0496-4b6f-bffc-09f48ab06100 tempest-VolumesImageMetadata-478861060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.363s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:46 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-974a2a7e-0496-4b6f-bffc-09f48ab06100 tempest-VolumesImageMetadata-478861060 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:19:46 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-974a2a7e-0496-4b6f-bffc-09f48ab06100 tempest-VolumesImageMetadata-478861060 None] Deleted volume successfully.
Nov 04 12:19:46 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-974a2a7e-0496-4b6f-bffc-09f48ab06100 tempest-VolumesImageMetadata-478861060 None] Lock "cinder-0031ec30-639d-4563-86cb-bb6f72c40328-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:19:49 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:19:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:19:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:19:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:19:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:19:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:19:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:49 devstack sudo[100022]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:19:49 devstack sudo[100022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:50 devstack sudo[100022]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.272s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:50 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:19:50 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager._thread_info {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:19:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread count: 28 {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 12:19:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread info: [<_MainThread(MainThread, started 137165867425920)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137165754678912)>, <Thread(Thread-3 (stat_writer), started daemon 137165754130752)>, <Thread(Rabbit-heartbeat, started daemon 137165752997504)>, <Thread(Thread-5 (_runner), started daemon 137165753227712)>, <Thread(Thread-7 (_runner), started daemon 137165751273856)>, <Thread(fd_logger, started daemon 137165755322048)>, <Thread(privsep_reader, started daemon 137165748896704)>, <Thread(tpool_thread_0, started daemon 137165742520000)>, <Thread(tpool_thread_1, started daemon 137165734127296)>, <Thread(tpool_thread_2, started daemon 137165725734592)>, <Thread(tpool_thread_3, started daemon 137165717341888)>, <Thread(tpool_thread_4, started daemon 137165708949184)>, <Thread(tpool_thread_5, started daemon 137165700556480)>, <Thread(tpool_thread_6, started daemon 137165692163776)>, <Thread(tpool_thread_7, started daemon 137165683771072)>, <Thread(tpool_thread_8, started daemon 137165675378368)>, <Thread(tpool_thread_9, started daemon 137165666985664)>, <Thread(tpool_thread_10, started daemon 137165658592960)>, <Thread(tpool_thread_11, started daemon 137165650183872)>, <Thread(tpool_thread_12, started daemon 137165641774784)>, <Thread(tpool_thread_13, started daemon 137165633365696)>, <Thread(tpool_thread_14, started daemon 137165624956608)>, <Thread(tpool_thread_15, started daemon 137165616547520)>, <Thread(tpool_thread_16, started daemon 137165608138432)>, <Thread(tpool_thread_17, started daemon 137165599729344)>, <Thread(tpool_thread_18, started daemon 137165591320256)>, <Thread(tpool_thread_19, started daemon 137165582911168)>] {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 12:19:50 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-46e768fe-9427-4cb7-920e-d4f6891cec1d tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:19:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-46e768fe-9427-4cb7-920e-d4f6891cec1d tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Flow 'volume_create_manager' (d64eea35-ae4a-4e0e-92d1-bfb032d9c071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:19:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-46e768fe-9427-4cb7-920e-d4f6891cec1d tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afa856e0-5a9e-4c2a-b151-a9f51b153a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-46e768fe-9427-4cb7-920e-d4f6891cec1d tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afa856e0-5a9e-4c2a-b151-a9f51b153a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1272434646',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93768bad-6495-4d53-91ee-1a9467fdf6ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9722dc909b44f8883c705c4b0370e1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:19:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:19:51Z,use_quota=True,user_id='79c2ff60f99e4dada7aedec6d0a48117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-46e768fe-9427-4cb7-920e-d4f6891cec1d tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80adf108-24b8-468d-9caa-ab0c3a7bf194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-46e768fe-9427-4cb7-920e-d4f6891cec1d tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80adf108-24b8-468d-9caa-ab0c3a7bf194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-46e768fe-9427-4cb7-920e-d4f6891cec1d tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5d44232-55f8-46b1-84a8-bbf962fd98c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-46e768fe-9427-4cb7-920e-d4f6891cec1d tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5d44232-55f8-46b1-84a8-bbf962fd98c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93768bad-6495-4d53-91ee-1a9467fdf6ea', 'volume_name': 'volume-93768bad-6495-4d53-91ee-1a9467fdf6ea', 'volume_size': 2}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-46e768fe-9427-4cb7-920e-d4f6891cec1d tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc0e310b-253f-4133-8d61-3e2cc3b06627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-46e768fe-9427-4cb7-920e-d4f6891cec1d tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc0e310b-253f-4133-8d61-3e2cc3b06627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-46e768fe-9427-4cb7-920e-d4f6891cec1d tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2172e85c-1e62-4f27-b074-6d58086d9a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:50 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-46e768fe-9427-4cb7-920e-d4f6891cec1d tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Volume 93768bad-6495-4d53-91ee-1a9467fdf6ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93768bad-6495-4d53-91ee-1a9467fdf6ea', 'volume_size': 2}
Nov 04 12:19:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-46e768fe-9427-4cb7-920e-d4f6891cec1d tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:19:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-46e768fe-9427-4cb7-920e-d4f6891cec1d tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:19:50 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-46e768fe-9427-4cb7-920e-d4f6891cec1d tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1272434646',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93768bad-6495-4d53-91ee-1a9467fdf6ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9722dc909b44f8883c705c4b0370e1d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:19:51Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:19:51Z,use_quota=True,user_id='79c2ff60f99e4dada7aedec6d0a48117',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:19:50 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-46e768fe-9427-4cb7-920e-d4f6891cec1d tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Creating volume 93768bad-6495-4d53-91ee-1a9467fdf6ea {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:19:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-46e768fe-9427-4cb7-920e-d4f6891cec1d tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:19:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-46e768fe-9427-4cb7-920e-d4f6891cec1d tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:19:50 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-46e768fe-9427-4cb7-920e-d4f6891cec1d tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:19:50 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-46e768fe-9427-4cb7-920e-d4f6891cec1d tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:19:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-46e768fe-9427-4cb7-920e-d4f6891cec1d tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:19:50 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-46e768fe-9427-4cb7-920e-d4f6891cec1d tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:19:50 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-46e768fe-9427-4cb7-920e-d4f6891cec1d tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:19:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-46e768fe-9427-4cb7-920e-d4f6891cec1d tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea 2147483648 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:50 devstack sudo[100025]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea 2147483648
Nov 04 12:19:50 devstack sudo[100025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:51 devstack sudo[100025]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-46e768fe-9427-4cb7-920e-d4f6891cec1d tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea 2147483648" returned: 0 in 0.580s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-46e768fe-9427-4cb7-920e-d4f6891cec1d tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:51 devstack sudo[100032]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea
Nov 04 12:19:51 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:51 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9af1855-8c56-4af5-b9d5-a8b77ef8996e tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:19:51 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c9af1855-8c56-4af5-b9d5-a8b77ef8996e tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Flow 'volume_create_manager' (16c7c27f-a13d-4c29-8632-7ea28f046db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:19:51 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c9af1855-8c56-4af5-b9d5-a8b77ef8996e tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfcd1f10-7bd6-4cf0-863d-219ac7061aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:51 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c9af1855-8c56-4af5-b9d5-a8b77ef8996e tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfcd1f10-7bd6-4cf0-863d-219ac7061aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-96388753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd4e5458-cbad-4708-b0e7-77894c27ce56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='898f06957a914b7ab3e452f7163514d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:19:51Z,use_quota=True,user_id='0287e93205b849f6a72dec12fcaf896e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:51 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c9af1855-8c56-4af5-b9d5-a8b77ef8996e tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae223214-f8a5-47f1-994a-9abccc16d6ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:51 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c9af1855-8c56-4af5-b9d5-a8b77ef8996e tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae223214-f8a5-47f1-994a-9abccc16d6ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:51 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c9af1855-8c56-4af5-b9d5-a8b77ef8996e tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (987786eb-8f53-4f46-9da4-506aa359a223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:51 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c9af1855-8c56-4af5-b9d5-a8b77ef8996e tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (987786eb-8f53-4f46-9da4-506aa359a223) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd4e5458-cbad-4708-b0e7-77894c27ce56', 'volume_name': 'volume-fd4e5458-cbad-4708-b0e7-77894c27ce56', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:51 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c9af1855-8c56-4af5-b9d5-a8b77ef8996e tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b761243-a101-425f-9288-db542d977c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:51 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c9af1855-8c56-4af5-b9d5-a8b77ef8996e tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b761243-a101-425f-9288-db542d977c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:51 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c9af1855-8c56-4af5-b9d5-a8b77ef8996e tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa7b79e8-05f2-4054-825f-18644dff35f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:51 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-c9af1855-8c56-4af5-b9d5-a8b77ef8996e tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Volume fd4e5458-cbad-4708-b0e7-77894c27ce56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd4e5458-cbad-4708-b0e7-77894c27ce56', 'volume_size': 1}
Nov 04 12:19:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c9af1855-8c56-4af5-b9d5-a8b77ef8996e tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:19:51 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ea6dc1e-fcc0-4403-b9be-29d407ffb304 tempest-VolumesMetadataTest-425069641 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:19:51 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-0ea6dc1e-fcc0-4403-b9be-29d407ffb304 tempest-VolumesMetadataTest-425069641 None] Flow 'volume_create_manager' (f078654e-7c32-4a02-81fd-59f169aaf4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:19:51 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-0ea6dc1e-fcc0-4403-b9be-29d407ffb304 tempest-VolumesMetadataTest-425069641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03fb1d25-33ef-4fee-9d37-07267ca9a161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:51 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-0ea6dc1e-fcc0-4403-b9be-29d407ffb304 tempest-VolumesMetadataTest-425069641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03fb1d25-33ef-4fee-9d37-07267ca9a161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1854352257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e091bfa-1782-46fd-a967-d25a157734c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee0cfe6438846659e5c2a37dd1ac50b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:19:51Z,use_quota=True,user_id='39fb98c9f311471d86d9c1e98814fe1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:51 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-0ea6dc1e-fcc0-4403-b9be-29d407ffb304 tempest-VolumesMetadataTest-425069641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75453b71-d15f-4abf-8363-69c8232b54c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:51 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:51 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-0ea6dc1e-fcc0-4403-b9be-29d407ffb304 tempest-VolumesMetadataTest-425069641 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75453b71-d15f-4abf-8363-69c8232b54c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:51 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-0ea6dc1e-fcc0-4403-b9be-29d407ffb304 tempest-VolumesMetadataTest-425069641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (739757b5-5803-471c-b830-eb6fc35844db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:51 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-0ea6dc1e-fcc0-4403-b9be-29d407ffb304 tempest-VolumesMetadataTest-425069641 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (739757b5-5803-471c-b830-eb6fc35844db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e091bfa-1782-46fd-a967-d25a157734c0', 'volume_name': 'volume-1e091bfa-1782-46fd-a967-d25a157734c0', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:51 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-0ea6dc1e-fcc0-4403-b9be-29d407ffb304 tempest-VolumesMetadataTest-425069641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b4b8c55-6240-4f9a-ad25-3d638754a50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:51 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-0ea6dc1e-fcc0-4403-b9be-29d407ffb304 tempest-VolumesMetadataTest-425069641 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b4b8c55-6240-4f9a-ad25-3d638754a50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:51 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-0ea6dc1e-fcc0-4403-b9be-29d407ffb304 tempest-VolumesMetadataTest-425069641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (992d04a1-0ea5-4890-abeb-3ffd8cf6bc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:51 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-0ea6dc1e-fcc0-4403-b9be-29d407ffb304 tempest-VolumesMetadataTest-425069641 None] Volume 1e091bfa-1782-46fd-a967-d25a157734c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e091bfa-1782-46fd-a967-d25a157734c0', 'volume_size': 1}
Nov 04 12:19:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-0ea6dc1e-fcc0-4403-b9be-29d407ffb304 tempest-VolumesMetadataTest-425069641 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:19:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-46e768fe-9427-4cb7-920e-d4f6891cec1d tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea" returned: 0 in 0.272s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:51 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-46e768fe-9427-4cb7-920e-d4f6891cec1d tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:19:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-46e768fe-9427-4cb7-920e-d4f6891cec1d tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:19:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c9af1855-8c56-4af5-b9d5-a8b77ef8996e tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.097s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:19:51 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c9af1855-8c56-4af5-b9d5-a8b77ef8996e tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-96388753',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd4e5458-cbad-4708-b0e7-77894c27ce56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='898f06957a914b7ab3e452f7163514d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:19:51Z,use_quota=True,user_id='0287e93205b849f6a72dec12fcaf896e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:19:51 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-c9af1855-8c56-4af5-b9d5-a8b77ef8996e tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Creating volume fd4e5458-cbad-4708-b0e7-77894c27ce56 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:19:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c9af1855-8c56-4af5-b9d5-a8b77ef8996e tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:19:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c9af1855-8c56-4af5-b9d5-a8b77ef8996e tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:19:51 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c9af1855-8c56-4af5-b9d5-a8b77ef8996e tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:19:51 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c9af1855-8c56-4af5-b9d5-a8b77ef8996e tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:19:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c9af1855-8c56-4af5-b9d5-a8b77ef8996e tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:19:51 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c9af1855-8c56-4af5-b9d5-a8b77ef8996e tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:19:51 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-c9af1855-8c56-4af5-b9d5-a8b77ef8996e tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:19:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c9af1855-8c56-4af5-b9d5-a8b77ef8996e tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:51 devstack sudo[100035]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56 1073741824
Nov 04 12:19:51 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-46e768fe-9427-4cb7-920e-d4f6891cec1d tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2172e85c-1e62-4f27-b074-6d58086d9a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93768bad-6495-4d53-91ee-1a9467fdf6ea', 'volume_size': 2}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:51 devstack sudo[100035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:51 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-46e768fe-9427-4cb7-920e-d4f6891cec1d tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eb064a8-f94e-4c4f-ac82-b6188f39e59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:51 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-46e768fe-9427-4cb7-920e-d4f6891cec1d tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Volume volume-93768bad-6495-4d53-91ee-1a9467fdf6ea (93768bad-6495-4d53-91ee-1a9467fdf6ea): created successfully
Nov 04 12:19:51 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-46e768fe-9427-4cb7-920e-d4f6891cec1d tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8eb064a8-f94e-4c4f-ac82-b6188f39e59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:51 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-46e768fe-9427-4cb7-920e-d4f6891cec1d tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Flow 'volume_create_manager' (d64eea35-ae4a-4e0e-92d1-bfb032d9c071) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:19:51 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-46e768fe-9427-4cb7-920e-d4f6891cec1d tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Created volume successfully.
Nov 04 12:19:52 devstack sudo[100035]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c9af1855-8c56-4af5-b9d5-a8b77ef8996e tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56 1073741824" returned: 0 in 0.420s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c9af1855-8c56-4af5-b9d5-a8b77ef8996e tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:52 devstack sudo[100040]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56
Nov 04 12:19:52 devstack sudo[100040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:52 devstack sudo[100040]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c9af1855-8c56-4af5-b9d5-a8b77ef8996e tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56" returned: 0 in 0.251s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:52 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c9af1855-8c56-4af5-b9d5-a8b77ef8996e tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:19:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c9af1855-8c56-4af5-b9d5-a8b77ef8996e tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:19:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-0ea6dc1e-fcc0-4403-b9be-29d407ffb304 tempest-VolumesMetadataTest-425069641 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.718s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:19:52 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-0ea6dc1e-fcc0-4403-b9be-29d407ffb304 tempest-VolumesMetadataTest-425069641 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:19:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1854352257',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e091bfa-1782-46fd-a967-d25a157734c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bee0cfe6438846659e5c2a37dd1ac50b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:19:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:19:51Z,use_quota=True,user_id='39fb98c9f311471d86d9c1e98814fe1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:19:52 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-0ea6dc1e-fcc0-4403-b9be-29d407ffb304 tempest-VolumesMetadataTest-425069641 None] Creating volume 1e091bfa-1782-46fd-a967-d25a157734c0 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:19:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-0ea6dc1e-fcc0-4403-b9be-29d407ffb304 tempest-VolumesMetadataTest-425069641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:19:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-0ea6dc1e-fcc0-4403-b9be-29d407ffb304 tempest-VolumesMetadataTest-425069641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:19:52 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-0ea6dc1e-fcc0-4403-b9be-29d407ffb304 tempest-VolumesMetadataTest-425069641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:19:52 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-0ea6dc1e-fcc0-4403-b9be-29d407ffb304 tempest-VolumesMetadataTest-425069641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:19:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-0ea6dc1e-fcc0-4403-b9be-29d407ffb304 tempest-VolumesMetadataTest-425069641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:19:52 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-0ea6dc1e-fcc0-4403-b9be-29d407ffb304 tempest-VolumesMetadataTest-425069641 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:19:52 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-0ea6dc1e-fcc0-4403-b9be-29d407ffb304 tempest-VolumesMetadataTest-425069641 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:19:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0ea6dc1e-fcc0-4403-b9be-29d407ffb304 tempest-VolumesMetadataTest-425069641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1e091bfa-1782-46fd-a967-d25a157734c0 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:52 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c9af1855-8c56-4af5-b9d5-a8b77ef8996e tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa7b79e8-05f2-4054-825f-18644dff35f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd4e5458-cbad-4708-b0e7-77894c27ce56', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:52 devstack sudo[100043]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1e091bfa-1782-46fd-a967-d25a157734c0 1073741824
Nov 04 12:19:52 devstack sudo[100043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:52 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c9af1855-8c56-4af5-b9d5-a8b77ef8996e tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae23063e-ecf3-4fb5-a972-fe3cdb6db0a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:52 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-c9af1855-8c56-4af5-b9d5-a8b77ef8996e tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Volume volume-fd4e5458-cbad-4708-b0e7-77894c27ce56 (fd4e5458-cbad-4708-b0e7-77894c27ce56): created successfully
Nov 04 12:19:52 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c9af1855-8c56-4af5-b9d5-a8b77ef8996e tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae23063e-ecf3-4fb5-a972-fe3cdb6db0a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:52 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c9af1855-8c56-4af5-b9d5-a8b77ef8996e tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Flow 'volume_create_manager' (16c7c27f-a13d-4c29-8632-7ea28f046db7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:19:52 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-c9af1855-8c56-4af5-b9d5-a8b77ef8996e tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Created volume successfully.
Nov 04 12:19:52 devstack sudo[100043]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0ea6dc1e-fcc0-4403-b9be-29d407ffb304 tempest-VolumesMetadataTest-425069641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1e091bfa-1782-46fd-a967-d25a157734c0 1073741824" returned: 0 in 0.515s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d0742598-48a4-496d-9725-5206b8548546 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:19:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0ea6dc1e-fcc0-4403-b9be-29d407ffb304 tempest-VolumesMetadataTest-425069641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1e091bfa-1782-46fd-a967-d25a157734c0 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:52 devstack sudo[100049]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1e091bfa-1782-46fd-a967-d25a157734c0
Nov 04 12:19:52 devstack sudo[100049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:53 devstack sudo[100049]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0ea6dc1e-fcc0-4403-b9be-29d407ffb304 tempest-VolumesMetadataTest-425069641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1e091bfa-1782-46fd-a967-d25a157734c0" returned: 0 in 0.251s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:53 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-0ea6dc1e-fcc0-4403-b9be-29d407ffb304 tempest-VolumesMetadataTest-425069641 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:19:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-0ea6dc1e-fcc0-4403-b9be-29d407ffb304 tempest-VolumesMetadataTest-425069641 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:19:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d0742598-48a4-496d-9725-5206b8548546 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.261s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:19:53 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-0ea6dc1e-fcc0-4403-b9be-29d407ffb304 tempest-VolumesMetadataTest-425069641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (992d04a1-0ea5-4890-abeb-3ffd8cf6bc85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e091bfa-1782-46fd-a967-d25a157734c0', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:53 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-0ea6dc1e-fcc0-4403-b9be-29d407ffb304 tempest-VolumesMetadataTest-425069641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e0e41cc-91e1-4373-a6e1-d326a704813d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:53 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-d0742598-48a4-496d-9725-5206b8548546 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Creating offline snapshot ae90e3dc-a2d2-48a7-ac19-dad6c72efdb2 of volume 93768bad-6495-4d53-91ee-1a9467fdf6ea {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:19:53 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-0ea6dc1e-fcc0-4403-b9be-29d407ffb304 tempest-VolumesMetadataTest-425069641 None] Volume volume-1e091bfa-1782-46fd-a967-d25a157734c0 (1e091bfa-1782-46fd-a967-d25a157734c0): created successfully
Nov 04 12:19:53 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-0ea6dc1e-fcc0-4403-b9be-29d407ffb304 tempest-VolumesMetadataTest-425069641 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e0e41cc-91e1-4373-a6e1-d326a704813d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:53 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-0ea6dc1e-fcc0-4403-b9be-29d407ffb304 tempest-VolumesMetadataTest-425069641 None] Flow 'volume_create_manager' (f078654e-7c32-4a02-81fd-59f169aaf4a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:19:53 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[59529e74-d4f2-4959-99e1-c310acdb47c4]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:19:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0742598-48a4-496d-9725-5206b8548546 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:53 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-0ea6dc1e-fcc0-4403-b9be-29d407ffb304 tempest-VolumesMetadataTest-425069641 None] Created volume successfully.
Nov 04 12:19:53 devstack sudo[100053]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea
Nov 04 12:19:53 devstack sudo[100053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-9b36ddcc-7459-498a-b539-44b30224d12d tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:19:53 devstack sudo[100053]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0742598-48a4-496d-9725-5206b8548546 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea" returned: 0 in 0.401s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0742598-48a4-496d-9725-5206b8548546 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea.ae90e3dc-a2d2-48a7-ac19-dad6c72efdb2 2G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:53 devstack sudo[100058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea.ae90e3dc-a2d2-48a7-ac19-dad6c72efdb2 2G
Nov 04 12:19:53 devstack sudo[100058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:54 devstack sudo[100058]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0742598-48a4-496d-9725-5206b8548546 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea.ae90e3dc-a2d2-48a7-ac19-dad6c72efdb2 2G" returned: 0 in 0.471s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0742598-48a4-496d-9725-5206b8548546 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93768bad-6495-4d53-91ee-1a9467fdf6ea -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea.ae90e3dc-a2d2-48a7-ac19-dad6c72efdb2 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:54 devstack sudo[100065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93768bad-6495-4d53-91ee-1a9467fdf6ea -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea.ae90e3dc-a2d2-48a7-ac19-dad6c72efdb2
Nov 04 12:19:54 devstack sudo[100065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:54 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-502096f1-6af2-4560-9ead-0c89710ca938 tempest-VolumesMetadataTest-425069641 None] Acquiring lock "cinder-1e091bfa-1782-46fd-a967-d25a157734c0-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:19:54 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-502096f1-6af2-4560-9ead-0c89710ca938 tempest-VolumesMetadataTest-425069641 None] Lock "cinder-1e091bfa-1782-46fd-a967-d25a157734c0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:19:54 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-502096f1-6af2-4560-9ead-0c89710ca938 tempest-VolumesMetadataTest-425069641 None] Acquiring lock "cinder-quobyte-1e091bfa-1782-46fd-a967-d25a157734c0" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:19:54 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-502096f1-6af2-4560-9ead-0c89710ca938 tempest-VolumesMetadataTest-425069641 None] Lock "cinder-quobyte-1e091bfa-1782-46fd-a967-d25a157734c0" acquired by "delete_volume" :: waited 0.016s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:19:54 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[056c8fec-0d61-4cc1-ac13-35804347fda4]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:19:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-502096f1-6af2-4560-9ead-0c89710ca938 tempest-VolumesMetadataTest-425069641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1e091bfa-1782-46fd-a967-d25a157734c0 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:54 devstack sudo[100067]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1e091bfa-1782-46fd-a967-d25a157734c0
Nov 04 12:19:54 devstack sudo[100067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:54 devstack sudo[100065]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0742598-48a4-496d-9725-5206b8548546 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93768bad-6495-4d53-91ee-1a9467fdf6ea -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea.ae90e3dc-a2d2-48a7-ac19-dad6c72efdb2" returned: 0 in 0.322s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:54 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-d0742598-48a4-496d-9725-5206b8548546 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea.ae90e3dc-a2d2-48a7-ac19-dad6c72efdb2 is being set with open permissions: ugo+rw
Nov 04 12:19:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0742598-48a4-496d-9725-5206b8548546 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea.ae90e3dc-a2d2-48a7-ac19-dad6c72efdb2 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:54 devstack sudo[100072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea.ae90e3dc-a2d2-48a7-ac19-dad6c72efdb2
Nov 04 12:19:54 devstack sudo[100072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:54 devstack sudo[100067]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-502096f1-6af2-4560-9ead-0c89710ca938 tempest-VolumesMetadataTest-425069641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1e091bfa-1782-46fd-a967-d25a157734c0" returned: 0 in 0.379s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-502096f1-6af2-4560-9ead-0c89710ca938 tempest-VolumesMetadataTest-425069641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1e091bfa-1782-46fd-a967-d25a157734c0 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:54 devstack sudo[100077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1e091bfa-1782-46fd-a967-d25a157734c0
Nov 04 12:19:54 devstack sudo[100077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:54 devstack sudo[100072]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0742598-48a4-496d-9725-5206b8548546 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea.ae90e3dc-a2d2-48a7-ac19-dad6c72efdb2" returned: 0 in 0.268s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0742598-48a4-496d-9725-5206b8548546 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:54 devstack sudo[100080]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea.info
Nov 04 12:19:54 devstack sudo[100080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:54 devstack sudo[100077]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-502096f1-6af2-4560-9ead-0c89710ca938 tempest-VolumesMetadataTest-425069641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1e091bfa-1782-46fd-a967-d25a157734c0" returned: 0 in 0.265s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:54 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-502096f1-6af2-4560-9ead-0c89710ca938 tempest-VolumesMetadataTest-425069641 None] Lock "cinder-quobyte-1e091bfa-1782-46fd-a967-d25a157734c0" released by "delete_volume" :: held 0.687s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:19:54 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-502096f1-6af2-4560-9ead-0c89710ca938 tempest-VolumesMetadataTest-425069641 None] Created reservations ['e3963e59-bb93-4c00-94cb-be4144be966b', 'bd3b8ce9-4c9d-4561-a84f-1a08e4084766', '4ab7af8b-68c1-4d3d-8839-35fbb3706b0f', 'a0ac9754-8e3b-4f3d-a111-aff2c9662465'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:19:55 devstack sudo[100080]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0742598-48a4-496d-9725-5206b8548546 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea.info" returned: 0 in 0.281s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:55 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-d0742598-48a4-496d-9725-5206b8548546 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea.info is being set with open permissions: ugo+rw
Nov 04 12:19:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0742598-48a4-496d-9725-5206b8548546 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-502096f1-6af2-4560-9ead-0c89710ca938 tempest-VolumesMetadataTest-425069641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:19:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-502096f1-6af2-4560-9ead-0c89710ca938 tempest-VolumesMetadataTest-425069641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:19:55 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-502096f1-6af2-4560-9ead-0c89710ca938 tempest-VolumesMetadataTest-425069641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:19:55 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-502096f1-6af2-4560-9ead-0c89710ca938 tempest-VolumesMetadataTest-425069641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:19:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-502096f1-6af2-4560-9ead-0c89710ca938 tempest-VolumesMetadataTest-425069641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:19:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-502096f1-6af2-4560-9ead-0c89710ca938 tempest-VolumesMetadataTest-425069641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:55 devstack sudo[100084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea.info
Nov 04 12:19:55 devstack sudo[100084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:55 devstack sudo[100086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:19:55 devstack sudo[100086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:55 devstack sudo[100084]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0742598-48a4-496d-9725-5206b8548546 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea.info" returned: 0 in 0.252s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:55 devstack sudo[100086]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d0742598-48a4-496d-9725-5206b8548546 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.148s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:19:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-9b36ddcc-7459-498a-b539-44b30224d12d tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.785s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:19:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-502096f1-6af2-4560-9ead-0c89710ca938 tempest-VolumesMetadataTest-425069641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.275s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:55 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-502096f1-6af2-4560-9ead-0c89710ca938 tempest-VolumesMetadataTest-425069641 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:19:55 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-502096f1-6af2-4560-9ead-0c89710ca938 tempest-VolumesMetadataTest-425069641 None] Deleted volume successfully.
Nov 04 12:19:55 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-9b36ddcc-7459-498a-b539-44b30224d12d tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Creating offline snapshot 042323b7-12ca-4ca7-8008-14482d185b08 of volume fd4e5458-cbad-4708-b0e7-77894c27ce56 {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:19:55 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-d0742598-48a4-496d-9725-5206b8548546 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Create snapshot completed successfully
Nov 04 12:19:55 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa3c5c1-ba66-474f-848e-28acdad11ca6]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:19:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9b36ddcc-7459-498a-b539-44b30224d12d tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:55 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-502096f1-6af2-4560-9ead-0c89710ca938 tempest-VolumesMetadataTest-425069641 None] Lock "cinder-1e091bfa-1782-46fd-a967-d25a157734c0-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:19:55 devstack sudo[100090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56
Nov 04 12:19:55 devstack sudo[100090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:55 devstack sudo[100090]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9b36ddcc-7459-498a-b539-44b30224d12d tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56" returned: 0 in 0.389s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9b36ddcc-7459-498a-b539-44b30224d12d tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56.042323b7-12ca-4ca7-8008-14482d185b08 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:55 devstack sudo[100097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56.042323b7-12ca-4ca7-8008-14482d185b08 1G
Nov 04 12:19:55 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:56 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a579c814-0528-4cc1-be70-69dc0825f914 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Acquiring lock "cinder-ae90e3dc-a2d2-48a7-ac19-dad6c72efdb2-delete_snapshot" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:19:56 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a579c814-0528-4cc1-be70-69dc0825f914 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Lock "cinder-ae90e3dc-a2d2-48a7-ac19-dad6c72efdb2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:19:56 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a579c814-0528-4cc1-be70-69dc0825f914 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Acquiring lock "cinder-quobyte-93768bad-6495-4d53-91ee-1a9467fdf6ea" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:19:56 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a579c814-0528-4cc1-be70-69dc0825f914 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Lock "cinder-quobyte-93768bad-6495-4d53-91ee-1a9467fdf6ea" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:19:56 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a579c814-0528-4cc1-be70-69dc0825f914 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Acquiring lock "cinder-quobyte-ae90e3dc-a2d2-48a7-ac19-dad6c72efdb2" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:19:56 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a579c814-0528-4cc1-be70-69dc0825f914 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Lock "cinder-quobyte-ae90e3dc-a2d2-48a7-ac19-dad6c72efdb2" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:19:56 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-a579c814-0528-4cc1-be70-69dc0825f914 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Deleting offline snapshot ae90e3dc-a2d2-48a7-ac19-dad6c72efdb2 of volume 93768bad-6495-4d53-91ee-1a9467fdf6ea {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:19:56 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-a579c814-0528-4cc1-be70-69dc0825f914 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] snapshot_file for this snap is: volume-93768bad-6495-4d53-91ee-1a9467fdf6ea.ae90e3dc-a2d2-48a7-ac19-dad6c72efdb2 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:19:56 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9b36ddcc-7459-498a-b539-44b30224d12d tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56.042323b7-12ca-4ca7-8008-14482d185b08 1G" returned: 0 in 0.518s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9b36ddcc-7459-498a-b539-44b30224d12d tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd4e5458-cbad-4708-b0e7-77894c27ce56 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56.042323b7-12ca-4ca7-8008-14482d185b08 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:56 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[a171b7d9-9ab5-4b1a-9265-edd34b28cc13]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:19:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a579c814-0528-4cc1-be70-69dc0825f914 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea.ae90e3dc-a2d2-48a7-ac19-dad6c72efdb2 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:56 devstack sudo[100103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd4e5458-cbad-4708-b0e7-77894c27ce56 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56.042323b7-12ca-4ca7-8008-14482d185b08
Nov 04 12:19:56 devstack sudo[100103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:56 devstack sudo[100104]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea.ae90e3dc-a2d2-48a7-ac19-dad6c72efdb2
Nov 04 12:19:56 devstack sudo[100104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:56 devstack sudo[100103]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9b36ddcc-7459-498a-b539-44b30224d12d tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd4e5458-cbad-4708-b0e7-77894c27ce56 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56.042323b7-12ca-4ca7-8008-14482d185b08" returned: 0 in 0.357s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:56 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-9b36ddcc-7459-498a-b539-44b30224d12d tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56.042323b7-12ca-4ca7-8008-14482d185b08 is being set with open permissions: ugo+rw
Nov 04 12:19:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9b36ddcc-7459-498a-b539-44b30224d12d tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56.042323b7-12ca-4ca7-8008-14482d185b08 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:56 devstack sudo[100112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56.042323b7-12ca-4ca7-8008-14482d185b08
Nov 04 12:19:56 devstack sudo[100112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:56 devstack sudo[100104]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a579c814-0528-4cc1-be70-69dc0825f914 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea.ae90e3dc-a2d2-48a7-ac19-dad6c72efdb2" returned: 0 in 0.436s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:56 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-a579c814-0528-4cc1-be70-69dc0825f914 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93768bad-6495-4d53-91ee-1a9467fdf6ea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:19:56 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6939eb-1021-4bcc-90f1-fb78e1683eea]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:19:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a579c814-0528-4cc1-be70-69dc0825f914 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:56 devstack sudo[100116]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea
Nov 04 12:19:56 devstack sudo[100116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:56 devstack sudo[100112]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9b36ddcc-7459-498a-b539-44b30224d12d tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56.042323b7-12ca-4ca7-8008-14482d185b08" returned: 0 in 0.304s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9b36ddcc-7459-498a-b539-44b30224d12d tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:57 devstack sudo[100119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56.info
Nov 04 12:19:57 devstack sudo[100119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:57 devstack sudo[100116]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a579c814-0528-4cc1-be70-69dc0825f914 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea" returned: 0 in 0.422s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a579c814-0528-4cc1-be70-69dc0825f914 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea.ae90e3dc-a2d2-48a7-ac19-dad6c72efdb2 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:57 devstack sudo[100125]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea.ae90e3dc-a2d2-48a7-ac19-dad6c72efdb2
Nov 04 12:19:57 devstack sudo[100125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:57 devstack sudo[100119]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9b36ddcc-7459-498a-b539-44b30224d12d tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56.info" returned: 0 in 0.288s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:57 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-9b36ddcc-7459-498a-b539-44b30224d12d tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56.info is being set with open permissions: ugo+rw
Nov 04 12:19:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9b36ddcc-7459-498a-b539-44b30224d12d tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:57 devstack sudo[100127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56.info
Nov 04 12:19:57 devstack sudo[100127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:57 devstack sudo[100127]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9b36ddcc-7459-498a-b539-44b30224d12d tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56.info" returned: 0 in 0.270s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-9b36ddcc-7459-498a-b539-44b30224d12d tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.255s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:19:57 devstack sudo[100125]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a579c814-0528-4cc1-be70-69dc0825f914 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea.ae90e3dc-a2d2-48a7-ac19-dad6c72efdb2" returned: 0 in 0.369s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a579c814-0528-4cc1-be70-69dc0825f914 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea.ae90e3dc-a2d2-48a7-ac19-dad6c72efdb2 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:57 devstack sudo[100134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea.ae90e3dc-a2d2-48a7-ac19-dad6c72efdb2
Nov 04 12:19:57 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:57 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-9b36ddcc-7459-498a-b539-44b30224d12d tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Create snapshot completed successfully
Nov 04 12:19:57 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a579c814-0528-4cc1-be70-69dc0825f914 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea.ae90e3dc-a2d2-48a7-ac19-dad6c72efdb2" returned: 0 in 0.263s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:57 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a579c814-0528-4cc1-be70-69dc0825f914 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Lock "cinder-quobyte-ae90e3dc-a2d2-48a7-ac19-dad6c72efdb2" released by "_delete_snapshot" :: held 1.649s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:19:57 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a579c814-0528-4cc1-be70-69dc0825f914 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Lock "cinder-quobyte-93768bad-6495-4d53-91ee-1a9467fdf6ea" released by "delete_snapshot" :: held 1.680s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:19:57 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-a579c814-0528-4cc1-be70-69dc0825f914 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Created reservations ['2f96e896-520c-42ca-8e83-8377d4d7e69f', '3087fa52-ecc2-485b-9166-7397b56ed3e1', '107d0fd8-b531-43ef-9f7f-768524b820b0', '33228990-edd2-4a82-a307-21ae57b70149'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:19:58 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-a579c814-0528-4cc1-be70-69dc0825f914 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Delete snapshot completed successfully.
Nov 04 12:19:58 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a579c814-0528-4cc1-be70-69dc0825f914 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Lock "cinder-ae90e3dc-a2d2-48a7-ac19-dad6c72efdb2-delete_snapshot" released by "delete_snapshot" :: held 1.834s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:19:58 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d3414966-5c8d-4d28-b08e-74b98a82faa2 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Acquiring lock "cinder-93768bad-6495-4d53-91ee-1a9467fdf6ea-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:19:58 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d3414966-5c8d-4d28-b08e-74b98a82faa2 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Lock "cinder-93768bad-6495-4d53-91ee-1a9467fdf6ea-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:19:58 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d3414966-5c8d-4d28-b08e-74b98a82faa2 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Acquiring lock "cinder-quobyte-93768bad-6495-4d53-91ee-1a9467fdf6ea" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:19:58 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d3414966-5c8d-4d28-b08e-74b98a82faa2 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Lock "cinder-quobyte-93768bad-6495-4d53-91ee-1a9467fdf6ea" acquired by "delete_volume" :: waited 0.018s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:19:58 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e19e18-9de8-4713-a1d2-b03b685b6a09]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:19:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d3414966-5c8d-4d28-b08e-74b98a82faa2 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:58 devstack sudo[100137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea
Nov 04 12:19:58 devstack sudo[100137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:58 devstack sudo[100137]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d3414966-5c8d-4d28-b08e-74b98a82faa2 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea" returned: 0 in 0.402s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d3414966-5c8d-4d28-b08e-74b98a82faa2 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:58 devstack sudo[100142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea
Nov 04 12:19:58 devstack sudo[100142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3ea52aef-8ff1-42c1-9386-0f8cd6087f98 tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Acquiring lock "cinder-042323b7-12ca-4ca7-8008-14482d185b08-delete_snapshot" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3ea52aef-8ff1-42c1-9386-0f8cd6087f98 tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Lock "cinder-042323b7-12ca-4ca7-8008-14482d185b08-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3ea52aef-8ff1-42c1-9386-0f8cd6087f98 tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Acquiring lock "cinder-quobyte-fd4e5458-cbad-4708-b0e7-77894c27ce56" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:19:59 devstack sudo[100142]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d3414966-5c8d-4d28-b08e-74b98a82faa2 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-93768bad-6495-4d53-91ee-1a9467fdf6ea" returned: 0 in 0.317s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d3414966-5c8d-4d28-b08e-74b98a82faa2 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Lock "cinder-quobyte-93768bad-6495-4d53-91ee-1a9467fdf6ea" released by "delete_volume" :: held 0.793s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3ea52aef-8ff1-42c1-9386-0f8cd6087f98 tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Lock "cinder-quobyte-fd4e5458-cbad-4708-b0e7-77894c27ce56" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3ea52aef-8ff1-42c1-9386-0f8cd6087f98 tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Acquiring lock "cinder-quobyte-042323b7-12ca-4ca7-8008-14482d185b08" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3ea52aef-8ff1-42c1-9386-0f8cd6087f98 tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Lock "cinder-quobyte-042323b7-12ca-4ca7-8008-14482d185b08" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-3ea52aef-8ff1-42c1-9386-0f8cd6087f98 tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Deleting offline snapshot 042323b7-12ca-4ca7-8008-14482d185b08 of volume fd4e5458-cbad-4708-b0e7-77894c27ce56 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-3ea52aef-8ff1-42c1-9386-0f8cd6087f98 tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] snapshot_file for this snap is: volume-fd4e5458-cbad-4708-b0e7-77894c27ce56.042323b7-12ca-4ca7-8008-14482d185b08 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ade27fc-716f-49a8-8188-43730c7898b5]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3ea52aef-8ff1-42c1-9386-0f8cd6087f98 tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56.042323b7-12ca-4ca7-8008-14482d185b08 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-d3414966-5c8d-4d28-b08e-74b98a82faa2 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Created reservations ['03c3c5a2-33e2-42f9-ae4e-8e6c9b77cab2', 'c0df64a3-54fd-4c2b-b257-de58fe955cf4', '936310e5-6ba2-48f2-b810-b4acef140305', '92ad9a4f-c8e4-46cd-8296-32db8f76fa98'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4be6ad1-3ee2-42a0-864b-09c92f76b662 tempest-VolumesGetTest-484486462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d4be6ad1-3ee2-42a0-864b-09c92f76b662 tempest-VolumesGetTest-484486462 None] Flow 'volume_create_manager' (9f69aa40-4397-4664-8a8a-d406854f5166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d4be6ad1-3ee2-42a0-864b-09c92f76b662 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20e1e0c9-56ff-4d8e-be15-1b9614269f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d4be6ad1-3ee2-42a0-864b-09c92f76b662 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20e1e0c9-56ff-4d8e-be15-1b9614269f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1088326130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b783c900-de2f-473d-a8a6-2fd10d222659,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0c914710419c41eaa76715e3748b4cf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:19:59Z,use_quota=True,user_id='a5ba237f1e5e4ae78cb1c31fd084d325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d4be6ad1-3ee2-42a0-864b-09c92f76b662 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (533b325d-c4f5-43ab-9097-eb2f3f852ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d4be6ad1-3ee2-42a0-864b-09c92f76b662 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (533b325d-c4f5-43ab-9097-eb2f3f852ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:59 devstack sudo[100145]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56.042323b7-12ca-4ca7-8008-14482d185b08
Nov 04 12:19:59 devstack sudo[100145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d4be6ad1-3ee2-42a0-864b-09c92f76b662 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67caf0c9-0d2a-414b-9715-256f2ed34e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d4be6ad1-3ee2-42a0-864b-09c92f76b662 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67caf0c9-0d2a-414b-9715-256f2ed34e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b783c900-de2f-473d-a8a6-2fd10d222659', 'volume_name': 'volume-b783c900-de2f-473d-a8a6-2fd10d222659', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d4be6ad1-3ee2-42a0-864b-09c92f76b662 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92aa01e7-1b1b-4443-9437-5fe040b1d22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d4be6ad1-3ee2-42a0-864b-09c92f76b662 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92aa01e7-1b1b-4443-9437-5fe040b1d22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d4be6ad1-3ee2-42a0-864b-09c92f76b662 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a5c60c9-0268-4d22-b8fd-c99d025c2f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:19:59 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-d4be6ad1-3ee2-42a0-864b-09c92f76b662 tempest-VolumesGetTest-484486462 None] Volume b783c900-de2f-473d-a8a6-2fd10d222659: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b783c900-de2f-473d-a8a6-2fd10d222659', 'volume_size': 1}
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d4be6ad1-3ee2-42a0-864b-09c92f76b662 tempest-VolumesGetTest-484486462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d4be6ad1-3ee2-42a0-864b-09c92f76b662 tempest-VolumesGetTest-484486462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d4be6ad1-3ee2-42a0-864b-09c92f76b662 tempest-VolumesGetTest-484486462 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:19:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1088326130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b783c900-de2f-473d-a8a6-2fd10d222659,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0c914710419c41eaa76715e3748b4cf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:19:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:19:59Z,use_quota=True,user_id='a5ba237f1e5e4ae78cb1c31fd084d325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-d4be6ad1-3ee2-42a0-864b-09c92f76b662 tempest-VolumesGetTest-484486462 None] Creating volume b783c900-de2f-473d-a8a6-2fd10d222659 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d4be6ad1-3ee2-42a0-864b-09c92f76b662 tempest-VolumesGetTest-484486462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d4be6ad1-3ee2-42a0-864b-09c92f76b662 tempest-VolumesGetTest-484486462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d4be6ad1-3ee2-42a0-864b-09c92f76b662 tempest-VolumesGetTest-484486462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d4be6ad1-3ee2-42a0-864b-09c92f76b662 tempest-VolumesGetTest-484486462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d4be6ad1-3ee2-42a0-864b-09c92f76b662 tempest-VolumesGetTest-484486462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d4be6ad1-3ee2-42a0-864b-09c92f76b662 tempest-VolumesGetTest-484486462 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:19:59 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-d4be6ad1-3ee2-42a0-864b-09c92f76b662 tempest-VolumesGetTest-484486462 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d4be6ad1-3ee2-42a0-864b-09c92f76b662 tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-b783c900-de2f-473d-a8a6-2fd10d222659 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:59 devstack sudo[100147]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-b783c900-de2f-473d-a8a6-2fd10d222659 1073741824
Nov 04 12:19:59 devstack sudo[100147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d3414966-5c8d-4d28-b08e-74b98a82faa2 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d3414966-5c8d-4d28-b08e-74b98a82faa2 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d3414966-5c8d-4d28-b08e-74b98a82faa2 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d3414966-5c8d-4d28-b08e-74b98a82faa2 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d3414966-5c8d-4d28-b08e-74b98a82faa2 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d3414966-5c8d-4d28-b08e-74b98a82faa2 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:59 devstack sudo[100149]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:19:59 devstack sudo[100149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:19:59 devstack sudo[100145]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3ea52aef-8ff1-42c1-9386-0f8cd6087f98 tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56.042323b7-12ca-4ca7-8008-14482d185b08" returned: 0 in 0.420s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-3ea52aef-8ff1-42c1-9386-0f8cd6087f98 tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd4e5458-cbad-4708-b0e7-77894c27ce56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[049bc6cd-9b5e-4602-b0c3-24eee3264b37]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3ea52aef-8ff1-42c1-9386-0f8cd6087f98 tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:19:59 devstack sudo[100149]: pam_unix(sudo:session): session closed for user root
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d3414966-5c8d-4d28-b08e-74b98a82faa2 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.267s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-d3414966-5c8d-4d28-b08e-74b98a82faa2 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:19:59 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-d3414966-5c8d-4d28-b08e-74b98a82faa2 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Deleted volume successfully.
Nov 04 12:19:59 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d3414966-5c8d-4d28-b08e-74b98a82faa2 tempest-VolumesSnapshotNegativeTestJSON-1373480357 None] Lock "cinder-93768bad-6495-4d53-91ee-1a9467fdf6ea-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:19:59 devstack sudo[100157]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56
Nov 04 12:19:59 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:00 devstack sudo[100147]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d4be6ad1-3ee2-42a0-864b-09c92f76b662 tempest-VolumesGetTest-484486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-b783c900-de2f-473d-a8a6-2fd10d222659 1073741824" returned: 0 in 0.488s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d4be6ad1-3ee2-42a0-864b-09c92f76b662 tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-b783c900-de2f-473d-a8a6-2fd10d222659 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:00 devstack sudo[100160]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-b783c900-de2f-473d-a8a6-2fd10d222659
Nov 04 12:20:00 devstack sudo[100160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:00 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3ea52aef-8ff1-42c1-9386-0f8cd6087f98 tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56" returned: 0 in 0.427s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3ea52aef-8ff1-42c1-9386-0f8cd6087f98 tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56.042323b7-12ca-4ca7-8008-14482d185b08 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:00 devstack sudo[100165]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56.042323b7-12ca-4ca7-8008-14482d185b08
Nov 04 12:20:00 devstack sudo[100165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:00 devstack sudo[100160]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d4be6ad1-3ee2-42a0-864b-09c92f76b662 tempest-VolumesGetTest-484486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-b783c900-de2f-473d-a8a6-2fd10d222659" returned: 0 in 0.282s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:00 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d4be6ad1-3ee2-42a0-864b-09c92f76b662 tempest-VolumesGetTest-484486462 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:20:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d4be6ad1-3ee2-42a0-864b-09c92f76b662 tempest-VolumesGetTest-484486462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:20:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d4be6ad1-3ee2-42a0-864b-09c92f76b662 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a5c60c9-0268-4d22-b8fd-c99d025c2f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b783c900-de2f-473d-a8a6-2fd10d222659', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d4be6ad1-3ee2-42a0-864b-09c92f76b662 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc6e2d45-eba4-490c-a785-78b82056638e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:00 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-d4be6ad1-3ee2-42a0-864b-09c92f76b662 tempest-VolumesGetTest-484486462 None] Volume volume-b783c900-de2f-473d-a8a6-2fd10d222659 (b783c900-de2f-473d-a8a6-2fd10d222659): created successfully
Nov 04 12:20:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d4be6ad1-3ee2-42a0-864b-09c92f76b662 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc6e2d45-eba4-490c-a785-78b82056638e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d4be6ad1-3ee2-42a0-864b-09c92f76b662 tempest-VolumesGetTest-484486462 None] Flow 'volume_create_manager' (9f69aa40-4397-4664-8a8a-d406854f5166) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:20:00 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-d4be6ad1-3ee2-42a0-864b-09c92f76b662 tempest-VolumesGetTest-484486462 None] Created volume successfully.
Nov 04 12:20:00 devstack sudo[100165]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3ea52aef-8ff1-42c1-9386-0f8cd6087f98 tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56.042323b7-12ca-4ca7-8008-14482d185b08" returned: 0 in 0.353s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3ea52aef-8ff1-42c1-9386-0f8cd6087f98 tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56.042323b7-12ca-4ca7-8008-14482d185b08 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:00 devstack sudo[100171]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56.042323b7-12ca-4ca7-8008-14482d185b08
Nov 04 12:20:00 devstack sudo[100171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:00 devstack sudo[100171]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3ea52aef-8ff1-42c1-9386-0f8cd6087f98 tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56.042323b7-12ca-4ca7-8008-14482d185b08" returned: 0 in 0.284s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:00 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3ea52aef-8ff1-42c1-9386-0f8cd6087f98 tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Lock "cinder-quobyte-042323b7-12ca-4ca7-8008-14482d185b08" released by "_delete_snapshot" :: held 1.616s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:20:00 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3ea52aef-8ff1-42c1-9386-0f8cd6087f98 tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Lock "cinder-quobyte-fd4e5458-cbad-4708-b0e7-77894c27ce56" released by "delete_snapshot" :: held 1.646s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:20:01 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-3ea52aef-8ff1-42c1-9386-0f8cd6087f98 tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Created reservations ['61fabe63-1d58-4be1-ada3-83bdc3812cc0', 'ea51dba1-1f04-4e0f-a51d-069ebd135619', '11600308-43f0-48f3-a978-2729330b2a0f', 'eb8e88ba-1854-492e-bc40-82f94f518736'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:20:01 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-3ea52aef-8ff1-42c1-9386-0f8cd6087f98 tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Delete snapshot completed successfully.
Nov 04 12:20:01 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3ea52aef-8ff1-42c1-9386-0f8cd6087f98 tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Lock "cinder-042323b7-12ca-4ca7-8008-14482d185b08-delete_snapshot" released by "delete_snapshot" :: held 1.810s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:20:01 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-17c4c36f-b46e-45ee-888e-f671b093a1c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Acquiring lock "cinder-fd4e5458-cbad-4708-b0e7-77894c27ce56-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:20:01 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-17c4c36f-b46e-45ee-888e-f671b093a1c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Lock "cinder-fd4e5458-cbad-4708-b0e7-77894c27ce56-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:20:01 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-17c4c36f-b46e-45ee-888e-f671b093a1c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Acquiring lock "cinder-quobyte-fd4e5458-cbad-4708-b0e7-77894c27ce56" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:20:01 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-17c4c36f-b46e-45ee-888e-f671b093a1c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Lock "cinder-quobyte-fd4e5458-cbad-4708-b0e7-77894c27ce56" acquired by "delete_volume" :: waited 0.027s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:20:01 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d178c8e-6670-4dd9-9a03-948da13fa121]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:20:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-17c4c36f-b46e-45ee-888e-f671b093a1c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:01 devstack sudo[100175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56
Nov 04 12:20:01 devstack sudo[100175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:02 devstack sudo[100175]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-17c4c36f-b46e-45ee-888e-f671b093a1c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56" returned: 0 in 0.501s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-17c4c36f-b46e-45ee-888e-f671b093a1c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:02 devstack sudo[100181]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56
Nov 04 12:20:02 devstack sudo[100181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:02 devstack sudo[100181]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-17c4c36f-b46e-45ee-888e-f671b093a1c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fd4e5458-cbad-4708-b0e7-77894c27ce56" returned: 0 in 0.339s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:02 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-17c4c36f-b46e-45ee-888e-f671b093a1c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Lock "cinder-quobyte-fd4e5458-cbad-4708-b0e7-77894c27ce56" released by "delete_volume" :: held 0.941s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:20:02 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-17c4c36f-b46e-45ee-888e-f671b093a1c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Created reservations ['7fb0a3e4-3de2-457e-9c8a-63f5d747d4b2', '67223d45-e841-49ce-a6b9-c83a8046d150', 'c299ce5d-cc6e-4d44-8406-0f063002a9e0', 'f02ed477-760a-44e1-8837-6861512b1399'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:20:02 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-c321d0ed-b886-47bc-97f0-68c6e2f16835 tempest-VolumesGetTest-484486462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:20:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c321d0ed-b886-47bc-97f0-68c6e2f16835 tempest-VolumesGetTest-484486462 None] Flow 'volume_create_manager' (60c5f80a-c66d-4fb7-8a7c-5a2a86c0d42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:20:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c321d0ed-b886-47bc-97f0-68c6e2f16835 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa5a55c-3e79-40ef-9757-829e79573465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-17c4c36f-b46e-45ee-888e-f671b093a1c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:20:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-17c4c36f-b46e-45ee-888e-f671b093a1c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:20:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-17c4c36f-b46e-45ee-888e-f671b093a1c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:20:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-17c4c36f-b46e-45ee-888e-f671b093a1c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:20:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-17c4c36f-b46e-45ee-888e-f671b093a1c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:20:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-17c4c36f-b46e-45ee-888e-f671b093a1c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c321d0ed-b886-47bc-97f0-68c6e2f16835 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa5a55c-3e79-40ef-9757-829e79573465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:20:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1683016033',display_name='tempest-VolumesGetTest-Volume-1658608279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c58b4d20-1b49-41e5-8fe5-e44d3c724954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c914710419c41eaa76715e3748b4cf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:20:03Z,use_quota=True,user_id='a5ba237f1e5e4ae78cb1c31fd084d325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:02 devstack sudo[100184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:20:02 devstack sudo[100184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c321d0ed-b886-47bc-97f0-68c6e2f16835 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7d76e32-c648-4713-92cb-608db501d85f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c321d0ed-b886-47bc-97f0-68c6e2f16835 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7d76e32-c648-4713-92cb-608db501d85f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c321d0ed-b886-47bc-97f0-68c6e2f16835 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eb01746-5e50-400b-9b32-d5edc58667aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c321d0ed-b886-47bc-97f0-68c6e2f16835 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eb01746-5e50-400b-9b32-d5edc58667aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c58b4d20-1b49-41e5-8fe5-e44d3c724954', 'volume_name': 'volume-c58b4d20-1b49-41e5-8fe5-e44d3c724954', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c321d0ed-b886-47bc-97f0-68c6e2f16835 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3ad09d9-f4ad-4fa3-a59f-a2016b5fd430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c321d0ed-b886-47bc-97f0-68c6e2f16835 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3ad09d9-f4ad-4fa3-a59f-a2016b5fd430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c321d0ed-b886-47bc-97f0-68c6e2f16835 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (700ff700-d711-42ee-8e1c-2056d9a20d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:02 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-c321d0ed-b886-47bc-97f0-68c6e2f16835 tempest-VolumesGetTest-484486462 None] Volume c58b4d20-1b49-41e5-8fe5-e44d3c724954: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c58b4d20-1b49-41e5-8fe5-e44d3c724954', 'volume_size': 1}
Nov 04 12:20:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c321d0ed-b886-47bc-97f0-68c6e2f16835 tempest-VolumesGetTest-484486462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:20:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c321d0ed-b886-47bc-97f0-68c6e2f16835 tempest-VolumesGetTest-484486462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:20:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c321d0ed-b886-47bc-97f0-68c6e2f16835 tempest-VolumesGetTest-484486462 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:20:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1683016033',display_name='tempest-VolumesGetTest-Volume-1658608279',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c58b4d20-1b49-41e5-8fe5-e44d3c724954,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c914710419c41eaa76715e3748b4cf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:20:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:20:03Z,use_quota=True,user_id='a5ba237f1e5e4ae78cb1c31fd084d325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:20:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-c321d0ed-b886-47bc-97f0-68c6e2f16835 tempest-VolumesGetTest-484486462 None] Creating volume c58b4d20-1b49-41e5-8fe5-e44d3c724954 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:20:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c321d0ed-b886-47bc-97f0-68c6e2f16835 tempest-VolumesGetTest-484486462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:20:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c321d0ed-b886-47bc-97f0-68c6e2f16835 tempest-VolumesGetTest-484486462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:20:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c321d0ed-b886-47bc-97f0-68c6e2f16835 tempest-VolumesGetTest-484486462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:20:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c321d0ed-b886-47bc-97f0-68c6e2f16835 tempest-VolumesGetTest-484486462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:20:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c321d0ed-b886-47bc-97f0-68c6e2f16835 tempest-VolumesGetTest-484486462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:20:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c321d0ed-b886-47bc-97f0-68c6e2f16835 tempest-VolumesGetTest-484486462 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:20:02 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-c321d0ed-b886-47bc-97f0-68c6e2f16835 tempest-VolumesGetTest-484486462 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:20:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c321d0ed-b886-47bc-97f0-68c6e2f16835 tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c58b4d20-1b49-41e5-8fe5-e44d3c724954 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:02 devstack sudo[100186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c58b4d20-1b49-41e5-8fe5-e44d3c724954 1073741824
Nov 04 12:20:02 devstack sudo[100186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:02 devstack sudo[100184]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-17c4c36f-b46e-45ee-888e-f671b093a1c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.267s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:03 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-17c4c36f-b46e-45ee-888e-f671b093a1c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:20:03 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-17c4c36f-b46e-45ee-888e-f671b093a1c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Deleted volume successfully.
Nov 04 12:20:03 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-17c4c36f-b46e-45ee-888e-f671b093a1c9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1256552234 None] Lock "cinder-fd4e5458-cbad-4708-b0e7-77894c27ce56-delete_volume" released by "delete_volume" :: held 1.534s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:20:03 devstack sudo[100186]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c321d0ed-b886-47bc-97f0-68c6e2f16835 tempest-VolumesGetTest-484486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c58b4d20-1b49-41e5-8fe5-e44d3c724954 1073741824" returned: 0 in 0.470s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c321d0ed-b886-47bc-97f0-68c6e2f16835 tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c58b4d20-1b49-41e5-8fe5-e44d3c724954 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:03 devstack sudo[100193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c58b4d20-1b49-41e5-8fe5-e44d3c724954
Nov 04 12:20:03 devstack sudo[100193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:03 devstack sudo[100193]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c321d0ed-b886-47bc-97f0-68c6e2f16835 tempest-VolumesGetTest-484486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c58b4d20-1b49-41e5-8fe5-e44d3c724954" returned: 0 in 0.280s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:03 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c321d0ed-b886-47bc-97f0-68c6e2f16835 tempest-VolumesGetTest-484486462 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:20:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c321d0ed-b886-47bc-97f0-68c6e2f16835 tempest-VolumesGetTest-484486462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:20:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c321d0ed-b886-47bc-97f0-68c6e2f16835 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (700ff700-d711-42ee-8e1c-2056d9a20d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c58b4d20-1b49-41e5-8fe5-e44d3c724954', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c321d0ed-b886-47bc-97f0-68c6e2f16835 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0efa6c88-a647-43b3-ae7f-cdeb0facec1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:03 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-c321d0ed-b886-47bc-97f0-68c6e2f16835 tempest-VolumesGetTest-484486462 None] Volume volume-c58b4d20-1b49-41e5-8fe5-e44d3c724954 (c58b4d20-1b49-41e5-8fe5-e44d3c724954): created successfully
Nov 04 12:20:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c321d0ed-b886-47bc-97f0-68c6e2f16835 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0efa6c88-a647-43b3-ae7f-cdeb0facec1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c321d0ed-b886-47bc-97f0-68c6e2f16835 tempest-VolumesGetTest-484486462 None] Flow 'volume_create_manager' (60c5f80a-c66d-4fb7-8a7c-5a2a86c0d42a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:20:03 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-c321d0ed-b886-47bc-97f0-68c6e2f16835 tempest-VolumesGetTest-484486462 None] Created volume successfully.
Nov 04 12:20:04 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5bbb4dd9-80f0-4b3f-b48a-e7a8b7e32bc4 tempest-VolumesGetTest-484486462 None] Acquiring lock "cinder-c58b4d20-1b49-41e5-8fe5-e44d3c724954-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:20:04 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5bbb4dd9-80f0-4b3f-b48a-e7a8b7e32bc4 tempest-VolumesGetTest-484486462 None] Lock "cinder-c58b4d20-1b49-41e5-8fe5-e44d3c724954-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:20:04 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5bbb4dd9-80f0-4b3f-b48a-e7a8b7e32bc4 tempest-VolumesGetTest-484486462 None] Acquiring lock "cinder-quobyte-c58b4d20-1b49-41e5-8fe5-e44d3c724954" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:20:05 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5bbb4dd9-80f0-4b3f-b48a-e7a8b7e32bc4 tempest-VolumesGetTest-484486462 None] Lock "cinder-quobyte-c58b4d20-1b49-41e5-8fe5-e44d3c724954" acquired by "delete_volume" :: waited 0.021s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:20:05 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff71c62-b991-4d94-8ea3-042ed4574526]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:20:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5bbb4dd9-80f0-4b3f-b48a-e7a8b7e32bc4 tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c58b4d20-1b49-41e5-8fe5-e44d3c724954 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:05 devstack sudo[100196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c58b4d20-1b49-41e5-8fe5-e44d3c724954
Nov 04 12:20:05 devstack sudo[100196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:05 devstack sudo[100196]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5bbb4dd9-80f0-4b3f-b48a-e7a8b7e32bc4 tempest-VolumesGetTest-484486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c58b4d20-1b49-41e5-8fe5-e44d3c724954" returned: 0 in 0.456s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5bbb4dd9-80f0-4b3f-b48a-e7a8b7e32bc4 tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c58b4d20-1b49-41e5-8fe5-e44d3c724954 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:05 devstack sudo[100201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c58b4d20-1b49-41e5-8fe5-e44d3c724954
Nov 04 12:20:05 devstack sudo[100201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:05 devstack sudo[100201]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5bbb4dd9-80f0-4b3f-b48a-e7a8b7e32bc4 tempest-VolumesGetTest-484486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c58b4d20-1b49-41e5-8fe5-e44d3c724954" returned: 0 in 0.271s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:05 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5bbb4dd9-80f0-4b3f-b48a-e7a8b7e32bc4 tempest-VolumesGetTest-484486462 None] Lock "cinder-quobyte-c58b4d20-1b49-41e5-8fe5-e44d3c724954" released by "delete_volume" :: held 0.797s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:20:05 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-5bbb4dd9-80f0-4b3f-b48a-e7a8b7e32bc4 tempest-VolumesGetTest-484486462 None] Created reservations ['2efa9e46-597f-44b0-b9d5-8f88dffe4011', '78c9bd25-3f29-41fa-871a-2104efa7a30b', '5cbe7e21-9ecc-47c5-ae1b-e86c073e139b', '82c7a933-802a-4161-93e2-1fde0e081c0e'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:20:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5bbb4dd9-80f0-4b3f-b48a-e7a8b7e32bc4 tempest-VolumesGetTest-484486462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:20:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5bbb4dd9-80f0-4b3f-b48a-e7a8b7e32bc4 tempest-VolumesGetTest-484486462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:20:06 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5bbb4dd9-80f0-4b3f-b48a-e7a8b7e32bc4 tempest-VolumesGetTest-484486462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:20:06 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5bbb4dd9-80f0-4b3f-b48a-e7a8b7e32bc4 tempest-VolumesGetTest-484486462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:20:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5bbb4dd9-80f0-4b3f-b48a-e7a8b7e32bc4 tempest-VolumesGetTest-484486462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:20:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5bbb4dd9-80f0-4b3f-b48a-e7a8b7e32bc4 tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:06 devstack sudo[100204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:20:06 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:06 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-8bab0573-5064-48fe-9ef9-1332cfb1257a tempest-VolumesGetTest-484486462 None] Acquiring lock "cinder-b783c900-de2f-473d-a8a6-2fd10d222659-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:20:06 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-8bab0573-5064-48fe-9ef9-1332cfb1257a tempest-VolumesGetTest-484486462 None] Lock "cinder-b783c900-de2f-473d-a8a6-2fd10d222659-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:20:06 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-8bab0573-5064-48fe-9ef9-1332cfb1257a tempest-VolumesGetTest-484486462 None] Acquiring lock "cinder-quobyte-b783c900-de2f-473d-a8a6-2fd10d222659" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:20:06 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-8bab0573-5064-48fe-9ef9-1332cfb1257a tempest-VolumesGetTest-484486462 None] Lock "cinder-quobyte-b783c900-de2f-473d-a8a6-2fd10d222659" acquired by "delete_volume" :: waited 0.027s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:20:06 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5bbb4dd9-80f0-4b3f-b48a-e7a8b7e32bc4 tempest-VolumesGetTest-484486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.378s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:06 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-5bbb4dd9-80f0-4b3f-b48a-e7a8b7e32bc4 tempest-VolumesGetTest-484486462 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:20:06 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-5bbb4dd9-80f0-4b3f-b48a-e7a8b7e32bc4 tempest-VolumesGetTest-484486462 None] Deleted volume successfully.
Nov 04 12:20:06 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c49b6c-bcca-425d-a91b-8a3341db7693]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:20:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8bab0573-5064-48fe-9ef9-1332cfb1257a tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-b783c900-de2f-473d-a8a6-2fd10d222659 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:06 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5bbb4dd9-80f0-4b3f-b48a-e7a8b7e32bc4 tempest-VolumesGetTest-484486462 None] Lock "cinder-c58b4d20-1b49-41e5-8fe5-e44d3c724954-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:20:06 devstack sudo[100207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-b783c900-de2f-473d-a8a6-2fd10d222659
Nov 04 12:20:06 devstack sudo[100207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:06 devstack sudo[100207]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8bab0573-5064-48fe-9ef9-1332cfb1257a tempest-VolumesGetTest-484486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-b783c900-de2f-473d-a8a6-2fd10d222659" returned: 0 in 0.456s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8bab0573-5064-48fe-9ef9-1332cfb1257a tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-b783c900-de2f-473d-a8a6-2fd10d222659 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:06 devstack sudo[100212]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-b783c900-de2f-473d-a8a6-2fd10d222659
Nov 04 12:20:06 devstack sudo[100212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:07 devstack sudo[100212]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8bab0573-5064-48fe-9ef9-1332cfb1257a tempest-VolumesGetTest-484486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-b783c900-de2f-473d-a8a6-2fd10d222659" returned: 0 in 0.271s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:07 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-8bab0573-5064-48fe-9ef9-1332cfb1257a tempest-VolumesGetTest-484486462 None] Lock "cinder-quobyte-b783c900-de2f-473d-a8a6-2fd10d222659" released by "delete_volume" :: held 0.805s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:20:07 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=138,cinder:UPDATE=186,cinder:INSERT=54,cinder:DELETE=13 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:20:07 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-8bab0573-5064-48fe-9ef9-1332cfb1257a tempest-VolumesGetTest-484486462 None] Created reservations ['d2922bea-3d9f-4f14-b867-588181280483', '18388c10-7cd8-40e6-a75a-b798abd66188', 'fa33ebfb-da9e-4d08-814f-409b41f4089c', '98d30466-d38f-4cc0-b1b1-446951dbe04b'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:20:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8bab0573-5064-48fe-9ef9-1332cfb1257a tempest-VolumesGetTest-484486462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:20:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8bab0573-5064-48fe-9ef9-1332cfb1257a tempest-VolumesGetTest-484486462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:20:07 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-8bab0573-5064-48fe-9ef9-1332cfb1257a tempest-VolumesGetTest-484486462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:20:07 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-8bab0573-5064-48fe-9ef9-1332cfb1257a tempest-VolumesGetTest-484486462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:20:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8bab0573-5064-48fe-9ef9-1332cfb1257a tempest-VolumesGetTest-484486462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:20:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8bab0573-5064-48fe-9ef9-1332cfb1257a tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:07 devstack sudo[100215]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:20:07 devstack sudo[100215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:07 devstack sudo[100215]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8bab0573-5064-48fe-9ef9-1332cfb1257a tempest-VolumesGetTest-484486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.312s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:07 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-8bab0573-5064-48fe-9ef9-1332cfb1257a tempest-VolumesGetTest-484486462 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:20:07 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-8bab0573-5064-48fe-9ef9-1332cfb1257a tempest-VolumesGetTest-484486462 None] Deleted volume successfully.
Nov 04 12:20:07 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-8bab0573-5064-48fe-9ef9-1332cfb1257a tempest-VolumesGetTest-484486462 None] Lock "cinder-b783c900-de2f-473d-a8a6-2fd10d222659-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:20:08 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed496bc7-3298-495a-b492-db373c23a845 tempest-VolumesGetTest-484486462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:20:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ed496bc7-3298-495a-b492-db373c23a845 tempest-VolumesGetTest-484486462 None] Flow 'volume_create_manager' (a6dcb5c5-30a9-4db7-8e4d-a06646efeb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:20:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ed496bc7-3298-495a-b492-db373c23a845 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25a7e155-5a05-445e-9a99-a02ec3bf9704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ed496bc7-3298-495a-b492-db373c23a845 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25a7e155-5a05-445e-9a99-a02ec3bf9704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2143807212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a532b58c-5e20-412c-9772-54bea395cf3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c914710419c41eaa76715e3748b4cf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:20:08Z,use_quota=True,user_id='a5ba237f1e5e4ae78cb1c31fd084d325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ed496bc7-3298-495a-b492-db373c23a845 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec6e5873-6715-46e2-96d3-14708fe61fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ed496bc7-3298-495a-b492-db373c23a845 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec6e5873-6715-46e2-96d3-14708fe61fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ed496bc7-3298-495a-b492-db373c23a845 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (961275ec-3d81-4883-ba91-06c46d6f363b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ed496bc7-3298-495a-b492-db373c23a845 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (961275ec-3d81-4883-ba91-06c46d6f363b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a532b58c-5e20-412c-9772-54bea395cf3c', 'volume_name': 'volume-a532b58c-5e20-412c-9772-54bea395cf3c', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ed496bc7-3298-495a-b492-db373c23a845 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (179f89c8-3078-4e1f-a74d-89fd7b379e04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ed496bc7-3298-495a-b492-db373c23a845 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (179f89c8-3078-4e1f-a74d-89fd7b379e04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ed496bc7-3298-495a-b492-db373c23a845 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e56dd87-c017-4e1d-8cd5-e408cc42521a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:08 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-ed496bc7-3298-495a-b492-db373c23a845 tempest-VolumesGetTest-484486462 None] Volume a532b58c-5e20-412c-9772-54bea395cf3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a532b58c-5e20-412c-9772-54bea395cf3c', 'volume_size': 1}
Nov 04 12:20:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ed496bc7-3298-495a-b492-db373c23a845 tempest-VolumesGetTest-484486462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:20:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ed496bc7-3298-495a-b492-db373c23a845 tempest-VolumesGetTest-484486462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:20:08 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ed496bc7-3298-495a-b492-db373c23a845 tempest-VolumesGetTest-484486462 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:20:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2143807212',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a532b58c-5e20-412c-9772-54bea395cf3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c914710419c41eaa76715e3748b4cf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:20:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:20:08Z,use_quota=True,user_id='a5ba237f1e5e4ae78cb1c31fd084d325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:20:08 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-ed496bc7-3298-495a-b492-db373c23a845 tempest-VolumesGetTest-484486462 None] Creating volume a532b58c-5e20-412c-9772-54bea395cf3c {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:20:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ed496bc7-3298-495a-b492-db373c23a845 tempest-VolumesGetTest-484486462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:20:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ed496bc7-3298-495a-b492-db373c23a845 tempest-VolumesGetTest-484486462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:20:08 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ed496bc7-3298-495a-b492-db373c23a845 tempest-VolumesGetTest-484486462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:20:08 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ed496bc7-3298-495a-b492-db373c23a845 tempest-VolumesGetTest-484486462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:20:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ed496bc7-3298-495a-b492-db373c23a845 tempest-VolumesGetTest-484486462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:20:08 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ed496bc7-3298-495a-b492-db373c23a845 tempest-VolumesGetTest-484486462 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:20:08 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-ed496bc7-3298-495a-b492-db373c23a845 tempest-VolumesGetTest-484486462 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:20:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ed496bc7-3298-495a-b492-db373c23a845 tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:08 devstack sudo[100218]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c 1073741824
Nov 04 12:20:08 devstack sudo[100218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:08 devstack sudo[100218]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ed496bc7-3298-495a-b492-db373c23a845 tempest-VolumesGetTest-484486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c 1073741824" returned: 0 in 0.521s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ed496bc7-3298-495a-b492-db373c23a845 tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:08 devstack sudo[100224]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c
Nov 04 12:20:08 devstack sudo[100224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:09 devstack sudo[100224]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ed496bc7-3298-495a-b492-db373c23a845 tempest-VolumesGetTest-484486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c" returned: 0 in 0.263s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:09 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ed496bc7-3298-495a-b492-db373c23a845 tempest-VolumesGetTest-484486462 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:20:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ed496bc7-3298-495a-b492-db373c23a845 tempest-VolumesGetTest-484486462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:20:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ed496bc7-3298-495a-b492-db373c23a845 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e56dd87-c017-4e1d-8cd5-e408cc42521a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a532b58c-5e20-412c-9772-54bea395cf3c', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ed496bc7-3298-495a-b492-db373c23a845 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4e7e782-1ed1-4d27-a6e7-cbdc2534abe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:09 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-ed496bc7-3298-495a-b492-db373c23a845 tempest-VolumesGetTest-484486462 None] Volume volume-a532b58c-5e20-412c-9772-54bea395cf3c (a532b58c-5e20-412c-9772-54bea395cf3c): created successfully
Nov 04 12:20:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ed496bc7-3298-495a-b492-db373c23a845 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4e7e782-1ed1-4d27-a6e7-cbdc2534abe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ed496bc7-3298-495a-b492-db373c23a845 tempest-VolumesGetTest-484486462 None] Flow 'volume_create_manager' (a6dcb5c5-30a9-4db7-8e4d-a06646efeb6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:20:09 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-ed496bc7-3298-495a-b492-db373c23a845 tempest-VolumesGetTest-484486462 None] Created volume successfully.
Nov 04 12:20:10 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:20:10 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Flow 'volume_create_manager' (9327e92c-1590-4200-b47c-96f44a380db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:20:10 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c633676-82dc-4dfc-9b4c-3bad515d1b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:10 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c633676-82dc-4dfc-9b4c-3bad515d1b31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-150171372',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50e0aac0-9419-429b-93b6-b34753b81ad7,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0c914710419c41eaa76715e3748b4cf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=a532b58c-5e20-412c-9772-54bea395cf3c,status='creating',terminated_at=None,updated_at=2026-11-04T11:20:11Z,use_quota=True,user_id='a5ba237f1e5e4ae78cb1c31fd084d325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:10 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e857ce78-2011-480c-8605-a1d939b866d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e857ce78-2011-480c-8605-a1d939b866d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b634cf8-52ed-4b2a-b002-7a1f07bf96f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b634cf8-52ed-4b2a-b002-7a1f07bf96f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '50e0aac0-9419-429b-93b6-b34753b81ad7', 'volume_name': 'volume-50e0aac0-9419-429b-93b6-b34753b81ad7', 'volume_size': 1, 'source_volid': 'a532b58c-5e20-412c-9772-54bea395cf3c', 'source_volstatus': 'available'}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7b92564-c433-4e05-a239-bf904ae57b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7b92564-c433-4e05-a239-bf904ae57b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45d17002-9f31-4dd4-a058-6aa41bf2cbfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:11 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Volume 50e0aac0-9419-429b-93b6-b34753b81ad7: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-50e0aac0-9419-429b-93b6-b34753b81ad7', 'volume_size': 1, 'source_volid': 'a532b58c-5e20-412c-9772-54bea395cf3c', 'source_volstatus': 'available'}
Nov 04 12:20:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:20:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:20:11 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Cloning volume a532b58c-5e20-412c-9772-54bea395cf3c to volume 50e0aac0-9419-429b-93b6-b34753b81ad7
Nov 04 12:20:11 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Creating offline snapshot febb5414-a330-44db-b1c5-599d4b530bb7 of volume a532b58c-5e20-412c-9772-54bea395cf3c {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:20:11 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b414c0-c3a8-4f3e-a1be-e53eaec366bf]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:20:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:11 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2ded94d-6bd3-46bc-8012-04acda415107 tempest-VolumesListAdminTestJSON-653064872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:20:11 devstack sudo[100228]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c
Nov 04 12:20:11 devstack sudo[100228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e2ded94d-6bd3-46bc-8012-04acda415107 tempest-VolumesListAdminTestJSON-653064872 None] Flow 'volume_create_manager' (410b03a4-ae83-45bd-a169-13611449c3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:20:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e2ded94d-6bd3-46bc-8012-04acda415107 tempest-VolumesListAdminTestJSON-653064872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e78e7b5b-33cd-4aa3-b764-876317abdb74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e2ded94d-6bd3-46bc-8012-04acda415107 tempest-VolumesListAdminTestJSON-653064872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e78e7b5b-33cd-4aa3-b764-876317abdb74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-679807485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd071116-fcda-4d86-a127-6e3a8977ae4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='822306bab232457fb200ef2a7a8ab302',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:20:11Z,use_quota=True,user_id='17aa948e09294dc1be1d7054a78d84f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e2ded94d-6bd3-46bc-8012-04acda415107 tempest-VolumesListAdminTestJSON-653064872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d2ef43a-4270-4e20-a833-25e5f51b4126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e2ded94d-6bd3-46bc-8012-04acda415107 tempest-VolumesListAdminTestJSON-653064872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d2ef43a-4270-4e20-a833-25e5f51b4126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e2ded94d-6bd3-46bc-8012-04acda415107 tempest-VolumesListAdminTestJSON-653064872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfc80b36-d067-415a-83b4-a96921955219) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e2ded94d-6bd3-46bc-8012-04acda415107 tempest-VolumesListAdminTestJSON-653064872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfc80b36-d067-415a-83b4-a96921955219) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd071116-fcda-4d86-a127-6e3a8977ae4d', 'volume_name': 'volume-dd071116-fcda-4d86-a127-6e3a8977ae4d', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e2ded94d-6bd3-46bc-8012-04acda415107 tempest-VolumesListAdminTestJSON-653064872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4bd91c8-c443-40f0-bf75-92938a9510f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e2ded94d-6bd3-46bc-8012-04acda415107 tempest-VolumesListAdminTestJSON-653064872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4bd91c8-c443-40f0-bf75-92938a9510f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e2ded94d-6bd3-46bc-8012-04acda415107 tempest-VolumesListAdminTestJSON-653064872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8e65ee5-6729-417a-912b-98f76409127a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:11 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-e2ded94d-6bd3-46bc-8012-04acda415107 tempest-VolumesListAdminTestJSON-653064872 None] Volume dd071116-fcda-4d86-a127-6e3a8977ae4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd071116-fcda-4d86-a127-6e3a8977ae4d', 'volume_size': 1}
Nov 04 12:20:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e2ded94d-6bd3-46bc-8012-04acda415107 tempest-VolumesListAdminTestJSON-653064872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:20:11 devstack sudo[100228]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c" returned: 0 in 0.507s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c.febb5414-a330-44db-b1c5-599d4b530bb7 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:11 devstack sudo[100235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c.febb5414-a330-44db-b1c5-599d4b530bb7 1G
Nov 04 12:20:11 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:12 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c.febb5414-a330-44db-b1c5-599d4b530bb7 1G" returned: 0 in 0.461s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a532b58c-5e20-412c-9772-54bea395cf3c -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c.febb5414-a330-44db-b1c5-599d4b530bb7 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:12 devstack sudo[100242]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a532b58c-5e20-412c-9772-54bea395cf3c -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c.febb5414-a330-44db-b1c5-599d4b530bb7
Nov 04 12:20:12 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:12 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a532b58c-5e20-412c-9772-54bea395cf3c -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c.febb5414-a330-44db-b1c5-599d4b530bb7" returned: 0 in 0.302s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:12 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c.febb5414-a330-44db-b1c5-599d4b530bb7 is being set with open permissions: ugo+rw
Nov 04 12:20:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c.febb5414-a330-44db-b1c5-599d4b530bb7 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:12 devstack sudo[100248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c.febb5414-a330-44db-b1c5-599d4b530bb7
Nov 04 12:20:12 devstack sudo[100248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:12 devstack sudo[100248]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c.febb5414-a330-44db-b1c5-599d4b530bb7" returned: 0 in 0.258s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:12 devstack sudo[100251]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c.info
Nov 04 12:20:12 devstack sudo[100251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:13 devstack sudo[100251]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c.info" returned: 0 in 0.272s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:13 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c.info is being set with open permissions: ugo+rw
Nov 04 12:20:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:13 devstack sudo[100254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c.info
Nov 04 12:20:13 devstack sudo[100254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:13 devstack sudo[100254]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c.info" returned: 0 in 0.254s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:13 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Acquiring lock "cinder-quobyte-50e0aac0-9419-429b-93b6-b34753b81ad7" by "_copy_volume_from_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:20:13 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Lock "cinder-quobyte-50e0aac0-9419-429b-93b6-b34753b81ad7" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:20:13 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] snapshot: febb5414-a330-44db-b1c5-599d4b530bb7, volume: 50e0aac0-9419-429b-93b6-b34753b81ad7,  {{(pid=87169) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 04 12:20:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:20:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:20:13 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:20:13 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:20:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:20:13 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec38c6c6-4213-4266-902c-68f90e292bba]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:20:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c.febb5414-a330-44db-b1c5-599d4b530bb7 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:13 devstack sudo[100257]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c.febb5414-a330-44db-b1c5-599d4b530bb7
Nov 04 12:20:13 devstack sudo[100257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:13 devstack sudo[100257]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c.febb5414-a330-44db-b1c5-599d4b530bb7" returned: 0 in 0.432s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:13 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a532b58c-5e20-412c-9772-54bea395cf3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:20:13 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff84cc92-9a8b-456f-87e4-474e4391a088]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:20:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:14 devstack sudo[100262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c
Nov 04 12:20:14 devstack sudo[100262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:14 devstack sudo[100262]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c" returned: 0 in 0.393s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:14 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c {{(pid=87169) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 04 12:20:14 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Creating direct copy from snapshot {{(pid=87169) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 04 12:20:14 devstack cinder-volume[87169]: DEBUG cinder.utils [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Path /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-50e0aac0-9419-429b-93b6-b34753b81ad7 not found in is_blk_device check {{(pid=87169) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 04 12:20:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-50e0aac0-9419-429b-93b6-b34753b81ad7 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:14 devstack sudo[100267]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-50e0aac0-9419-429b-93b6-b34753b81ad7
Nov 04 12:20:14 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:21 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-50e0aac0-9419-429b-93b6-b34753b81ad7" returned: 0 in 6.926s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:21 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Image conversion details: src /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c, size 1024.00 MB, duration 6.93 sec, destination /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-50e0aac0-9419-429b-93b6-b34753b81ad7 {{(pid=87169) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 12:20:21 devstack cinder-volume[87169]: INFO cinder.image.image_utils [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Converted 1024.00 MB image at 147.82 MB/s
Nov 04 12:20:21 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-50e0aac0-9419-429b-93b6-b34753b81ad7 is being set with open permissions: ugo+rw
Nov 04 12:20:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-50e0aac0-9419-429b-93b6-b34753b81ad7 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:21 devstack sudo[100282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-50e0aac0-9419-429b-93b6-b34753b81ad7
Nov 04 12:20:21 devstack sudo[100282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:21 devstack sudo[100282]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-50e0aac0-9419-429b-93b6-b34753b81ad7" returned: 0 in 0.244s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:21 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Lock "cinder-quobyte-50e0aac0-9419-429b-93b6-b34753b81ad7" released by "_copy_volume_from_snapshot" :: held 8.089s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:20:21 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Acquiring lock "cinder-quobyte-febb5414-a330-44db-b1c5-599d4b530bb7" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:20:21 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Lock "cinder-quobyte-febb5414-a330-44db-b1c5-599d4b530bb7" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:20:21 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Deleting offline snapshot febb5414-a330-44db-b1c5-599d4b530bb7 of volume a532b58c-5e20-412c-9772-54bea395cf3c {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:20:21 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] snapshot_file for this snap is: volume-a532b58c-5e20-412c-9772-54bea395cf3c.febb5414-a330-44db-b1c5-599d4b530bb7 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:20:21 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[46554cbf-b032-4916-9795-ad5b0c212ed6]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:20:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c.febb5414-a330-44db-b1c5-599d4b530bb7 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:21 devstack sudo[100285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c.febb5414-a330-44db-b1c5-599d4b530bb7
Nov 04 12:20:21 devstack sudo[100285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:21 devstack sudo[100285]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c.febb5414-a330-44db-b1c5-599d4b530bb7" returned: 0 in 0.371s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:21 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a532b58c-5e20-412c-9772-54bea395cf3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:20:21 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae6b2fd-b44a-44ed-a6a3-145487d7f395]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:20:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:22 devstack sudo[100290]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c
Nov 04 12:20:22 devstack sudo[100290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:22 devstack sudo[100290]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c" returned: 0 in 0.628s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c.febb5414-a330-44db-b1c5-599d4b530bb7 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:22 devstack sudo[100295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c.febb5414-a330-44db-b1c5-599d4b530bb7
Nov 04 12:20:22 devstack sudo[100295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:22 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=116,cinder:UPDATE=139,cinder:DELETE=10,cinder:INSERT=38 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:20:22 devstack sudo[100295]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c.febb5414-a330-44db-b1c5-599d4b530bb7" returned: 0 in 0.345s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c.febb5414-a330-44db-b1c5-599d4b530bb7 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:22 devstack sudo[100301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c.febb5414-a330-44db-b1c5-599d4b530bb7
Nov 04 12:20:22 devstack sudo[100301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:23 devstack sudo[100301]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c.febb5414-a330-44db-b1c5-599d4b530bb7" returned: 0 in 0.243s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:23 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Lock "cinder-quobyte-febb5414-a330-44db-b1c5-599d4b530bb7" released by "_delete_snapshot" :: held 1.682s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:20:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.075s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:20:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e2ded94d-6bd3-46bc-8012-04acda415107 tempest-VolumesListAdminTestJSON-653064872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.722s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:20:23 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e2ded94d-6bd3-46bc-8012-04acda415107 tempest-VolumesListAdminTestJSON-653064872 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-679807485',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd071116-fcda-4d86-a127-6e3a8977ae4d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='822306bab232457fb200ef2a7a8ab302',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:20:11Z,use_quota=True,user_id='17aa948e09294dc1be1d7054a78d84f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:20:23 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-e2ded94d-6bd3-46bc-8012-04acda415107 tempest-VolumesListAdminTestJSON-653064872 None] Creating volume dd071116-fcda-4d86-a127-6e3a8977ae4d {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:20:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e2ded94d-6bd3-46bc-8012-04acda415107 tempest-VolumesListAdminTestJSON-653064872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:20:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e2ded94d-6bd3-46bc-8012-04acda415107 tempest-VolumesListAdminTestJSON-653064872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:20:23 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e2ded94d-6bd3-46bc-8012-04acda415107 tempest-VolumesListAdminTestJSON-653064872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:20:23 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e2ded94d-6bd3-46bc-8012-04acda415107 tempest-VolumesListAdminTestJSON-653064872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:20:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e2ded94d-6bd3-46bc-8012-04acda415107 tempest-VolumesListAdminTestJSON-653064872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:20:23 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e2ded94d-6bd3-46bc-8012-04acda415107 tempest-VolumesListAdminTestJSON-653064872 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:20:23 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-e2ded94d-6bd3-46bc-8012-04acda415107 tempest-VolumesListAdminTestJSON-653064872 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:20:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e2ded94d-6bd3-46bc-8012-04acda415107 tempest-VolumesListAdminTestJSON-653064872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-dd071116-fcda-4d86-a127-6e3a8977ae4d 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:23 devstack sudo[100304]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-dd071116-fcda-4d86-a127-6e3a8977ae4d 1073741824
Nov 04 12:20:23 devstack sudo[100304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:23 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45d17002-9f31-4dd4-a058-6aa41bf2cbfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50e0aac0-9419-429b-93b6-b34753b81ad7', 'volume_size': 1, 'source_volid': 'a532b58c-5e20-412c-9772-54bea395cf3c', 'source_volstatus': 'available'}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:23 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37f1c0e2-ccd4-449c-8a33-e1305c810133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:23 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Volume volume-50e0aac0-9419-429b-93b6-b34753b81ad7 (50e0aac0-9419-429b-93b6-b34753b81ad7): created successfully
Nov 04 12:20:23 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37f1c0e2-ccd4-449c-8a33-e1305c810133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:23 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Flow 'volume_create_manager' (9327e92c-1590-4200-b47c-96f44a380db6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:20:23 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-230854c9-4f5f-4ae7-abca-9959792c4e4d tempest-VolumesGetTest-484486462 None] Created volume successfully.
Nov 04 12:20:23 devstack sudo[100304]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e2ded94d-6bd3-46bc-8012-04acda415107 tempest-VolumesListAdminTestJSON-653064872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-dd071116-fcda-4d86-a127-6e3a8977ae4d 1073741824" returned: 0 in 0.502s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e2ded94d-6bd3-46bc-8012-04acda415107 tempest-VolumesListAdminTestJSON-653064872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-dd071116-fcda-4d86-a127-6e3a8977ae4d {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:23 devstack sudo[100311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-dd071116-fcda-4d86-a127-6e3a8977ae4d
Nov 04 12:20:23 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:24 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e2ded94d-6bd3-46bc-8012-04acda415107 tempest-VolumesListAdminTestJSON-653064872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-dd071116-fcda-4d86-a127-6e3a8977ae4d" returned: 0 in 0.287s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:24 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e2ded94d-6bd3-46bc-8012-04acda415107 tempest-VolumesListAdminTestJSON-653064872 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:20:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e2ded94d-6bd3-46bc-8012-04acda415107 tempest-VolumesListAdminTestJSON-653064872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:20:24 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e2ded94d-6bd3-46bc-8012-04acda415107 tempest-VolumesListAdminTestJSON-653064872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8e65ee5-6729-417a-912b-98f76409127a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd071116-fcda-4d86-a127-6e3a8977ae4d', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:24 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e2ded94d-6bd3-46bc-8012-04acda415107 tempest-VolumesListAdminTestJSON-653064872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66f393ab-969a-4327-b756-2810d3db41fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:24 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-e2ded94d-6bd3-46bc-8012-04acda415107 tempest-VolumesListAdminTestJSON-653064872 None] Volume volume-dd071116-fcda-4d86-a127-6e3a8977ae4d (dd071116-fcda-4d86-a127-6e3a8977ae4d): created successfully
Nov 04 12:20:24 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e2ded94d-6bd3-46bc-8012-04acda415107 tempest-VolumesListAdminTestJSON-653064872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66f393ab-969a-4327-b756-2810d3db41fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:24 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e2ded94d-6bd3-46bc-8012-04acda415107 tempest-VolumesListAdminTestJSON-653064872 None] Flow 'volume_create_manager' (410b03a4-ae83-45bd-a169-13611449c3c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:20:24 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-e2ded94d-6bd3-46bc-8012-04acda415107 tempest-VolumesListAdminTestJSON-653064872 None] Created volume successfully.
Nov 04 12:20:24 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad5a5cc6-0853-4db7-bbe6-120e6db59dcb tempest-VolumesGetTest-484486462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:20:24 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ad5a5cc6-0853-4db7-bbe6-120e6db59dcb tempest-VolumesGetTest-484486462 None] Flow 'volume_create_manager' (524480b3-0c1d-4112-9aab-b0ad05bf1274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:20:24 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ad5a5cc6-0853-4db7-bbe6-120e6db59dcb tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e8c8cfa-e8ef-4e0b-94b4-e405a5ec60e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:24 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ad5a5cc6-0853-4db7-bbe6-120e6db59dcb tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e8c8cfa-e8ef-4e0b-94b4-e405a5ec60e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:20:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-574305401',display_name='tempest-VolumesGetTest-Volume-626114532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ec78071-8ded-48c3-8ec6-d985e63d18a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c914710419c41eaa76715e3748b4cf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:20:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:20:25Z,use_quota=True,user_id='a5ba237f1e5e4ae78cb1c31fd084d325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:24 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ad5a5cc6-0853-4db7-bbe6-120e6db59dcb tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c9eb978-9120-4984-a72a-086aecb69cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:24 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ad5a5cc6-0853-4db7-bbe6-120e6db59dcb tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c9eb978-9120-4984-a72a-086aecb69cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:24 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ad5a5cc6-0853-4db7-bbe6-120e6db59dcb tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3617c596-6022-4980-b6bf-d1675b0a7f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:24 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ad5a5cc6-0853-4db7-bbe6-120e6db59dcb tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3617c596-6022-4980-b6bf-d1675b0a7f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ec78071-8ded-48c3-8ec6-d985e63d18a6', 'volume_name': 'volume-9ec78071-8ded-48c3-8ec6-d985e63d18a6', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:24 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ad5a5cc6-0853-4db7-bbe6-120e6db59dcb tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38930a27-6d61-4a63-9797-b0d0bae05e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:24 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ad5a5cc6-0853-4db7-bbe6-120e6db59dcb tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38930a27-6d61-4a63-9797-b0d0bae05e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:24 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ad5a5cc6-0853-4db7-bbe6-120e6db59dcb tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e891932-c775-49b6-bdde-6e20e1a558b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:24 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-ad5a5cc6-0853-4db7-bbe6-120e6db59dcb tempest-VolumesGetTest-484486462 None] Volume 9ec78071-8ded-48c3-8ec6-d985e63d18a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ec78071-8ded-48c3-8ec6-d985e63d18a6', 'volume_size': 1}
Nov 04 12:20:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ad5a5cc6-0853-4db7-bbe6-120e6db59dcb tempest-VolumesGetTest-484486462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:20:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ad5a5cc6-0853-4db7-bbe6-120e6db59dcb tempest-VolumesGetTest-484486462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:20:24 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ad5a5cc6-0853-4db7-bbe6-120e6db59dcb tempest-VolumesGetTest-484486462 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:20:24Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-574305401',display_name='tempest-VolumesGetTest-Volume-626114532',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ec78071-8ded-48c3-8ec6-d985e63d18a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c914710419c41eaa76715e3748b4cf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:20:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:20:25Z,use_quota=True,user_id='a5ba237f1e5e4ae78cb1c31fd084d325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:20:24 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-ad5a5cc6-0853-4db7-bbe6-120e6db59dcb tempest-VolumesGetTest-484486462 None] Creating volume 9ec78071-8ded-48c3-8ec6-d985e63d18a6 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:20:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ad5a5cc6-0853-4db7-bbe6-120e6db59dcb tempest-VolumesGetTest-484486462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:20:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ad5a5cc6-0853-4db7-bbe6-120e6db59dcb tempest-VolumesGetTest-484486462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:20:24 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ad5a5cc6-0853-4db7-bbe6-120e6db59dcb tempest-VolumesGetTest-484486462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:20:24 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ad5a5cc6-0853-4db7-bbe6-120e6db59dcb tempest-VolumesGetTest-484486462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:20:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ad5a5cc6-0853-4db7-bbe6-120e6db59dcb tempest-VolumesGetTest-484486462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:20:24 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ad5a5cc6-0853-4db7-bbe6-120e6db59dcb tempest-VolumesGetTest-484486462 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:20:24 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-ad5a5cc6-0853-4db7-bbe6-120e6db59dcb tempest-VolumesGetTest-484486462 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:20:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ad5a5cc6-0853-4db7-bbe6-120e6db59dcb tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9ec78071-8ded-48c3-8ec6-d985e63d18a6 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:24 devstack sudo[100314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9ec78071-8ded-48c3-8ec6-d985e63d18a6 1073741824
Nov 04 12:20:24 devstack sudo[100314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:25 devstack sudo[100314]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ad5a5cc6-0853-4db7-bbe6-120e6db59dcb tempest-VolumesGetTest-484486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9ec78071-8ded-48c3-8ec6-d985e63d18a6 1073741824" returned: 0 in 0.482s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ad5a5cc6-0853-4db7-bbe6-120e6db59dcb tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9ec78071-8ded-48c3-8ec6-d985e63d18a6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:25 devstack sudo[100320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9ec78071-8ded-48c3-8ec6-d985e63d18a6
Nov 04 12:20:25 devstack sudo[100320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:25 devstack sudo[100320]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ad5a5cc6-0853-4db7-bbe6-120e6db59dcb tempest-VolumesGetTest-484486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9ec78071-8ded-48c3-8ec6-d985e63d18a6" returned: 0 in 0.294s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:25 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ad5a5cc6-0853-4db7-bbe6-120e6db59dcb tempest-VolumesGetTest-484486462 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:20:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ad5a5cc6-0853-4db7-bbe6-120e6db59dcb tempest-VolumesGetTest-484486462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:20:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ad5a5cc6-0853-4db7-bbe6-120e6db59dcb tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e891932-c775-49b6-bdde-6e20e1a558b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ec78071-8ded-48c3-8ec6-d985e63d18a6', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ad5a5cc6-0853-4db7-bbe6-120e6db59dcb tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b64b8b49-ff0e-49a4-8e33-532d4e374449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:25 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-ad5a5cc6-0853-4db7-bbe6-120e6db59dcb tempest-VolumesGetTest-484486462 None] Volume volume-9ec78071-8ded-48c3-8ec6-d985e63d18a6 (9ec78071-8ded-48c3-8ec6-d985e63d18a6): created successfully
Nov 04 12:20:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ad5a5cc6-0853-4db7-bbe6-120e6db59dcb tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b64b8b49-ff0e-49a4-8e33-532d4e374449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ad5a5cc6-0853-4db7-bbe6-120e6db59dcb tempest-VolumesGetTest-484486462 None] Flow 'volume_create_manager' (524480b3-0c1d-4112-9aab-b0ad05bf1274) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:20:25 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-ad5a5cc6-0853-4db7-bbe6-120e6db59dcb tempest-VolumesGetTest-484486462 None] Created volume successfully.
Nov 04 12:20:25 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-8805e16d-4c39-4ef1-9670-2d7408138ff3 tempest-VolumesListAdminTestJSON-653064872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:20:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8805e16d-4c39-4ef1-9670-2d7408138ff3 tempest-VolumesListAdminTestJSON-653064872 None] Flow 'volume_create_manager' (0d4a5e19-229f-4edf-abe4-41e1e4b5fa85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:20:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8805e16d-4c39-4ef1-9670-2d7408138ff3 tempest-VolumesListAdminTestJSON-653064872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf9d40b-bf71-40d8-a551-094347aab32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8805e16d-4c39-4ef1-9670-2d7408138ff3 tempest-VolumesListAdminTestJSON-653064872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdf9d40b-bf71-40d8-a551-094347aab32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2021694365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca6443be-6a39-4466-a8e4-c21f03563af8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='822306bab232457fb200ef2a7a8ab302',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:20:26Z,use_quota=True,user_id='17aa948e09294dc1be1d7054a78d84f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8805e16d-4c39-4ef1-9670-2d7408138ff3 tempest-VolumesListAdminTestJSON-653064872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cef7eb67-ef6d-4aa3-86c5-e45bb04fda96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8805e16d-4c39-4ef1-9670-2d7408138ff3 tempest-VolumesListAdminTestJSON-653064872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cef7eb67-ef6d-4aa3-86c5-e45bb04fda96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8805e16d-4c39-4ef1-9670-2d7408138ff3 tempest-VolumesListAdminTestJSON-653064872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c48d5fa-9d29-4d0f-939a-7be7c5c581b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8805e16d-4c39-4ef1-9670-2d7408138ff3 tempest-VolumesListAdminTestJSON-653064872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c48d5fa-9d29-4d0f-939a-7be7c5c581b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca6443be-6a39-4466-a8e4-c21f03563af8', 'volume_name': 'volume-ca6443be-6a39-4466-a8e4-c21f03563af8', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:26 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8805e16d-4c39-4ef1-9670-2d7408138ff3 tempest-VolumesListAdminTestJSON-653064872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b82b6ee-25f4-4dfa-b92e-21ad8bf84f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:26 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8805e16d-4c39-4ef1-9670-2d7408138ff3 tempest-VolumesListAdminTestJSON-653064872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b82b6ee-25f4-4dfa-b92e-21ad8bf84f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:26 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8805e16d-4c39-4ef1-9670-2d7408138ff3 tempest-VolumesListAdminTestJSON-653064872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bfa8f46-3b7a-42fa-a0be-5c63f5dba1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:26 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-8805e16d-4c39-4ef1-9670-2d7408138ff3 tempest-VolumesListAdminTestJSON-653064872 None] Volume ca6443be-6a39-4466-a8e4-c21f03563af8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca6443be-6a39-4466-a8e4-c21f03563af8', 'volume_size': 1}
Nov 04 12:20:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8805e16d-4c39-4ef1-9670-2d7408138ff3 tempest-VolumesListAdminTestJSON-653064872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:20:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8805e16d-4c39-4ef1-9670-2d7408138ff3 tempest-VolumesListAdminTestJSON-653064872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:20:26 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-8805e16d-4c39-4ef1-9670-2d7408138ff3 tempest-VolumesListAdminTestJSON-653064872 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2021694365',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca6443be-6a39-4466-a8e4-c21f03563af8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='822306bab232457fb200ef2a7a8ab302',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:20:26Z,use_quota=True,user_id='17aa948e09294dc1be1d7054a78d84f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:20:26 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-8805e16d-4c39-4ef1-9670-2d7408138ff3 tempest-VolumesListAdminTestJSON-653064872 None] Creating volume ca6443be-6a39-4466-a8e4-c21f03563af8 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:20:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8805e16d-4c39-4ef1-9670-2d7408138ff3 tempest-VolumesListAdminTestJSON-653064872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:20:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8805e16d-4c39-4ef1-9670-2d7408138ff3 tempest-VolumesListAdminTestJSON-653064872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:20:26 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-8805e16d-4c39-4ef1-9670-2d7408138ff3 tempest-VolumesListAdminTestJSON-653064872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:20:26 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-8805e16d-4c39-4ef1-9670-2d7408138ff3 tempest-VolumesListAdminTestJSON-653064872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:20:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8805e16d-4c39-4ef1-9670-2d7408138ff3 tempest-VolumesListAdminTestJSON-653064872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:20:26 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-8805e16d-4c39-4ef1-9670-2d7408138ff3 tempest-VolumesListAdminTestJSON-653064872 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:20:26 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-8805e16d-4c39-4ef1-9670-2d7408138ff3 tempest-VolumesListAdminTestJSON-653064872 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:20:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8805e16d-4c39-4ef1-9670-2d7408138ff3 tempest-VolumesListAdminTestJSON-653064872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ca6443be-6a39-4466-a8e4-c21f03563af8 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:26 devstack sudo[100323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ca6443be-6a39-4466-a8e4-c21f03563af8 1073741824
Nov 04 12:20:26 devstack sudo[100323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:26 devstack sudo[100323]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8805e16d-4c39-4ef1-9670-2d7408138ff3 tempest-VolumesListAdminTestJSON-653064872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ca6443be-6a39-4466-a8e4-c21f03563af8 1073741824" returned: 0 in 0.523s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8805e16d-4c39-4ef1-9670-2d7408138ff3 tempest-VolumesListAdminTestJSON-653064872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ca6443be-6a39-4466-a8e4-c21f03563af8 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:26 devstack sudo[100329]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ca6443be-6a39-4466-a8e4-c21f03563af8
Nov 04 12:20:26 devstack sudo[100329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:26 devstack sudo[100329]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8805e16d-4c39-4ef1-9670-2d7408138ff3 tempest-VolumesListAdminTestJSON-653064872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ca6443be-6a39-4466-a8e4-c21f03563af8" returned: 0 in 0.308s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:26 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-8805e16d-4c39-4ef1-9670-2d7408138ff3 tempest-VolumesListAdminTestJSON-653064872 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:20:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8805e16d-4c39-4ef1-9670-2d7408138ff3 tempest-VolumesListAdminTestJSON-653064872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:20:26 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8805e16d-4c39-4ef1-9670-2d7408138ff3 tempest-VolumesListAdminTestJSON-653064872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bfa8f46-3b7a-42fa-a0be-5c63f5dba1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca6443be-6a39-4466-a8e4-c21f03563af8', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:26 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8805e16d-4c39-4ef1-9670-2d7408138ff3 tempest-VolumesListAdminTestJSON-653064872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d09dedd5-e421-418d-b700-c15fac61ad5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:26 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-8805e16d-4c39-4ef1-9670-2d7408138ff3 tempest-VolumesListAdminTestJSON-653064872 None] Volume volume-ca6443be-6a39-4466-a8e4-c21f03563af8 (ca6443be-6a39-4466-a8e4-c21f03563af8): created successfully
Nov 04 12:20:26 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8805e16d-4c39-4ef1-9670-2d7408138ff3 tempest-VolumesListAdminTestJSON-653064872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d09dedd5-e421-418d-b700-c15fac61ad5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:26 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8805e16d-4c39-4ef1-9670-2d7408138ff3 tempest-VolumesListAdminTestJSON-653064872 None] Flow 'volume_create_manager' (0d4a5e19-229f-4edf-abe4-41e1e4b5fa85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:20:26 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-8805e16d-4c39-4ef1-9670-2d7408138ff3 tempest-VolumesListAdminTestJSON-653064872 None] Created volume successfully.
Nov 04 12:20:26 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9827f758-35de-4700-a369-f1788c99f557 tempest-VolumesGetTest-484486462 None] Acquiring lock "cinder-9ec78071-8ded-48c3-8ec6-d985e63d18a6-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:20:26 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9827f758-35de-4700-a369-f1788c99f557 tempest-VolumesGetTest-484486462 None] Lock "cinder-9ec78071-8ded-48c3-8ec6-d985e63d18a6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:20:27 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9827f758-35de-4700-a369-f1788c99f557 tempest-VolumesGetTest-484486462 None] Acquiring lock "cinder-quobyte-9ec78071-8ded-48c3-8ec6-d985e63d18a6" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:20:27 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9827f758-35de-4700-a369-f1788c99f557 tempest-VolumesGetTest-484486462 None] Lock "cinder-quobyte-9ec78071-8ded-48c3-8ec6-d985e63d18a6" acquired by "delete_volume" :: waited 0.014s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:20:27 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[62540c2d-e270-4ee3-9e12-d48a86a77b54]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:20:27 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9827f758-35de-4700-a369-f1788c99f557 tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9ec78071-8ded-48c3-8ec6-d985e63d18a6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:27 devstack sudo[100332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9ec78071-8ded-48c3-8ec6-d985e63d18a6
Nov 04 12:20:27 devstack sudo[100332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:27 devstack sudo[100332]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:27 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9827f758-35de-4700-a369-f1788c99f557 tempest-VolumesGetTest-484486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9ec78071-8ded-48c3-8ec6-d985e63d18a6" returned: 0 in 0.365s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:27 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9827f758-35de-4700-a369-f1788c99f557 tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9ec78071-8ded-48c3-8ec6-d985e63d18a6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:27 devstack sudo[100338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9ec78071-8ded-48c3-8ec6-d985e63d18a6
Nov 04 12:20:27 devstack sudo[100338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:27 devstack sudo[100338]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:27 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9827f758-35de-4700-a369-f1788c99f557 tempest-VolumesGetTest-484486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9ec78071-8ded-48c3-8ec6-d985e63d18a6" returned: 0 in 0.254s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:27 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9827f758-35de-4700-a369-f1788c99f557 tempest-VolumesGetTest-484486462 None] Lock "cinder-quobyte-9ec78071-8ded-48c3-8ec6-d985e63d18a6" released by "delete_volume" :: held 0.670s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:20:27 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-9827f758-35de-4700-a369-f1788c99f557 tempest-VolumesGetTest-484486462 None] Created reservations ['205cfe0c-240e-463d-a8c4-ff2c029e20ef', '59188361-5fad-4d22-b909-b0ddbe99444a', 'cc5df3f6-11ac-40f3-a8a1-bfe7f2bcecb0', '8398315d-b94d-4b69-9246-beddc137b36b'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:20:27 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-9827f758-35de-4700-a369-f1788c99f557 tempest-VolumesGetTest-484486462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:20:27 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-9827f758-35de-4700-a369-f1788c99f557 tempest-VolumesGetTest-484486462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:20:27 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-9827f758-35de-4700-a369-f1788c99f557 tempest-VolumesGetTest-484486462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:20:27 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-9827f758-35de-4700-a369-f1788c99f557 tempest-VolumesGetTest-484486462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:20:27 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-9827f758-35de-4700-a369-f1788c99f557 tempest-VolumesGetTest-484486462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:20:27 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9827f758-35de-4700-a369-f1788c99f557 tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:27 devstack sudo[100341]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:20:27 devstack sudo[100341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:28 devstack sudo[100341]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9827f758-35de-4700-a369-f1788c99f557 tempest-VolumesGetTest-484486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.258s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:28 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-9827f758-35de-4700-a369-f1788c99f557 tempest-VolumesGetTest-484486462 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:20:28 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-9827f758-35de-4700-a369-f1788c99f557 tempest-VolumesGetTest-484486462 None] Deleted volume successfully.
Nov 04 12:20:28 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9827f758-35de-4700-a369-f1788c99f557 tempest-VolumesGetTest-484486462 None] Lock "cinder-9ec78071-8ded-48c3-8ec6-d985e63d18a6-delete_volume" released by "delete_volume" :: held 1.136s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:20:28 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-4c36b101-ad43-4b08-9dee-77b49b510036 tempest-VolumesGetTest-484486462 None] Acquiring lock "cinder-50e0aac0-9419-429b-93b6-b34753b81ad7-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:20:28 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-4c36b101-ad43-4b08-9dee-77b49b510036 tempest-VolumesGetTest-484486462 None] Lock "cinder-50e0aac0-9419-429b-93b6-b34753b81ad7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:20:28 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-4c36b101-ad43-4b08-9dee-77b49b510036 tempest-VolumesGetTest-484486462 None] Acquiring lock "cinder-quobyte-50e0aac0-9419-429b-93b6-b34753b81ad7" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:20:28 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-4c36b101-ad43-4b08-9dee-77b49b510036 tempest-VolumesGetTest-484486462 None] Lock "cinder-quobyte-50e0aac0-9419-429b-93b6-b34753b81ad7" acquired by "delete_volume" :: waited 0.022s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:20:28 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36a6f73-517d-43ed-a961-40b548e72bbb]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:20:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4c36b101-ad43-4b08-9dee-77b49b510036 tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-50e0aac0-9419-429b-93b6-b34753b81ad7 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:28 devstack sudo[100344]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-50e0aac0-9419-429b-93b6-b34753b81ad7
Nov 04 12:20:28 devstack sudo[100344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:28 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-bebf4873-212b-4117-9541-f2f61125d347 tempest-VolumesListAdminTestJSON-653064872 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:20:28 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bebf4873-212b-4117-9541-f2f61125d347 tempest-VolumesListAdminTestJSON-653064872 None] Flow 'volume_create_manager' (96a8d810-b78f-4919-9d22-4afa88b780c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:20:28 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bebf4873-212b-4117-9541-f2f61125d347 tempest-VolumesListAdminTestJSON-653064872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9386f69-5080-4090-84de-6390741f004b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:28 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bebf4873-212b-4117-9541-f2f61125d347 tempest-VolumesListAdminTestJSON-653064872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9386f69-5080-4090-84de-6390741f004b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:20:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-730138514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=576726ae-28ff-4897-b31d-1c78fad0a449,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='822306bab232457fb200ef2a7a8ab302',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:20:29Z,use_quota=True,user_id='17aa948e09294dc1be1d7054a78d84f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:28 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bebf4873-212b-4117-9541-f2f61125d347 tempest-VolumesListAdminTestJSON-653064872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17dc20bc-55b6-441a-baa7-1c8209caf97b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:28 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bebf4873-212b-4117-9541-f2f61125d347 tempest-VolumesListAdminTestJSON-653064872 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17dc20bc-55b6-441a-baa7-1c8209caf97b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:28 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bebf4873-212b-4117-9541-f2f61125d347 tempest-VolumesListAdminTestJSON-653064872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68edad77-1c5a-45a3-9c47-145b83316dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:28 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bebf4873-212b-4117-9541-f2f61125d347 tempest-VolumesListAdminTestJSON-653064872 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68edad77-1c5a-45a3-9c47-145b83316dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '576726ae-28ff-4897-b31d-1c78fad0a449', 'volume_name': 'volume-576726ae-28ff-4897-b31d-1c78fad0a449', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:28 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bebf4873-212b-4117-9541-f2f61125d347 tempest-VolumesListAdminTestJSON-653064872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90906837-6b9c-4212-a7f1-42ad58ef3d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:28 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bebf4873-212b-4117-9541-f2f61125d347 tempest-VolumesListAdminTestJSON-653064872 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90906837-6b9c-4212-a7f1-42ad58ef3d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:28 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bebf4873-212b-4117-9541-f2f61125d347 tempest-VolumesListAdminTestJSON-653064872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab472a6f-ea29-418d-b772-327c9e6a688c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:28 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-bebf4873-212b-4117-9541-f2f61125d347 tempest-VolumesListAdminTestJSON-653064872 None] Volume 576726ae-28ff-4897-b31d-1c78fad0a449: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-576726ae-28ff-4897-b31d-1c78fad0a449', 'volume_size': 1}
Nov 04 12:20:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-bebf4873-212b-4117-9541-f2f61125d347 tempest-VolumesListAdminTestJSON-653064872 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:20:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-bebf4873-212b-4117-9541-f2f61125d347 tempest-VolumesListAdminTestJSON-653064872 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:20:28 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-bebf4873-212b-4117-9541-f2f61125d347 tempest-VolumesListAdminTestJSON-653064872 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:20:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-730138514',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=576726ae-28ff-4897-b31d-1c78fad0a449,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='822306bab232457fb200ef2a7a8ab302',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:20:29Z,use_quota=True,user_id='17aa948e09294dc1be1d7054a78d84f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:20:28 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-bebf4873-212b-4117-9541-f2f61125d347 tempest-VolumesListAdminTestJSON-653064872 None] Creating volume 576726ae-28ff-4897-b31d-1c78fad0a449 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:20:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-bebf4873-212b-4117-9541-f2f61125d347 tempest-VolumesListAdminTestJSON-653064872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:20:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-bebf4873-212b-4117-9541-f2f61125d347 tempest-VolumesListAdminTestJSON-653064872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:20:28 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-bebf4873-212b-4117-9541-f2f61125d347 tempest-VolumesListAdminTestJSON-653064872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:20:28 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-bebf4873-212b-4117-9541-f2f61125d347 tempest-VolumesListAdminTestJSON-653064872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:20:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-bebf4873-212b-4117-9541-f2f61125d347 tempest-VolumesListAdminTestJSON-653064872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:20:28 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-bebf4873-212b-4117-9541-f2f61125d347 tempest-VolumesListAdminTestJSON-653064872 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:20:28 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-bebf4873-212b-4117-9541-f2f61125d347 tempest-VolumesListAdminTestJSON-653064872 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:20:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bebf4873-212b-4117-9541-f2f61125d347 tempest-VolumesListAdminTestJSON-653064872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-576726ae-28ff-4897-b31d-1c78fad0a449 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:28 devstack sudo[100349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-576726ae-28ff-4897-b31d-1c78fad0a449 1073741824
Nov 04 12:20:28 devstack sudo[100349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:28 devstack sudo[100344]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4c36b101-ad43-4b08-9dee-77b49b510036 tempest-VolumesGetTest-484486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-50e0aac0-9419-429b-93b6-b34753b81ad7" returned: 0 in 0.567s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4c36b101-ad43-4b08-9dee-77b49b510036 tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-50e0aac0-9419-429b-93b6-b34753b81ad7 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:28 devstack sudo[100351]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-50e0aac0-9419-429b-93b6-b34753b81ad7
Nov 04 12:20:28 devstack sudo[100351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:29 devstack sudo[100351]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4c36b101-ad43-4b08-9dee-77b49b510036 tempest-VolumesGetTest-484486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-50e0aac0-9419-429b-93b6-b34753b81ad7" returned: 0 in 0.294s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:29 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-4c36b101-ad43-4b08-9dee-77b49b510036 tempest-VolumesGetTest-484486462 None] Lock "cinder-quobyte-50e0aac0-9419-429b-93b6-b34753b81ad7" released by "delete_volume" :: held 0.910s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:20:29 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-4c36b101-ad43-4b08-9dee-77b49b510036 tempest-VolumesGetTest-484486462 None] Created reservations ['8bd4efda-65a6-478d-b15f-70114e33ab1f', '9fd778c3-6b6b-49f8-bb89-b04b32ea2cc6', 'f2c7d03e-f8d7-4a2e-b9e8-750b53c0ef90', '6d4941be-058a-4671-9a39-cbfef0f16e43'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:20:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-4c36b101-ad43-4b08-9dee-77b49b510036 tempest-VolumesGetTest-484486462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:20:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-4c36b101-ad43-4b08-9dee-77b49b510036 tempest-VolumesGetTest-484486462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:20:29 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-4c36b101-ad43-4b08-9dee-77b49b510036 tempest-VolumesGetTest-484486462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:20:29 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-4c36b101-ad43-4b08-9dee-77b49b510036 tempest-VolumesGetTest-484486462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:20:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-4c36b101-ad43-4b08-9dee-77b49b510036 tempest-VolumesGetTest-484486462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:20:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4c36b101-ad43-4b08-9dee-77b49b510036 tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:29 devstack sudo[100349]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bebf4873-212b-4117-9541-f2f61125d347 tempest-VolumesListAdminTestJSON-653064872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-576726ae-28ff-4897-b31d-1c78fad0a449 1073741824" returned: 0 in 0.528s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:29 devstack sudo[100358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:20:29 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bebf4873-212b-4117-9541-f2f61125d347 tempest-VolumesListAdminTestJSON-653064872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-576726ae-28ff-4897-b31d-1c78fad0a449 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:29 devstack sudo[100360]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-576726ae-28ff-4897-b31d-1c78fad0a449
Nov 04 12:20:29 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:29 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4c36b101-ad43-4b08-9dee-77b49b510036 tempest-VolumesGetTest-484486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.283s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:29 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-4c36b101-ad43-4b08-9dee-77b49b510036 tempest-VolumesGetTest-484486462 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:20:29 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-4c36b101-ad43-4b08-9dee-77b49b510036 tempest-VolumesGetTest-484486462 None] Deleted volume successfully.
Nov 04 12:20:29 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-4c36b101-ad43-4b08-9dee-77b49b510036 tempest-VolumesGetTest-484486462 None] Lock "cinder-50e0aac0-9419-429b-93b6-b34753b81ad7-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:20:29 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bebf4873-212b-4117-9541-f2f61125d347 tempest-VolumesListAdminTestJSON-653064872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-576726ae-28ff-4897-b31d-1c78fad0a449" returned: 0 in 0.286s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:29 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-bebf4873-212b-4117-9541-f2f61125d347 tempest-VolumesListAdminTestJSON-653064872 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:20:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-bebf4873-212b-4117-9541-f2f61125d347 tempest-VolumesListAdminTestJSON-653064872 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:20:29 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bebf4873-212b-4117-9541-f2f61125d347 tempest-VolumesListAdminTestJSON-653064872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab472a6f-ea29-418d-b772-327c9e6a688c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-576726ae-28ff-4897-b31d-1c78fad0a449', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:29 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bebf4873-212b-4117-9541-f2f61125d347 tempest-VolumesListAdminTestJSON-653064872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (360e8a06-a3fa-48c6-ac93-b4fd957796f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:29 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-bebf4873-212b-4117-9541-f2f61125d347 tempest-VolumesListAdminTestJSON-653064872 None] Volume volume-576726ae-28ff-4897-b31d-1c78fad0a449 (576726ae-28ff-4897-b31d-1c78fad0a449): created successfully
Nov 04 12:20:29 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bebf4873-212b-4117-9541-f2f61125d347 tempest-VolumesListAdminTestJSON-653064872 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (360e8a06-a3fa-48c6-ac93-b4fd957796f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:29 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bebf4873-212b-4117-9541-f2f61125d347 tempest-VolumesListAdminTestJSON-653064872 None] Flow 'volume_create_manager' (96a8d810-b78f-4919-9d22-4afa88b780c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:20:29 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-bebf4873-212b-4117-9541-f2f61125d347 tempest-VolumesListAdminTestJSON-653064872 None] Created volume successfully.
Nov 04 12:20:30 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-33ea0174-e877-450f-b2d8-56d787b1158f tempest-VolumesGetTest-484486462 None] Acquiring lock "cinder-a532b58c-5e20-412c-9772-54bea395cf3c-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:20:30 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-33ea0174-e877-450f-b2d8-56d787b1158f tempest-VolumesGetTest-484486462 None] Lock "cinder-a532b58c-5e20-412c-9772-54bea395cf3c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:20:30 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-33ea0174-e877-450f-b2d8-56d787b1158f tempest-VolumesGetTest-484486462 None] Acquiring lock "cinder-quobyte-a532b58c-5e20-412c-9772-54bea395cf3c" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:20:30 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-33ea0174-e877-450f-b2d8-56d787b1158f tempest-VolumesGetTest-484486462 None] Lock "cinder-quobyte-a532b58c-5e20-412c-9772-54bea395cf3c" acquired by "delete_volume" :: waited 0.017s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:20:30 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[354b2d5a-d7fe-4901-b8e9-27e28e2ff13b]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:20:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-33ea0174-e877-450f-b2d8-56d787b1158f tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:30 devstack sudo[100364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c
Nov 04 12:20:30 devstack sudo[100364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:31 devstack sudo[100364]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-33ea0174-e877-450f-b2d8-56d787b1158f tempest-VolumesGetTest-484486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c" returned: 0 in 0.398s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-33ea0174-e877-450f-b2d8-56d787b1158f tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:31 devstack sudo[100370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c
Nov 04 12:20:31 devstack sudo[100370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:31 devstack sudo[100370]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-33ea0174-e877-450f-b2d8-56d787b1158f tempest-VolumesGetTest-484486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a532b58c-5e20-412c-9772-54bea395cf3c" returned: 0 in 0.280s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:31 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-33ea0174-e877-450f-b2d8-56d787b1158f tempest-VolumesGetTest-484486462 None] Lock "cinder-quobyte-a532b58c-5e20-412c-9772-54bea395cf3c" released by "delete_volume" :: held 0.760s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:20:31 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-33ea0174-e877-450f-b2d8-56d787b1158f tempest-VolumesGetTest-484486462 None] Created reservations ['aed35595-68e1-494e-a4ee-07370bf74bf2', '4fc7a90a-01d0-4c52-9dff-0b99a64e2cf2', '7b767fef-dd55-4e14-a792-891bae0db429', 'eee32c5c-c973-40e0-83ef-aad8808eede3'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:20:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-33ea0174-e877-450f-b2d8-56d787b1158f tempest-VolumesGetTest-484486462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:20:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-33ea0174-e877-450f-b2d8-56d787b1158f tempest-VolumesGetTest-484486462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:20:31 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-33ea0174-e877-450f-b2d8-56d787b1158f tempest-VolumesGetTest-484486462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:20:31 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-33ea0174-e877-450f-b2d8-56d787b1158f tempest-VolumesGetTest-484486462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:20:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-33ea0174-e877-450f-b2d8-56d787b1158f tempest-VolumesGetTest-484486462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:20:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-33ea0174-e877-450f-b2d8-56d787b1158f tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:31 devstack sudo[100373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:20:31 devstack sudo[100373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:31 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-03e63106-d8a8-4455-9d06-bf0ea386fbd2 tempest-VolumesListAdminTestJSON-749460342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:20:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-03e63106-d8a8-4455-9d06-bf0ea386fbd2 tempest-VolumesListAdminTestJSON-749460342 None] Flow 'volume_create_manager' (f9321dd0-fdd6-43e2-9d9e-e264996d0527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:20:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-03e63106-d8a8-4455-9d06-bf0ea386fbd2 tempest-VolumesListAdminTestJSON-749460342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7e8f10a-d483-451d-9317-b5bc230558b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-03e63106-d8a8-4455-9d06-bf0ea386fbd2 tempest-VolumesListAdminTestJSON-749460342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7e8f10a-d483-451d-9317-b5bc230558b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d27f9c2-bebc-4b01-884c-38974e4a93d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651cf070fe694255a4b6146b64869322',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:20:32Z,use_quota=True,user_id='0ea7e4df8d514534a723c773fdb5373a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-03e63106-d8a8-4455-9d06-bf0ea386fbd2 tempest-VolumesListAdminTestJSON-749460342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7bb4b9c-a376-4802-a159-55df8fdd1a09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-03e63106-d8a8-4455-9d06-bf0ea386fbd2 tempest-VolumesListAdminTestJSON-749460342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7bb4b9c-a376-4802-a159-55df8fdd1a09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-03e63106-d8a8-4455-9d06-bf0ea386fbd2 tempest-VolumesListAdminTestJSON-749460342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9d85181-1bb2-4f95-8725-b3286e8e7c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-03e63106-d8a8-4455-9d06-bf0ea386fbd2 tempest-VolumesListAdminTestJSON-749460342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9d85181-1bb2-4f95-8725-b3286e8e7c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d27f9c2-bebc-4b01-884c-38974e4a93d9', 'volume_name': 'volume-8d27f9c2-bebc-4b01-884c-38974e4a93d9', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-03e63106-d8a8-4455-9d06-bf0ea386fbd2 tempest-VolumesListAdminTestJSON-749460342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5bc91ea-228a-4736-b7c1-8fb21ba2f5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-03e63106-d8a8-4455-9d06-bf0ea386fbd2 tempest-VolumesListAdminTestJSON-749460342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5bc91ea-228a-4736-b7c1-8fb21ba2f5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-03e63106-d8a8-4455-9d06-bf0ea386fbd2 tempest-VolumesListAdminTestJSON-749460342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2871bb45-eb67-4555-93b7-0b4077b08e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:31 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-03e63106-d8a8-4455-9d06-bf0ea386fbd2 tempest-VolumesListAdminTestJSON-749460342 None] Volume 8d27f9c2-bebc-4b01-884c-38974e4a93d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d27f9c2-bebc-4b01-884c-38974e4a93d9', 'volume_size': 1}
Nov 04 12:20:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-03e63106-d8a8-4455-9d06-bf0ea386fbd2 tempest-VolumesListAdminTestJSON-749460342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:20:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-03e63106-d8a8-4455-9d06-bf0ea386fbd2 tempest-VolumesListAdminTestJSON-749460342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:20:31 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-03e63106-d8a8-4455-9d06-bf0ea386fbd2 tempest-VolumesListAdminTestJSON-749460342 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:20:31Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d27f9c2-bebc-4b01-884c-38974e4a93d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='651cf070fe694255a4b6146b64869322',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:20:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:20:32Z,use_quota=True,user_id='0ea7e4df8d514534a723c773fdb5373a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:20:31 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-03e63106-d8a8-4455-9d06-bf0ea386fbd2 tempest-VolumesListAdminTestJSON-749460342 None] Creating volume 8d27f9c2-bebc-4b01-884c-38974e4a93d9 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:20:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-03e63106-d8a8-4455-9d06-bf0ea386fbd2 tempest-VolumesListAdminTestJSON-749460342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:20:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-03e63106-d8a8-4455-9d06-bf0ea386fbd2 tempest-VolumesListAdminTestJSON-749460342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:20:31 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-03e63106-d8a8-4455-9d06-bf0ea386fbd2 tempest-VolumesListAdminTestJSON-749460342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:20:31 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-03e63106-d8a8-4455-9d06-bf0ea386fbd2 tempest-VolumesListAdminTestJSON-749460342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:20:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-03e63106-d8a8-4455-9d06-bf0ea386fbd2 tempest-VolumesListAdminTestJSON-749460342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:20:31 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-03e63106-d8a8-4455-9d06-bf0ea386fbd2 tempest-VolumesListAdminTestJSON-749460342 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:20:31 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-03e63106-d8a8-4455-9d06-bf0ea386fbd2 tempest-VolumesListAdminTestJSON-749460342 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:20:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-03e63106-d8a8-4455-9d06-bf0ea386fbd2 tempest-VolumesListAdminTestJSON-749460342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8d27f9c2-bebc-4b01-884c-38974e4a93d9 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:31 devstack sudo[100373]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-33ea0174-e877-450f-b2d8-56d787b1158f tempest-VolumesGetTest-484486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.331s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:31 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-33ea0174-e877-450f-b2d8-56d787b1158f tempest-VolumesGetTest-484486462 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:20:31 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-33ea0174-e877-450f-b2d8-56d787b1158f tempest-VolumesGetTest-484486462 None] Deleted volume successfully.
Nov 04 12:20:31 devstack sudo[100376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8d27f9c2-bebc-4b01-884c-38974e4a93d9 1073741824
Nov 04 12:20:31 devstack sudo[100376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:31 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-33ea0174-e877-450f-b2d8-56d787b1158f tempest-VolumesGetTest-484486462 None] Lock "cinder-a532b58c-5e20-412c-9772-54bea395cf3c-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:20:32 devstack sudo[100376]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-03e63106-d8a8-4455-9d06-bf0ea386fbd2 tempest-VolumesListAdminTestJSON-749460342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8d27f9c2-bebc-4b01-884c-38974e4a93d9 1073741824" returned: 0 in 0.528s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-03e63106-d8a8-4455-9d06-bf0ea386fbd2 tempest-VolumesListAdminTestJSON-749460342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8d27f9c2-bebc-4b01-884c-38974e4a93d9 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:32 devstack sudo[100388]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8d27f9c2-bebc-4b01-884c-38974e4a93d9
Nov 04 12:20:32 devstack sudo[100388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:32 devstack sudo[100388]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-03e63106-d8a8-4455-9d06-bf0ea386fbd2 tempest-VolumesListAdminTestJSON-749460342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8d27f9c2-bebc-4b01-884c-38974e4a93d9" returned: 0 in 0.412s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:32 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-03e63106-d8a8-4455-9d06-bf0ea386fbd2 tempest-VolumesListAdminTestJSON-749460342 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:20:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-03e63106-d8a8-4455-9d06-bf0ea386fbd2 tempest-VolumesListAdminTestJSON-749460342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:20:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-03e63106-d8a8-4455-9d06-bf0ea386fbd2 tempest-VolumesListAdminTestJSON-749460342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2871bb45-eb67-4555-93b7-0b4077b08e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d27f9c2-bebc-4b01-884c-38974e4a93d9', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-03e63106-d8a8-4455-9d06-bf0ea386fbd2 tempest-VolumesListAdminTestJSON-749460342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59209413-3acb-4057-a48d-274755881203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:32 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:20:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Flow 'volume_create_manager' (4e41761b-ab10-408e-b895-7a81433182b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:20:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c147fef8-b7bb-409f-a4cf-ce927c16ba84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:32 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-03e63106-d8a8-4455-9d06-bf0ea386fbd2 tempest-VolumesListAdminTestJSON-749460342 None] Volume volume-8d27f9c2-bebc-4b01-884c-38974e4a93d9 (8d27f9c2-bebc-4b01-884c-38974e4a93d9): created successfully
Nov 04 12:20:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-03e63106-d8a8-4455-9d06-bf0ea386fbd2 tempest-VolumesListAdminTestJSON-749460342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59209413-3acb-4057-a48d-274755881203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-03e63106-d8a8-4455-9d06-bf0ea386fbd2 tempest-VolumesListAdminTestJSON-749460342 None] Flow 'volume_create_manager' (f9321dd0-fdd6-43e2-9d9e-e264996d0527) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:20:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c147fef8-b7bb-409f-a4cf-ce927c16ba84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1815394348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c58bf890-86b6-42a7-8b07-51514d61914d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0c914710419c41eaa76715e3748b4cf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:20:33Z,use_quota=True,user_id='a5ba237f1e5e4ae78cb1c31fd084d325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e111ec5-15a0-4efa-9e83-386153b101e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e111ec5-15a0-4efa-9e83-386153b101e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eb56a54-454d-47d7-b3a0-5fb362624412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:32 devstack cinder-volume[87169]: DEBUG cinder.image.glance [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Creating Keystone auth plugin from conf {{(pid=87169) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 04 12:20:33 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-03e63106-d8a8-4455-9d06-bf0ea386fbd2 tempest-VolumesListAdminTestJSON-749460342 None] Created volume successfully.
Nov 04 12:20:33 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2eb56a54-454d-47d7-b3a0-5fb362624412) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c58bf890-86b6-42a7-8b07-51514d61914d', 'volume_name': 'volume-c58bf890-86b6-42a7-8b07-51514d61914d', 'volume_size': 1, 'image_id': '5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '52d49d1f3a4b47a8a8f060da8e0e2c02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'created_at': datetime.datetime(2026, 11, 4, 11, 3, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 3, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fd6a6ac-1614-4aa5-aedb-17a31996018d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cc0594f4980>}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:33 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03e77f20-f5a7-4dc9-8cf4-2171eb51d36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:33 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03e77f20-f5a7-4dc9-8cf4-2171eb51d36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:33 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b67b45a-b615-445d-a2ff-c14e514c65dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:33 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Volume c58bf890-86b6-42a7-8b07-51514d61914d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c58bf890-86b6-42a7-8b07-51514d61914d', 'volume_size': 1, 'image_id': '5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '52d49d1f3a4b47a8a8f060da8e0e2c02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'created_at': datetime.datetime(2026, 11, 4, 11, 3, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 3, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fd6a6ac-1614-4aa5-aedb-17a31996018d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cc0594f4980>}
Nov 04 12:20:33 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Trying to clone c58bf890-86b6-42a7-8b07-51514d61914d from image 5fd6a6ac-1614-4aa5-aedb-17a31996018d at location (None, [{'url': 'file:///opt/stack/data/glance/images/5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'metadata': {}}]). {{(pid=87169) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 04 12:20:33 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:20:33 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Flow 'volume_create_manager' (50ff58c1-0e73-4baa-bef3-76aaa7dcc9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:20:33 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (230746e2-7ed4-4eae-8a64-cea7356ca603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:33 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (230746e2-7ed4-4eae-8a64-cea7356ca603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1158758258',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fef71b7-a8de-409c-b1b9-7d0cef41603a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f00a346f4c94a928785bccde89f588a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:20:33Z,use_quota=True,user_id='dc9cc01a4dd843e88f0fd41f409eb5aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:33 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f9f67b-51b6-4b90-ba7b-db54fca9f2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:33 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f9f67b-51b6-4b90-ba7b-db54fca9f2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:33 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc6b039d-f302-418f-bf84-da3b69fdecdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:33 devstack cinder-volume[87169]: DEBUG cinder.image.glance [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Creating Keystone auth plugin from conf {{(pid=87169) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 04 12:20:33 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_9578o1nhdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87169) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 04 12:20:33 devstack cinder-volume[87169]: INFO cinder.image.image_utils [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Image download 20.69 MB at 20.69 MB/s
Nov 04 12:20:33 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca48905-082f-4a12-9925-786acc4978cb]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:20:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_9578o1nhdevstack@QuobyteHD {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:33 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc6b039d-f302-418f-bf84-da3b69fdecdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1fef71b7-a8de-409c-b1b9-7d0cef41603a', 'volume_name': 'volume-1fef71b7-a8de-409c-b1b9-7d0cef41603a', 'volume_size': 1, 'image_id': '5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '52d49d1f3a4b47a8a8f060da8e0e2c02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'created_at': datetime.datetime(2026, 11, 4, 11, 3, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 3, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fd6a6ac-1614-4aa5-aedb-17a31996018d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cc063a9dfd0>}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:33 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d82a9dd-24a5-489d-94d7-f16c31030178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:33 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d82a9dd-24a5-489d-94d7-f16c31030178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:33 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39f9f848-d01e-40c0-8568-3ae9b7258169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:33 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Volume 1fef71b7-a8de-409c-b1b9-7d0cef41603a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1fef71b7-a8de-409c-b1b9-7d0cef41603a', 'volume_size': 1, 'image_id': '5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '52d49d1f3a4b47a8a8f060da8e0e2c02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'created_at': datetime.datetime(2026, 11, 4, 11, 3, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 3, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fd6a6ac-1614-4aa5-aedb-17a31996018d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cc063a9dfd0>}
Nov 04 12:20:33 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Trying to clone 1fef71b7-a8de-409c-b1b9-7d0cef41603a from image 5fd6a6ac-1614-4aa5-aedb-17a31996018d at location (None, [{'url': 'file:///opt/stack/data/glance/images/5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'metadata': {}}]). {{(pid=87169) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 04 12:20:33 devstack sudo[100428]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_9578o1nhdevstack@QuobyteHD
Nov 04 12:20:33 devstack sudo[100428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:33 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a60b4acf-4a5b-461e-a859-6bade588b3d1 tempest-VolumesListAdminTestJSON-749460342 None] Acquiring lock "cinder-8d27f9c2-bebc-4b01-884c-38974e4a93d9-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:20:33 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a60b4acf-4a5b-461e-a859-6bade588b3d1 tempest-VolumesListAdminTestJSON-749460342 None] Lock "cinder-8d27f9c2-bebc-4b01-884c-38974e4a93d9-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:20:34 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a60b4acf-4a5b-461e-a859-6bade588b3d1 tempest-VolumesListAdminTestJSON-749460342 None] Acquiring lock "cinder-quobyte-8d27f9c2-bebc-4b01-884c-38974e4a93d9" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:20:34 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a60b4acf-4a5b-461e-a859-6bade588b3d1 tempest-VolumesListAdminTestJSON-749460342 None] Lock "cinder-quobyte-8d27f9c2-bebc-4b01-884c-38974e4a93d9" acquired by "delete_volume" :: waited 0.031s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:20:34 devstack sudo[100428]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:34 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[754314e9-e95b-4345-b556-715f0920325e]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:20:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a60b4acf-4a5b-461e-a859-6bade588b3d1 tempest-VolumesListAdminTestJSON-749460342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8d27f9c2-bebc-4b01-884c-38974e4a93d9 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_9578o1nhdevstack@QuobyteHD" returned: 0 in 0.484s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:34 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1e9e35ff-d78c-406a-ba06-e2a08dc34f9b tempest-VolumesListAdminTestJSON-653064872 None] Acquiring lock "cinder-576726ae-28ff-4897-b31d-1c78fad0a449-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:20:34 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Temporary image 5fd6a6ac-1614-4aa5-aedb-17a31996018d is fetched for user a5ba237f1e5e4ae78cb1c31fd084d325. {{(pid=87169) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 04 12:20:34 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1e9e35ff-d78c-406a-ba06-e2a08dc34f9b tempest-VolumesListAdminTestJSON-653064872 None] Lock "cinder-576726ae-28ff-4897-b31d-1c78fad0a449-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:20:34 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_gcas36v2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87169) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 04 12:20:34 devstack cinder-volume[87169]: INFO cinder.image.image_utils [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Image download 20.69 MB at 20.69 MB/s
Nov 04 12:20:34 devstack sudo[100434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8d27f9c2-bebc-4b01-884c-38974e4a93d9
Nov 04 12:20:34 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:34 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[9924229c-23e7-4b82-9201-8ac6f6842402]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:20:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_9578o1nhdevstack@QuobyteHD {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:34 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1e9e35ff-d78c-406a-ba06-e2a08dc34f9b tempest-VolumesListAdminTestJSON-653064872 None] Acquiring lock "cinder-quobyte-576726ae-28ff-4897-b31d-1c78fad0a449" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:20:34 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[056696c9-4ff2-45ce-985a-d80a8c796ae3]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:20:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_gcas36v2devstack@QuobyteHD {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:34 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1e9e35ff-d78c-406a-ba06-e2a08dc34f9b tempest-VolumesListAdminTestJSON-653064872 None] Lock "cinder-quobyte-576726ae-28ff-4897-b31d-1c78fad0a449" acquired by "delete_volume" :: waited 0.031s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:20:34 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[828d7fba-b80e-47c4-9910-b6722a67d1af]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:20:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1e9e35ff-d78c-406a-ba06-e2a08dc34f9b tempest-VolumesListAdminTestJSON-653064872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-576726ae-28ff-4897-b31d-1c78fad0a449 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:34 devstack sudo[100436]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_9578o1nhdevstack@QuobyteHD
Nov 04 12:20:34 devstack sudo[100436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:34 devstack sudo[100437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_gcas36v2devstack@QuobyteHD
Nov 04 12:20:34 devstack sudo[100437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:34 devstack sudo[100438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-576726ae-28ff-4897-b31d-1c78fad0a449
Nov 04 12:20:34 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:34 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a60b4acf-4a5b-461e-a859-6bade588b3d1 tempest-VolumesListAdminTestJSON-749460342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8d27f9c2-bebc-4b01-884c-38974e4a93d9" returned: 0 in 0.435s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a60b4acf-4a5b-461e-a859-6bade588b3d1 tempest-VolumesListAdminTestJSON-749460342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8d27f9c2-bebc-4b01-884c-38974e4a93d9 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:34 devstack sudo[100445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8d27f9c2-bebc-4b01-884c-38974e4a93d9
Nov 04 12:20:34 devstack sudo[100445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:34 devstack sudo[100436]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_9578o1nhdevstack@QuobyteHD" returned: 0 in 0.385s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:20:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:20:34 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1815394348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c58bf890-86b6-42a7-8b07-51514d61914d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='0c914710419c41eaa76715e3748b4cf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:20:33Z,use_quota=True,user_id='a5ba237f1e5e4ae78cb1c31fd084d325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:20:34 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Creating volume c58bf890-86b6-42a7-8b07-51514d61914d {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:20:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:20:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:20:34 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:20:34 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:20:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:20:34 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:20:34 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:20:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c58bf890-86b6-42a7-8b07-51514d61914d 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:34 devstack sudo[100437]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_gcas36v2devstack@QuobyteHD" returned: 0 in 0.384s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:34 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Temporary image 5fd6a6ac-1614-4aa5-aedb-17a31996018d is fetched for user dc9cc01a4dd843e88f0fd41f409eb5aa. {{(pid=87169) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 04 12:20:34 devstack sudo[100454]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c58bf890-86b6-42a7-8b07-51514d61914d 1073741824
Nov 04 12:20:34 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:34 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:34 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e16af82-8b80-41a7-9c41-74fcae40f2e3]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:20:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_gcas36v2devstack@QuobyteHD {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1e9e35ff-d78c-406a-ba06-e2a08dc34f9b tempest-VolumesListAdminTestJSON-653064872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-576726ae-28ff-4897-b31d-1c78fad0a449" returned: 0 in 0.428s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1e9e35ff-d78c-406a-ba06-e2a08dc34f9b tempest-VolumesListAdminTestJSON-653064872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-576726ae-28ff-4897-b31d-1c78fad0a449 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:34 devstack sudo[100445]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:34 devstack sudo[100462]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-576726ae-28ff-4897-b31d-1c78fad0a449
Nov 04 12:20:34 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a60b4acf-4a5b-461e-a859-6bade588b3d1 tempest-VolumesListAdminTestJSON-749460342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8d27f9c2-bebc-4b01-884c-38974e4a93d9" returned: 0 in 0.297s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:34 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a60b4acf-4a5b-461e-a859-6bade588b3d1 tempest-VolumesListAdminTestJSON-749460342 None] Lock "cinder-quobyte-8d27f9c2-bebc-4b01-884c-38974e4a93d9" released by "delete_volume" :: held 0.822s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:20:34 devstack sudo[100461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_gcas36v2devstack@QuobyteHD
Nov 04 12:20:34 devstack sudo[100461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:34 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-a60b4acf-4a5b-461e-a859-6bade588b3d1 tempest-VolumesListAdminTestJSON-749460342 None] Created reservations ['ea8e53d7-8c42-47d4-9349-fecf6ac9b6bf', '667126eb-11d6-4c83-9c5e-68f8496d8876', 'bb5369ab-514d-4451-a324-601ae42572cf', '8dda12ff-df34-4609-85a0-b35c9d382a87'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a60b4acf-4a5b-461e-a859-6bade588b3d1 tempest-VolumesListAdminTestJSON-749460342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a60b4acf-4a5b-461e-a859-6bade588b3d1 tempest-VolumesListAdminTestJSON-749460342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a60b4acf-4a5b-461e-a859-6bade588b3d1 tempest-VolumesListAdminTestJSON-749460342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a60b4acf-4a5b-461e-a859-6bade588b3d1 tempest-VolumesListAdminTestJSON-749460342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a60b4acf-4a5b-461e-a859-6bade588b3d1 tempest-VolumesListAdminTestJSON-749460342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a60b4acf-4a5b-461e-a859-6bade588b3d1 tempest-VolumesListAdminTestJSON-749460342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:35 devstack sudo[100468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:20:35 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:35 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1e9e35ff-d78c-406a-ba06-e2a08dc34f9b tempest-VolumesListAdminTestJSON-653064872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-576726ae-28ff-4897-b31d-1c78fad0a449" returned: 0 in 0.313s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1e9e35ff-d78c-406a-ba06-e2a08dc34f9b tempest-VolumesListAdminTestJSON-653064872 None] Lock "cinder-quobyte-576726ae-28ff-4897-b31d-1c78fad0a449" released by "delete_volume" :: held 0.795s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-1e9e35ff-d78c-406a-ba06-e2a08dc34f9b tempest-VolumesListAdminTestJSON-653064872 None] Created reservations ['a731d702-3b72-4721-aced-8218b9342e63', 'c8dd9d10-22a8-4d77-b52a-93c438217435', 'a17dff42-73a1-4870-8bb3-7c2d1acb9c58', 'c59a2bd6-5dd9-46b3-9f3d-1a99017d1ad1'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:20:35 devstack sudo[100461]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_gcas36v2devstack@QuobyteHD" returned: 0 in 0.434s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:20:35 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c58bf890-86b6-42a7-8b07-51514d61914d 1073741824" returned: 0 in 0.604s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1e9e35ff-d78c-406a-ba06-e2a08dc34f9b tempest-VolumesListAdminTestJSON-653064872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1e9e35ff-d78c-406a-ba06-e2a08dc34f9b tempest-VolumesListAdminTestJSON-653064872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1e9e35ff-d78c-406a-ba06-e2a08dc34f9b tempest-VolumesListAdminTestJSON-653064872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1e9e35ff-d78c-406a-ba06-e2a08dc34f9b tempest-VolumesListAdminTestJSON-653064872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1e9e35ff-d78c-406a-ba06-e2a08dc34f9b tempest-VolumesListAdminTestJSON-653064872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1e9e35ff-d78c-406a-ba06-e2a08dc34f9b tempest-VolumesListAdminTestJSON-653064872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c58bf890-86b6-42a7-8b07-51514d61914d {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:35 devstack sudo[100474]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:20:35 devstack sudo[100474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:35 devstack sudo[100476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c58bf890-86b6-42a7-8b07-51514d61914d
Nov 04 12:20:35 devstack sudo[100476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:35 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a60b4acf-4a5b-461e-a859-6bade588b3d1 tempest-VolumesListAdminTestJSON-749460342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.358s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-a60b4acf-4a5b-461e-a859-6bade588b3d1 tempest-VolumesListAdminTestJSON-749460342 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:20:35 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-a60b4acf-4a5b-461e-a859-6bade588b3d1 tempest-VolumesListAdminTestJSON-749460342 None] Deleted volume successfully.
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-daf89654-3a5d-4845-b1ce-0a49cb4e98fe tempest-VolumesListAdminTestJSON-653064872 None] Acquiring lock "cinder-ca6443be-6a39-4466-a8e4-c21f03563af8-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a60b4acf-4a5b-461e-a859-6bade588b3d1 tempest-VolumesListAdminTestJSON-749460342 None] Lock "cinder-8d27f9c2-bebc-4b01-884c-38974e4a93d9-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-daf89654-3a5d-4845-b1ce-0a49cb4e98fe tempest-VolumesListAdminTestJSON-653064872 None] Lock "cinder-ca6443be-6a39-4466-a8e4-c21f03563af8-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-daf89654-3a5d-4845-b1ce-0a49cb4e98fe tempest-VolumesListAdminTestJSON-653064872 None] Acquiring lock "cinder-quobyte-ca6443be-6a39-4466-a8e4-c21f03563af8" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-daf89654-3a5d-4845-b1ce-0a49cb4e98fe tempest-VolumesListAdminTestJSON-653064872 None] Lock "cinder-quobyte-ca6443be-6a39-4466-a8e4-c21f03563af8" acquired by "delete_volume" :: waited 0.017s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec0d73f3-fe3d-4f6f-92ae-0692e9548475]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-daf89654-3a5d-4845-b1ce-0a49cb4e98fe tempest-VolumesListAdminTestJSON-653064872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ca6443be-6a39-4466-a8e4-c21f03563af8 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:35 devstack sudo[100474]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1e9e35ff-d78c-406a-ba06-e2a08dc34f9b tempest-VolumesListAdminTestJSON-653064872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.308s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-1e9e35ff-d78c-406a-ba06-e2a08dc34f9b tempest-VolumesListAdminTestJSON-653064872 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:20:35 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-1e9e35ff-d78c-406a-ba06-e2a08dc34f9b tempest-VolumesListAdminTestJSON-653064872 None] Deleted volume successfully.
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1e9e35ff-d78c-406a-ba06-e2a08dc34f9b tempest-VolumesListAdminTestJSON-653064872 None] Lock "cinder-576726ae-28ff-4897-b31d-1c78fad0a449-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:20:35 devstack sudo[100476]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c58bf890-86b6-42a7-8b07-51514d61914d" returned: 0 in 0.339s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.461s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:20:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1158758258',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fef71b7-a8de-409c-b1b9-7d0cef41603a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4f00a346f4c94a928785bccde89f588a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:20:33Z,use_quota=True,user_id='dc9cc01a4dd843e88f0fd41f409eb5aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Creating volume 1fef71b7-a8de-409c-b1b9-7d0cef41603a {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:20:35 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1fef71b7-a8de-409c-b1b9-7d0cef41603a 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:35 devstack sudo[100480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ca6443be-6a39-4466-a8e4-c21f03563af8
Nov 04 12:20:35 devstack sudo[100480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:35 devstack sudo[100482]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1fef71b7-a8de-409c-b1b9-7d0cef41603a 1073741824
Nov 04 12:20:35 devstack sudo[100482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG cinder.volume.volume_utils [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Attempting download of 5fd6a6ac-1614-4aa5-aedb-17a31996018d ((None, [{'url': 'file:///opt/stack/data/glance/images/5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'metadata': {}}])) to volume c58bf890-86b6-42a7-8b07-51514d61914d. {{(pid=87169) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf0ffcc-5154-41ee-b9a2-3535f562254d]: (4, 'raw') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:20:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fd6a6ac-1614-4aa5-aedb-17a31996018d_reof_nt6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:35 devstack sudo[100485]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fd6a6ac-1614-4aa5-aedb-17a31996018d_reof_nt6
Nov 04 12:20:35 devstack sudo[100485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:36 devstack sudo[100480]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-daf89654-3a5d-4845-b1ce-0a49cb4e98fe tempest-VolumesListAdminTestJSON-653064872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ca6443be-6a39-4466-a8e4-c21f03563af8" returned: 0 in 0.431s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-daf89654-3a5d-4845-b1ce-0a49cb4e98fe tempest-VolumesListAdminTestJSON-653064872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ca6443be-6a39-4466-a8e4-c21f03563af8 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:36 devstack sudo[100493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ca6443be-6a39-4466-a8e4-c21f03563af8
Nov 04 12:20:36 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:36 devstack sudo[100485]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fd6a6ac-1614-4aa5-aedb-17a31996018d_reof_nt6" returned: 0 in 0.338s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fd6a6ac-1614-4aa5-aedb-17a31996018d_reof_nt6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:36 devstack sudo[100482]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1fef71b7-a8de-409c-b1b9-7d0cef41603a 1073741824" returned: 0 in 0.476s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1fef71b7-a8de-409c-b1b9-7d0cef41603a {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:36 devstack sudo[100499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1fef71b7-a8de-409c-b1b9-7d0cef41603a
Nov 04 12:20:36 devstack sudo[100499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:36 devstack sudo[100498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fd6a6ac-1614-4aa5-aedb-17a31996018d_reof_nt6
Nov 04 12:20:36 devstack sudo[100498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:36 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-daf89654-3a5d-4845-b1ce-0a49cb4e98fe tempest-VolumesListAdminTestJSON-653064872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ca6443be-6a39-4466-a8e4-c21f03563af8" returned: 0 in 0.277s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:36 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-daf89654-3a5d-4845-b1ce-0a49cb4e98fe tempest-VolumesListAdminTestJSON-653064872 None] Lock "cinder-quobyte-ca6443be-6a39-4466-a8e4-c21f03563af8" released by "delete_volume" :: held 0.766s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:20:36 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-daf89654-3a5d-4845-b1ce-0a49cb4e98fe tempest-VolumesListAdminTestJSON-653064872 None] Created reservations ['66c245fd-b580-45bd-adb8-305f435abe1c', '3bc0dec5-6f06-4e8c-9ca0-b9efcc9d9885', '634ce5cf-da42-4a70-a3e1-bc182dd776e0', '975840eb-732c-4e80-9b84-30d7bdf9d51b'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:20:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-daf89654-3a5d-4845-b1ce-0a49cb4e98fe tempest-VolumesListAdminTestJSON-653064872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:20:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-daf89654-3a5d-4845-b1ce-0a49cb4e98fe tempest-VolumesListAdminTestJSON-653064872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:20:36 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-daf89654-3a5d-4845-b1ce-0a49cb4e98fe tempest-VolumesListAdminTestJSON-653064872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:20:36 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-daf89654-3a5d-4845-b1ce-0a49cb4e98fe tempest-VolumesListAdminTestJSON-653064872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:20:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-daf89654-3a5d-4845-b1ce-0a49cb4e98fe tempest-VolumesListAdminTestJSON-653064872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:20:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-daf89654-3a5d-4845-b1ce-0a49cb4e98fe tempest-VolumesListAdminTestJSON-653064872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:36 devstack sudo[100505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:20:36 devstack sudo[100499]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:36 devstack sudo[100505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1fef71b7-a8de-409c-b1b9-7d0cef41603a" returned: 0 in 0.304s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:36 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:20:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:20:36 devstack sudo[100498]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fd6a6ac-1614-4aa5-aedb-17a31996018d_reof_nt6" returned: 1 in 0.372s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fd6a6ac-1614-4aa5-aedb-17a31996018d_reof_nt6' failed. Not Retrying. {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 12:20:36 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d05648-114e-4db6-84b1-23119c304375]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:20:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_9578o1nhdevstack@QuobyteHD {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:36 devstack cinder-volume[87169]: DEBUG cinder.volume.volume_utils [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Attempting download of 5fd6a6ac-1614-4aa5-aedb-17a31996018d ((None, [{'url': 'file:///opt/stack/data/glance/images/5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'metadata': {}}])) to volume 1fef71b7-a8de-409c-b1b9-7d0cef41603a. {{(pid=87169) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 04 12:20:36 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe9a20c6-fa64-4a01-a558-78ef287da907]: (4, 'raw') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:20:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fd6a6ac-1614-4aa5-aedb-17a31996018d_fid_na_9 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:36 devstack sudo[100508]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_9578o1nhdevstack@QuobyteHD
Nov 04 12:20:36 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:36 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-30760436-e140-4cc9-8f7f-7655a0304916 tempest-VolumesListAdminTestJSON-653064872 None] Acquiring lock "cinder-dd071116-fcda-4d86-a127-6e3a8977ae4d-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:20:36 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-30760436-e140-4cc9-8f7f-7655a0304916 tempest-VolumesListAdminTestJSON-653064872 None] Lock "cinder-dd071116-fcda-4d86-a127-6e3a8977ae4d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:20:36 devstack sudo[100505]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:36 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-30760436-e140-4cc9-8f7f-7655a0304916 tempest-VolumesListAdminTestJSON-653064872 None] Acquiring lock "cinder-quobyte-dd071116-fcda-4d86-a127-6e3a8977ae4d" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:20:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-daf89654-3a5d-4845-b1ce-0a49cb4e98fe tempest-VolumesListAdminTestJSON-653064872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.312s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:36 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-daf89654-3a5d-4845-b1ce-0a49cb4e98fe tempest-VolumesListAdminTestJSON-653064872 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:20:36 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-daf89654-3a5d-4845-b1ce-0a49cb4e98fe tempest-VolumesListAdminTestJSON-653064872 None] Deleted volume successfully.
Nov 04 12:20:36 devstack sudo[100509]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fd6a6ac-1614-4aa5-aedb-17a31996018d_fid_na_9
Nov 04 12:20:36 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-30760436-e140-4cc9-8f7f-7655a0304916 tempest-VolumesListAdminTestJSON-653064872 None] Lock "cinder-quobyte-dd071116-fcda-4d86-a127-6e3a8977ae4d" acquired by "delete_volume" :: waited 0.023s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:20:36 devstack sudo[100509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:36 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[020b3d06-fb26-467b-8d79-058ad2136160]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:20:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-30760436-e140-4cc9-8f7f-7655a0304916 tempest-VolumesListAdminTestJSON-653064872 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-dd071116-fcda-4d86-a127-6e3a8977ae4d {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:36 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-daf89654-3a5d-4845-b1ce-0a49cb4e98fe tempest-VolumesListAdminTestJSON-653064872 None] Lock "cinder-ca6443be-6a39-4466-a8e4-c21f03563af8-delete_volume" released by "delete_volume" :: held 1.363s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:20:36 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_9578o1nhdevstack@QuobyteHD" returned: 0 in 0.382s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:36 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] 5fd6a6ac-1614-4aa5-aedb-17a31996018d was qcow2, converting to qcow2 {{(pid=87169) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 04 12:20:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_9578o1nhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c58bf890-86b6-42a7-8b07-51514d61914d {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:36 devstack sudo[100517]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_9578o1nhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c58bf890-86b6-42a7-8b07-51514d61914d
Nov 04 12:20:36 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:36 devstack sudo[100513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-dd071116-fcda-4d86-a127-6e3a8977ae4d
Nov 04 12:20:37 devstack sudo[100513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:37 devstack sudo[100509]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5fd6a6ac-1614-4aa5-aedb-17a31996018d_fid_na_9" returned: 0 in 0.418s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fd6a6ac-1614-4aa5-aedb-17a31996018d_fid_na_9 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:37 devstack sudo[100522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fd6a6ac-1614-4aa5-aedb-17a31996018d_fid_na_9
Nov 04 12:20:37 devstack sudo[100522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:37 devstack sudo[100513]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-30760436-e140-4cc9-8f7f-7655a0304916 tempest-VolumesListAdminTestJSON-653064872 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-dd071116-fcda-4d86-a127-6e3a8977ae4d" returned: 0 in 0.396s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-30760436-e140-4cc9-8f7f-7655a0304916 tempest-VolumesListAdminTestJSON-653064872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-dd071116-fcda-4d86-a127-6e3a8977ae4d {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:37 devstack sudo[100531]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-dd071116-fcda-4d86-a127-6e3a8977ae4d
Nov 04 12:20:37 devstack sudo[100531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:37 devstack sudo[100522]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fd6a6ac-1614-4aa5-aedb-17a31996018d_fid_na_9" returned: 1 in 0.362s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5fd6a6ac-1614-4aa5-aedb-17a31996018d_fid_na_9' failed. Not Retrying. {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 12:20:37 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb3dafd-dac6-4398-b50f-73a801d58f92]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:20:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_gcas36v2devstack@QuobyteHD {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:37 devstack sudo[100531]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-30760436-e140-4cc9-8f7f-7655a0304916 tempest-VolumesListAdminTestJSON-653064872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-dd071116-fcda-4d86-a127-6e3a8977ae4d" returned: 0 in 0.283s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:37 devstack sudo[100536]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_gcas36v2devstack@QuobyteHD
Nov 04 12:20:37 devstack sudo[100536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:37 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-30760436-e140-4cc9-8f7f-7655a0304916 tempest-VolumesListAdminTestJSON-653064872 None] Lock "cinder-quobyte-dd071116-fcda-4d86-a127-6e3a8977ae4d" released by "delete_volume" :: held 0.730s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:20:37 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-30760436-e140-4cc9-8f7f-7655a0304916 tempest-VolumesListAdminTestJSON-653064872 None] Created reservations ['dde3ae4c-dfe1-4b84-9727-a255a267308f', '323f17a1-6cf3-4386-ad7b-b6b460b62e8c', '4de5f83b-4087-4510-9f59-97adbfa7c1de', 'e86a9221-3a96-419c-8926-34aed4d49482'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:20:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-30760436-e140-4cc9-8f7f-7655a0304916 tempest-VolumesListAdminTestJSON-653064872 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:20:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-30760436-e140-4cc9-8f7f-7655a0304916 tempest-VolumesListAdminTestJSON-653064872 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:20:37 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-30760436-e140-4cc9-8f7f-7655a0304916 tempest-VolumesListAdminTestJSON-653064872 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:20:37 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-30760436-e140-4cc9-8f7f-7655a0304916 tempest-VolumesListAdminTestJSON-653064872 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:20:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-30760436-e140-4cc9-8f7f-7655a0304916 tempest-VolumesListAdminTestJSON-653064872 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:20:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-30760436-e140-4cc9-8f7f-7655a0304916 tempest-VolumesListAdminTestJSON-653064872 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:37 devstack sudo[100540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:20:37 devstack sudo[100540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:37 devstack sudo[100536]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_gcas36v2devstack@QuobyteHD" returned: 0 in 0.366s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:37 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] 5fd6a6ac-1614-4aa5-aedb-17a31996018d was qcow2, converting to qcow2 {{(pid=87169) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 04 12:20:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_gcas36v2devstack@QuobyteHD /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1fef71b7-a8de-409c-b1b9-7d0cef41603a {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:37 devstack sudo[100545]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_gcas36v2devstack@QuobyteHD /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1fef71b7-a8de-409c-b1b9-7d0cef41603a
Nov 04 12:20:37 devstack sudo[100545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:38 devstack sudo[100540]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-30760436-e140-4cc9-8f7f-7655a0304916 tempest-VolumesListAdminTestJSON-653064872 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.305s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:38 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-30760436-e140-4cc9-8f7f-7655a0304916 tempest-VolumesListAdminTestJSON-653064872 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:20:38 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-30760436-e140-4cc9-8f7f-7655a0304916 tempest-VolumesListAdminTestJSON-653064872 None] Deleted volume successfully.
Nov 04 12:20:38 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-30760436-e140-4cc9-8f7f-7655a0304916 tempest-VolumesListAdminTestJSON-653064872 None] Lock "cinder-dd071116-fcda-4d86-a127-6e3a8977ae4d-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:20:39 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_9578o1nhdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c58bf890-86b6-42a7-8b07-51514d61914d" returned: 0 in 2.086s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:39 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_9578o1nhdevstack@QuobyteHD, size 112.00 MB, duration 2.09 sec, destination /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c58bf890-86b6-42a7-8b07-51514d61914d {{(pid=87169) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 12:20:39 devstack cinder-volume[87169]: INFO cinder.image.image_utils [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Converted 112.00 MB image at 53.67 MB/s
Nov 04 12:20:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c58bf890-86b6-42a7-8b07-51514d61914d 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:39 devstack sudo[100554]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c58bf890-86b6-42a7-8b07-51514d61914d 1G
Nov 04 12:20:39 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:39 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c58bf890-86b6-42a7-8b07-51514d61914d 1G" returned: 0 in 0.414s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:39 devstack cinder-volume[87169]: DEBUG cinder.volume.volume_utils [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Downloaded image 5fd6a6ac-1614-4aa5-aedb-17a31996018d ((None, [{'url': 'file:///opt/stack/data/glance/images/5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'metadata': {}}])) to volume c58bf890-86b6-42a7-8b07-51514d61914d successfully. {{(pid=87169) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 04 12:20:39 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Temporary image 5fd6a6ac-1614-4aa5-aedb-17a31996018d for user a5ba237f1e5e4ae78cb1c31fd084d325 is deleted. {{(pid=87169) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 04 12:20:39 devstack cinder-volume[87169]: DEBUG cinder.volume.volume_utils [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Marking volume c58bf890-86b6-42a7-8b07-51514d61914d as bootable. {{(pid=87169) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 04 12:20:39 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Copying metadata from image 5fd6a6ac-1614-4aa5-aedb-17a31996018d to c58bf890-86b6-42a7-8b07-51514d61914d. {{(pid=87169) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 04 12:20:39 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Creating volume glance metadata for volume c58bf890-86b6-42a7-8b07-51514d61914d backed by image 5fd6a6ac-1614-4aa5-aedb-17a31996018d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87169) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 04 12:20:39 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b67b45a-b615-445d-a2ff-c14e514c65dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c58bf890-86b6-42a7-8b07-51514d61914d', 'volume_size': 1, 'image_id': '5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '52d49d1f3a4b47a8a8f060da8e0e2c02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'created_at': datetime.datetime(2026, 11, 4, 11, 3, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 3, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fd6a6ac-1614-4aa5-aedb-17a31996018d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cc0594f4980>}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:39 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d51aee4-0708-4644-9a9d-e39a5a8fa5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:39 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Volume volume-c58bf890-86b6-42a7-8b07-51514d61914d (c58bf890-86b6-42a7-8b07-51514d61914d): created successfully
Nov 04 12:20:39 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d51aee4-0708-4644-9a9d-e39a5a8fa5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:39 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Flow 'volume_create_manager' (4e41761b-ab10-408e-b895-7a81433182b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:20:39 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-c663fb0d-02d3-4933-afd3-092b67928647 tempest-VolumesGetTest-484486462 None] Created volume successfully.
Nov 04 12:20:40 devstack sudo[100545]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_gcas36v2devstack@QuobyteHD /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1fef71b7-a8de-409c-b1b9-7d0cef41603a" returned: 0 in 2.317s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:40 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5fd6a6ac-1614-4aa5-aedb-17a31996018d_gcas36v2devstack@QuobyteHD, size 112.00 MB, duration 2.32 sec, destination /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1fef71b7-a8de-409c-b1b9-7d0cef41603a {{(pid=87169) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 12:20:40 devstack cinder-volume[87169]: INFO cinder.image.image_utils [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Converted 112.00 MB image at 48.32 MB/s
Nov 04 12:20:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1fef71b7-a8de-409c-b1b9-7d0cef41603a 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:40 devstack sudo[100559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1fef71b7-a8de-409c-b1b9-7d0cef41603a 1G
Nov 04 12:20:40 devstack sudo[100559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:40 devstack sudo[100559]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1fef71b7-a8de-409c-b1b9-7d0cef41603a 1G" returned: 0 in 0.387s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:40 devstack cinder-volume[87169]: DEBUG cinder.volume.volume_utils [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Downloaded image 5fd6a6ac-1614-4aa5-aedb-17a31996018d ((None, [{'url': 'file:///opt/stack/data/glance/images/5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'metadata': {}}])) to volume 1fef71b7-a8de-409c-b1b9-7d0cef41603a successfully. {{(pid=87169) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 04 12:20:40 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Temporary image 5fd6a6ac-1614-4aa5-aedb-17a31996018d for user dc9cc01a4dd843e88f0fd41f409eb5aa is deleted. {{(pid=87169) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 04 12:20:40 devstack cinder-volume[87169]: DEBUG cinder.volume.volume_utils [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Marking volume 1fef71b7-a8de-409c-b1b9-7d0cef41603a as bootable. {{(pid=87169) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 04 12:20:40 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Copying metadata from image 5fd6a6ac-1614-4aa5-aedb-17a31996018d to 1fef71b7-a8de-409c-b1b9-7d0cef41603a. {{(pid=87169) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 04 12:20:40 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Creating volume glance metadata for volume 1fef71b7-a8de-409c-b1b9-7d0cef41603a backed by image 5fd6a6ac-1614-4aa5-aedb-17a31996018d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87169) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 04 12:20:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39f9f848-d01e-40c0-8568-3ae9b7258169) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fef71b7-a8de-409c-b1b9-7d0cef41603a', 'volume_size': 1, 'image_id': '5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '52d49d1f3a4b47a8a8f060da8e0e2c02', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '5fd6a6ac-1614-4aa5-aedb-17a31996018d', 'created_at': datetime.datetime(2026, 11, 4, 11, 3, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 3, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5fd6a6ac-1614-4aa5-aedb-17a31996018d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cc063a9dfd0>}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76711b02-62dc-4d67-9326-19016c0624ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:40 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Volume volume-1fef71b7-a8de-409c-b1b9-7d0cef41603a (1fef71b7-a8de-409c-b1b9-7d0cef41603a): created successfully
Nov 04 12:20:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76711b02-62dc-4d67-9326-19016c0624ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Flow 'volume_create_manager' (50ff58c1-0e73-4baa-bef3-76aaa7dcc9d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:20:40 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-5185886a-3f1a-48c5-8e13-0f5cb41993a5 tempest-TestShelveInstance-1519749939 None] Created volume successfully.
Nov 04 12:20:41 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-73099b90-e70f-4e12-b513-a7002d888785 tempest-VolumesGetTest-484486462 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:20:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-73099b90-e70f-4e12-b513-a7002d888785 tempest-VolumesGetTest-484486462 None] Flow 'volume_create_manager' (8339914f-5e8a-423d-b51e-bd4fb0d88ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:20:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-73099b90-e70f-4e12-b513-a7002d888785 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e68618e-25d7-4fd2-8f99-5c0047544b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-73099b90-e70f-4e12-b513-a7002d888785 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e68618e-25d7-4fd2-8f99-5c0047544b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:20:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1699301285',display_name='tempest-VolumesGetTest-Volume-1208389465',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee7d78c2-dcb0-4296-90b3-0c66080ad9e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c914710419c41eaa76715e3748b4cf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:20:41Z,use_quota=True,user_id='a5ba237f1e5e4ae78cb1c31fd084d325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-73099b90-e70f-4e12-b513-a7002d888785 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4419fd1-57bc-474d-a06d-de7f19b5b8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-73099b90-e70f-4e12-b513-a7002d888785 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4419fd1-57bc-474d-a06d-de7f19b5b8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-73099b90-e70f-4e12-b513-a7002d888785 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f625aa79-21e2-4707-9d91-a20e9eda214a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-73099b90-e70f-4e12-b513-a7002d888785 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f625aa79-21e2-4707-9d91-a20e9eda214a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee7d78c2-dcb0-4296-90b3-0c66080ad9e1', 'volume_name': 'volume-ee7d78c2-dcb0-4296-90b3-0c66080ad9e1', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-73099b90-e70f-4e12-b513-a7002d888785 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdf11f00-3dc0-4d6d-a54a-f6018afb0e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-73099b90-e70f-4e12-b513-a7002d888785 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdf11f00-3dc0-4d6d-a54a-f6018afb0e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-73099b90-e70f-4e12-b513-a7002d888785 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de24e16c-d40a-409e-80e0-d9036b6da79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:41 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-73099b90-e70f-4e12-b513-a7002d888785 tempest-VolumesGetTest-484486462 None] Volume ee7d78c2-dcb0-4296-90b3-0c66080ad9e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee7d78c2-dcb0-4296-90b3-0c66080ad9e1', 'volume_size': 1}
Nov 04 12:20:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-73099b90-e70f-4e12-b513-a7002d888785 tempest-VolumesGetTest-484486462 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:20:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-73099b90-e70f-4e12-b513-a7002d888785 tempest-VolumesGetTest-484486462 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:20:41 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-73099b90-e70f-4e12-b513-a7002d888785 tempest-VolumesGetTest-484486462 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:20:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1699301285',display_name='tempest-VolumesGetTest-Volume-1208389465',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee7d78c2-dcb0-4296-90b3-0c66080ad9e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c914710419c41eaa76715e3748b4cf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:20:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:20:41Z,use_quota=True,user_id='a5ba237f1e5e4ae78cb1c31fd084d325',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:20:41 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-73099b90-e70f-4e12-b513-a7002d888785 tempest-VolumesGetTest-484486462 None] Creating volume ee7d78c2-dcb0-4296-90b3-0c66080ad9e1 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:20:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-73099b90-e70f-4e12-b513-a7002d888785 tempest-VolumesGetTest-484486462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:20:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-73099b90-e70f-4e12-b513-a7002d888785 tempest-VolumesGetTest-484486462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:20:41 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-73099b90-e70f-4e12-b513-a7002d888785 tempest-VolumesGetTest-484486462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:20:41 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-73099b90-e70f-4e12-b513-a7002d888785 tempest-VolumesGetTest-484486462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:20:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-73099b90-e70f-4e12-b513-a7002d888785 tempest-VolumesGetTest-484486462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:20:41 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-73099b90-e70f-4e12-b513-a7002d888785 tempest-VolumesGetTest-484486462 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:20:41 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-73099b90-e70f-4e12-b513-a7002d888785 tempest-VolumesGetTest-484486462 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:20:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-73099b90-e70f-4e12-b513-a7002d888785 tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ee7d78c2-dcb0-4296-90b3-0c66080ad9e1 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:41 devstack sudo[100565]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ee7d78c2-dcb0-4296-90b3-0c66080ad9e1 1073741824
Nov 04 12:20:41 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:41 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-73099b90-e70f-4e12-b513-a7002d888785 tempest-VolumesGetTest-484486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ee7d78c2-dcb0-4296-90b3-0c66080ad9e1 1073741824" returned: 0 in 0.534s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-73099b90-e70f-4e12-b513-a7002d888785 tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ee7d78c2-dcb0-4296-90b3-0c66080ad9e1 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:41 devstack sudo[100571]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ee7d78c2-dcb0-4296-90b3-0c66080ad9e1
Nov 04 12:20:41 devstack sudo[100571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:42 devstack sudo[100571]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-73099b90-e70f-4e12-b513-a7002d888785 tempest-VolumesGetTest-484486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ee7d78c2-dcb0-4296-90b3-0c66080ad9e1" returned: 0 in 0.259s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:42 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-73099b90-e70f-4e12-b513-a7002d888785 tempest-VolumesGetTest-484486462 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:20:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-73099b90-e70f-4e12-b513-a7002d888785 tempest-VolumesGetTest-484486462 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:20:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-73099b90-e70f-4e12-b513-a7002d888785 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de24e16c-d40a-409e-80e0-d9036b6da79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee7d78c2-dcb0-4296-90b3-0c66080ad9e1', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-73099b90-e70f-4e12-b513-a7002d888785 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0979deff-79a5-4876-b062-fcb4eefd27b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:42 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-73099b90-e70f-4e12-b513-a7002d888785 tempest-VolumesGetTest-484486462 None] Volume volume-ee7d78c2-dcb0-4296-90b3-0c66080ad9e1 (ee7d78c2-dcb0-4296-90b3-0c66080ad9e1): created successfully
Nov 04 12:20:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-73099b90-e70f-4e12-b513-a7002d888785 tempest-VolumesGetTest-484486462 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0979deff-79a5-4876-b062-fcb4eefd27b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-73099b90-e70f-4e12-b513-a7002d888785 tempest-VolumesGetTest-484486462 None] Flow 'volume_create_manager' (8339914f-5e8a-423d-b51e-bd4fb0d88ac6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:20:42 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-73099b90-e70f-4e12-b513-a7002d888785 tempest-VolumesGetTest-484486462 None] Created volume successfully.
Nov 04 12:20:43 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d1e111da-0aa5-45a5-abd6-aceb978f2be5 tempest-VolumesGetTest-484486462 None] Acquiring lock "cinder-ee7d78c2-dcb0-4296-90b3-0c66080ad9e1-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:20:43 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d1e111da-0aa5-45a5-abd6-aceb978f2be5 tempest-VolumesGetTest-484486462 None] Lock "cinder-ee7d78c2-dcb0-4296-90b3-0c66080ad9e1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:20:43 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d1e111da-0aa5-45a5-abd6-aceb978f2be5 tempest-VolumesGetTest-484486462 None] Acquiring lock "cinder-quobyte-ee7d78c2-dcb0-4296-90b3-0c66080ad9e1" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:20:43 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d1e111da-0aa5-45a5-abd6-aceb978f2be5 tempest-VolumesGetTest-484486462 None] Lock "cinder-quobyte-ee7d78c2-dcb0-4296-90b3-0c66080ad9e1" acquired by "delete_volume" :: waited 0.021s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:20:43 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[564238ef-f047-42cf-843f-73cbe0c4dfbf]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:20:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d1e111da-0aa5-45a5-abd6-aceb978f2be5 tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ee7d78c2-dcb0-4296-90b3-0c66080ad9e1 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:43 devstack sudo[100577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ee7d78c2-dcb0-4296-90b3-0c66080ad9e1
Nov 04 12:20:43 devstack sudo[100577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:44 devstack sudo[100577]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d1e111da-0aa5-45a5-abd6-aceb978f2be5 tempest-VolumesGetTest-484486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ee7d78c2-dcb0-4296-90b3-0c66080ad9e1" returned: 0 in 0.486s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d1e111da-0aa5-45a5-abd6-aceb978f2be5 tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ee7d78c2-dcb0-4296-90b3-0c66080ad9e1 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:44 devstack sudo[100583]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ee7d78c2-dcb0-4296-90b3-0c66080ad9e1
Nov 04 12:20:44 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:44 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d1e111da-0aa5-45a5-abd6-aceb978f2be5 tempest-VolumesGetTest-484486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ee7d78c2-dcb0-4296-90b3-0c66080ad9e1" returned: 0 in 0.348s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:44 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d1e111da-0aa5-45a5-abd6-aceb978f2be5 tempest-VolumesGetTest-484486462 None] Lock "cinder-quobyte-ee7d78c2-dcb0-4296-90b3-0c66080ad9e1" released by "delete_volume" :: held 0.895s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:20:44 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-d1e111da-0aa5-45a5-abd6-aceb978f2be5 tempest-VolumesGetTest-484486462 None] Created reservations ['e9db3c33-735d-438e-9fea-85879ddf85ef', 'c4a75e83-f5b7-4702-8176-92c7e82fae7f', 'f6f94d29-82d2-4a70-91df-b662a6eb2c64', '21d2e126-4ce6-4895-aa86-850df0e997e4'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:20:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d1e111da-0aa5-45a5-abd6-aceb978f2be5 tempest-VolumesGetTest-484486462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:20:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d1e111da-0aa5-45a5-abd6-aceb978f2be5 tempest-VolumesGetTest-484486462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:20:44 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d1e111da-0aa5-45a5-abd6-aceb978f2be5 tempest-VolumesGetTest-484486462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:20:44 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d1e111da-0aa5-45a5-abd6-aceb978f2be5 tempest-VolumesGetTest-484486462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:20:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d1e111da-0aa5-45a5-abd6-aceb978f2be5 tempest-VolumesGetTest-484486462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:20:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d1e111da-0aa5-45a5-abd6-aceb978f2be5 tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:44 devstack sudo[100594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:20:44 devstack sudo[100594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-8ab7ee91-b545-4788-9864-eb6fdf0cd639 req-a893b648-32df-48e5-a172-13e7d251dc96 tempest-TestShelveInstance-1519749939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:20:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-8ab7ee91-b545-4788-9864-eb6fdf0cd639 req-a893b648-32df-48e5-a172-13e7d251dc96 tempest-TestShelveInstance-1519749939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:20:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-8ab7ee91-b545-4788-9864-eb6fdf0cd639 req-a893b648-32df-48e5-a172-13e7d251dc96 tempest-TestShelveInstance-1519749939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:20:44 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a1b75394-e7bd-40c9-90ae-41d1d737270b tempest-VolumesGetTest-484486462 None] Acquiring lock "cinder-c58bf890-86b6-42a7-8b07-51514d61914d-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:20:45 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a1b75394-e7bd-40c9-90ae-41d1d737270b tempest-VolumesGetTest-484486462 None] Lock "cinder-c58bf890-86b6-42a7-8b07-51514d61914d-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:20:45 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-8ab7ee91-b545-4788-9864-eb6fdf0cd639 req-a893b648-32df-48e5-a172-13e7d251dc96 tempest-TestShelveInstance-1519749939 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79', 'name': 'volume-1fef71b7-a8de-409c-b1b9-7d0cef41603a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a077e0b9-f92c-426a-a413-4e66933f673b', 'enforce_multipath': True} {{(pid=87169) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 04 12:20:45 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a1b75394-e7bd-40c9-90ae-41d1d737270b tempest-VolumesGetTest-484486462 None] Acquiring lock "cinder-quobyte-c58bf890-86b6-42a7-8b07-51514d61914d" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:20:45 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a1b75394-e7bd-40c9-90ae-41d1d737270b tempest-VolumesGetTest-484486462 None] Lock "cinder-quobyte-c58bf890-86b6-42a7-8b07-51514d61914d" acquired by "delete_volume" :: waited 0.024s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:20:45 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-8ab7ee91-b545-4788-9864-eb6fdf0cd639 req-a893b648-32df-48e5-a172-13e7d251dc96 tempest-TestShelveInstance-1519749939 None] attachment_update completed successfully.
Nov 04 12:20:45 devstack sudo[100594]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:45 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[98dd5343-93c9-49eb-bc5a-2c1227275501]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:20:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a1b75394-e7bd-40c9-90ae-41d1d737270b tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c58bf890-86b6-42a7-8b07-51514d61914d {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d1e111da-0aa5-45a5-abd6-aceb978f2be5 tempest-VolumesGetTest-484486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.466s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:45 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-d1e111da-0aa5-45a5-abd6-aceb978f2be5 tempest-VolumesGetTest-484486462 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:20:45 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-d1e111da-0aa5-45a5-abd6-aceb978f2be5 tempest-VolumesGetTest-484486462 None] Deleted volume successfully.
Nov 04 12:20:45 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d1e111da-0aa5-45a5-abd6-aceb978f2be5 tempest-VolumesGetTest-484486462 None] Lock "cinder-ee7d78c2-dcb0-4296-90b3-0c66080ad9e1-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:20:45 devstack sudo[100597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c58bf890-86b6-42a7-8b07-51514d61914d
Nov 04 12:20:45 devstack sudo[100597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:45 devstack sudo[100597]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a1b75394-e7bd-40c9-90ae-41d1d737270b tempest-VolumesGetTest-484486462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c58bf890-86b6-42a7-8b07-51514d61914d" returned: 0 in 0.478s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a1b75394-e7bd-40c9-90ae-41d1d737270b tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c58bf890-86b6-42a7-8b07-51514d61914d {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:45 devstack sudo[100602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c58bf890-86b6-42a7-8b07-51514d61914d
Nov 04 12:20:45 devstack sudo[100602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:45 devstack sudo[100602]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a1b75394-e7bd-40c9-90ae-41d1d737270b tempest-VolumesGetTest-484486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c58bf890-86b6-42a7-8b07-51514d61914d" returned: 0 in 0.267s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:45 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a1b75394-e7bd-40c9-90ae-41d1d737270b tempest-VolumesGetTest-484486462 None] Lock "cinder-quobyte-c58bf890-86b6-42a7-8b07-51514d61914d" released by "delete_volume" :: held 0.802s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:20:46 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-a1b75394-e7bd-40c9-90ae-41d1d737270b tempest-VolumesGetTest-484486462 None] Created reservations ['fbb5ab30-5c7c-4eca-996f-f5622b45b599', '8bfba737-2a7c-4c13-bdbe-8d322ca51704', 'bacf82d1-3515-4ce3-8bd3-70fbff0c3ee2', '381dac75-0097-41fb-8f76-5502b76b3c4f'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:20:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a1b75394-e7bd-40c9-90ae-41d1d737270b tempest-VolumesGetTest-484486462 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:20:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a1b75394-e7bd-40c9-90ae-41d1d737270b tempest-VolumesGetTest-484486462 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:20:46 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a1b75394-e7bd-40c9-90ae-41d1d737270b tempest-VolumesGetTest-484486462 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:20:46 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a1b75394-e7bd-40c9-90ae-41d1d737270b tempest-VolumesGetTest-484486462 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:20:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a1b75394-e7bd-40c9-90ae-41d1d737270b tempest-VolumesGetTest-484486462 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:20:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a1b75394-e7bd-40c9-90ae-41d1d737270b tempest-VolumesGetTest-484486462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:46 devstack sudo[100605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:20:46 devstack sudo[100605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:46 devstack sudo[100605]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a1b75394-e7bd-40c9-90ae-41d1d737270b tempest-VolumesGetTest-484486462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.285s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:46 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-a1b75394-e7bd-40c9-90ae-41d1d737270b tempest-VolumesGetTest-484486462 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:20:46 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-a1b75394-e7bd-40c9-90ae-41d1d737270b tempest-VolumesGetTest-484486462 None] Deleted volume successfully.
Nov 04 12:20:46 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a1b75394-e7bd-40c9-90ae-41d1d737270b tempest-VolumesGetTest-484486462 None] Lock "cinder-c58bf890-86b6-42a7-8b07-51514d61914d-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:20:47 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-a535d839-1d6a-45d2-8119-1c02702a4681 tempest-SnapshotMetadataTestJSON-1208892347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:20:47 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a535d839-1d6a-45d2-8119-1c02702a4681 tempest-SnapshotMetadataTestJSON-1208892347 None] Flow 'volume_create_manager' (c27737cd-5621-418b-b9b7-4fbc053748ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:20:47 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a535d839-1d6a-45d2-8119-1c02702a4681 tempest-SnapshotMetadataTestJSON-1208892347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0a4d72a-d607-421b-85be-280d9fed9b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:47 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a535d839-1d6a-45d2-8119-1c02702a4681 tempest-SnapshotMetadataTestJSON-1208892347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0a4d72a-d607-421b-85be-280d9fed9b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1692268446',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=978a2e0b-1f93-44aa-9374-c3e63577f751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5af87a258c34033a6e281488187b330',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:20:48Z,use_quota=True,user_id='88805f72a5f54a4fa1a0f13c68bb10f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:47 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a535d839-1d6a-45d2-8119-1c02702a4681 tempest-SnapshotMetadataTestJSON-1208892347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a649d65-5619-40ad-9b12-b35e06664570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:47 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a535d839-1d6a-45d2-8119-1c02702a4681 tempest-SnapshotMetadataTestJSON-1208892347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a649d65-5619-40ad-9b12-b35e06664570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:47 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a535d839-1d6a-45d2-8119-1c02702a4681 tempest-SnapshotMetadataTestJSON-1208892347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9836331-c105-4f22-bc6c-b91a11c50883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:47 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a535d839-1d6a-45d2-8119-1c02702a4681 tempest-SnapshotMetadataTestJSON-1208892347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9836331-c105-4f22-bc6c-b91a11c50883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '978a2e0b-1f93-44aa-9374-c3e63577f751', 'volume_name': 'volume-978a2e0b-1f93-44aa-9374-c3e63577f751', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:47 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a535d839-1d6a-45d2-8119-1c02702a4681 tempest-SnapshotMetadataTestJSON-1208892347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cabd45fb-6feb-4781-a632-e1648e885b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:47 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a535d839-1d6a-45d2-8119-1c02702a4681 tempest-SnapshotMetadataTestJSON-1208892347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cabd45fb-6feb-4781-a632-e1648e885b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:47 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a535d839-1d6a-45d2-8119-1c02702a4681 tempest-SnapshotMetadataTestJSON-1208892347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e45fd275-fe58-41dd-8908-764b413207c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:47 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-a535d839-1d6a-45d2-8119-1c02702a4681 tempest-SnapshotMetadataTestJSON-1208892347 None] Volume 978a2e0b-1f93-44aa-9374-c3e63577f751: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-978a2e0b-1f93-44aa-9374-c3e63577f751', 'volume_size': 1}
Nov 04 12:20:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a535d839-1d6a-45d2-8119-1c02702a4681 tempest-SnapshotMetadataTestJSON-1208892347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:20:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a535d839-1d6a-45d2-8119-1c02702a4681 tempest-SnapshotMetadataTestJSON-1208892347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:20:47 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a535d839-1d6a-45d2-8119-1c02702a4681 tempest-SnapshotMetadataTestJSON-1208892347 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:20:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1692268446',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=978a2e0b-1f93-44aa-9374-c3e63577f751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5af87a258c34033a6e281488187b330',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:20:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:20:48Z,use_quota=True,user_id='88805f72a5f54a4fa1a0f13c68bb10f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:20:47 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-a535d839-1d6a-45d2-8119-1c02702a4681 tempest-SnapshotMetadataTestJSON-1208892347 None] Creating volume 978a2e0b-1f93-44aa-9374-c3e63577f751 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:20:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a535d839-1d6a-45d2-8119-1c02702a4681 tempest-SnapshotMetadataTestJSON-1208892347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:20:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a535d839-1d6a-45d2-8119-1c02702a4681 tempest-SnapshotMetadataTestJSON-1208892347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:20:47 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a535d839-1d6a-45d2-8119-1c02702a4681 tempest-SnapshotMetadataTestJSON-1208892347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:20:47 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a535d839-1d6a-45d2-8119-1c02702a4681 tempest-SnapshotMetadataTestJSON-1208892347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:20:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a535d839-1d6a-45d2-8119-1c02702a4681 tempest-SnapshotMetadataTestJSON-1208892347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:20:47 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a535d839-1d6a-45d2-8119-1c02702a4681 tempest-SnapshotMetadataTestJSON-1208892347 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:20:47 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-a535d839-1d6a-45d2-8119-1c02702a4681 tempest-SnapshotMetadataTestJSON-1208892347 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:20:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a535d839-1d6a-45d2-8119-1c02702a4681 tempest-SnapshotMetadataTestJSON-1208892347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:48 devstack sudo[100610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751 1073741824
Nov 04 12:20:48 devstack sudo[100610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:48 devstack sudo[100610]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a535d839-1d6a-45d2-8119-1c02702a4681 tempest-SnapshotMetadataTestJSON-1208892347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751 1073741824" returned: 0 in 0.848s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a535d839-1d6a-45d2-8119-1c02702a4681 tempest-SnapshotMetadataTestJSON-1208892347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:48 devstack sudo[101065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751
Nov 04 12:20:48 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:49 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a535d839-1d6a-45d2-8119-1c02702a4681 tempest-SnapshotMetadataTestJSON-1208892347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751" returned: 0 in 0.415s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a535d839-1d6a-45d2-8119-1c02702a4681 tempest-SnapshotMetadataTestJSON-1208892347 None] <== create_volume: return (1376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:20:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a535d839-1d6a-45d2-8119-1c02702a4681 tempest-SnapshotMetadataTestJSON-1208892347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.380s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:20:49 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a535d839-1d6a-45d2-8119-1c02702a4681 tempest-SnapshotMetadataTestJSON-1208892347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e45fd275-fe58-41dd-8908-764b413207c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-978a2e0b-1f93-44aa-9374-c3e63577f751', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:49 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a535d839-1d6a-45d2-8119-1c02702a4681 tempest-SnapshotMetadataTestJSON-1208892347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a26dae44-b934-4c52-ac12-323f2bd688bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:49 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-a535d839-1d6a-45d2-8119-1c02702a4681 tempest-SnapshotMetadataTestJSON-1208892347 None] Volume volume-978a2e0b-1f93-44aa-9374-c3e63577f751 (978a2e0b-1f93-44aa-9374-c3e63577f751): created successfully
Nov 04 12:20:49 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a535d839-1d6a-45d2-8119-1c02702a4681 tempest-SnapshotMetadataTestJSON-1208892347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a26dae44-b934-4c52-ac12-323f2bd688bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:49 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a535d839-1d6a-45d2-8119-1c02702a4681 tempest-SnapshotMetadataTestJSON-1208892347 None] Flow 'volume_create_manager' (c27737cd-5621-418b-b9b7-4fbc053748ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:20:49 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-a535d839-1d6a-45d2-8119-1c02702a4681 tempest-SnapshotMetadataTestJSON-1208892347 None] Created volume successfully.
Nov 04 12:20:49 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:20:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:20:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:20:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:20:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:20:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:20:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:49 devstack sudo[101093]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:20:49 devstack sudo[101093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:50 devstack sudo[101093]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.305s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:50 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:20:50 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager._thread_info {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:20:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread count: 28 {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 12:20:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread info: [<_MainThread(MainThread, started 137165867425920)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137165754678912)>, <Thread(Thread-3 (stat_writer), started daemon 137165754130752)>, <Thread(Rabbit-heartbeat, started daemon 137165752997504)>, <Thread(Thread-5 (_runner), started daemon 137165753227712)>, <Thread(Thread-7 (_runner), started daemon 137165751273856)>, <Thread(fd_logger, started daemon 137165755322048)>, <Thread(privsep_reader, started daemon 137165748896704)>, <Thread(tpool_thread_0, started daemon 137165742520000)>, <Thread(tpool_thread_1, started daemon 137165734127296)>, <Thread(tpool_thread_2, started daemon 137165725734592)>, <Thread(tpool_thread_3, started daemon 137165717341888)>, <Thread(tpool_thread_4, started daemon 137165708949184)>, <Thread(tpool_thread_5, started daemon 137165700556480)>, <Thread(tpool_thread_6, started daemon 137165692163776)>, <Thread(tpool_thread_7, started daemon 137165683771072)>, <Thread(tpool_thread_8, started daemon 137165675378368)>, <Thread(tpool_thread_9, started daemon 137165666985664)>, <Thread(tpool_thread_10, started daemon 137165658592960)>, <Thread(tpool_thread_11, started daemon 137165650183872)>, <Thread(tpool_thread_12, started daemon 137165641774784)>, <Thread(tpool_thread_13, started daemon 137165633365696)>, <Thread(tpool_thread_14, started daemon 137165624956608)>, <Thread(tpool_thread_15, started daemon 137165616547520)>, <Thread(tpool_thread_16, started daemon 137165608138432)>, <Thread(tpool_thread_17, started daemon 137165599729344)>, <Thread(tpool_thread_18, started daemon 137165591320256)>, <Thread(tpool_thread_19, started daemon 137165582911168)>] {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 12:20:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e3aded12-9081-4107-bd33-1d94533dcbe2 tempest-SnapshotMetadataTestJSON-1208892347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:20:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e3aded12-9081-4107-bd33-1d94533dcbe2 tempest-SnapshotMetadataTestJSON-1208892347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:20:50 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-e3aded12-9081-4107-bd33-1d94533dcbe2 tempest-SnapshotMetadataTestJSON-1208892347 None] Creating offline snapshot f92754c9-c3d3-4033-bf45-f5bb74a9799c of volume 978a2e0b-1f93-44aa-9374-c3e63577f751 {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:20:50 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa92ea4d-5efe-4f27-906d-00a0ca77511e]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:20:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e3aded12-9081-4107-bd33-1d94533dcbe2 tempest-SnapshotMetadataTestJSON-1208892347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:50 devstack sudo[101096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751
Nov 04 12:20:50 devstack sudo[101096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:50 devstack sudo[101096]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e3aded12-9081-4107-bd33-1d94533dcbe2 tempest-SnapshotMetadataTestJSON-1208892347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751" returned: 0 in 0.627s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e3aded12-9081-4107-bd33-1d94533dcbe2 tempest-SnapshotMetadataTestJSON-1208892347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751.f92754c9-c3d3-4033-bf45-f5bb74a9799c 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:50 devstack sudo[101105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751.f92754c9-c3d3-4033-bf45-f5bb74a9799c 1G
Nov 04 12:20:50 devstack sudo[101105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:51 devstack sudo[101105]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e3aded12-9081-4107-bd33-1d94533dcbe2 tempest-SnapshotMetadataTestJSON-1208892347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751.f92754c9-c3d3-4033-bf45-f5bb74a9799c 1G" returned: 0 in 0.430s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e3aded12-9081-4107-bd33-1d94533dcbe2 tempest-SnapshotMetadataTestJSON-1208892347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-978a2e0b-1f93-44aa-9374-c3e63577f751 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751.f92754c9-c3d3-4033-bf45-f5bb74a9799c {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:51 devstack sudo[101112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-978a2e0b-1f93-44aa-9374-c3e63577f751 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751.f92754c9-c3d3-4033-bf45-f5bb74a9799c
Nov 04 12:20:51 devstack sudo[101112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:51 devstack sudo[101112]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e3aded12-9081-4107-bd33-1d94533dcbe2 tempest-SnapshotMetadataTestJSON-1208892347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-978a2e0b-1f93-44aa-9374-c3e63577f751 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751.f92754c9-c3d3-4033-bf45-f5bb74a9799c" returned: 0 in 0.364s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:51 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-e3aded12-9081-4107-bd33-1d94533dcbe2 tempest-SnapshotMetadataTestJSON-1208892347 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751.f92754c9-c3d3-4033-bf45-f5bb74a9799c is being set with open permissions: ugo+rw
Nov 04 12:20:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e3aded12-9081-4107-bd33-1d94533dcbe2 tempest-SnapshotMetadataTestJSON-1208892347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751.f92754c9-c3d3-4033-bf45-f5bb74a9799c {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:51 devstack sudo[101117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751.f92754c9-c3d3-4033-bf45-f5bb74a9799c
Nov 04 12:20:51 devstack sudo[101117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:52 devstack sudo[101117]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e3aded12-9081-4107-bd33-1d94533dcbe2 tempest-SnapshotMetadataTestJSON-1208892347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751.f92754c9-c3d3-4033-bf45-f5bb74a9799c" returned: 0 in 0.333s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e3aded12-9081-4107-bd33-1d94533dcbe2 tempest-SnapshotMetadataTestJSON-1208892347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:52 devstack sudo[101120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751.info
Nov 04 12:20:52 devstack sudo[101120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:52 devstack sudo[101120]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e3aded12-9081-4107-bd33-1d94533dcbe2 tempest-SnapshotMetadataTestJSON-1208892347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751.info" returned: 0 in 0.394s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:52 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-e3aded12-9081-4107-bd33-1d94533dcbe2 tempest-SnapshotMetadataTestJSON-1208892347 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751.info is being set with open permissions: ugo+rw
Nov 04 12:20:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e3aded12-9081-4107-bd33-1d94533dcbe2 tempest-SnapshotMetadataTestJSON-1208892347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:52 devstack sudo[101123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751.info
Nov 04 12:20:52 devstack sudo[101123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:52 devstack sudo[101123]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e3aded12-9081-4107-bd33-1d94533dcbe2 tempest-SnapshotMetadataTestJSON-1208892347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751.info" returned: 0 in 0.392s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e3aded12-9081-4107-bd33-1d94533dcbe2 tempest-SnapshotMetadataTestJSON-1208892347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.680s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:20:52 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-e3aded12-9081-4107-bd33-1d94533dcbe2 tempest-SnapshotMetadataTestJSON-1208892347 None] Create snapshot completed successfully
Nov 04 12:20:55 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-38c08e80-1fbf-4712-a658-149a15e4e905 tempest-SnapshotMetadataTestJSON-1208892347 None] Acquiring lock "cinder-f92754c9-c3d3-4033-bf45-f5bb74a9799c-delete_snapshot" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:20:55 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-38c08e80-1fbf-4712-a658-149a15e4e905 tempest-SnapshotMetadataTestJSON-1208892347 None] Lock "cinder-f92754c9-c3d3-4033-bf45-f5bb74a9799c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:20:55 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-38c08e80-1fbf-4712-a658-149a15e4e905 tempest-SnapshotMetadataTestJSON-1208892347 None] Acquiring lock "cinder-quobyte-978a2e0b-1f93-44aa-9374-c3e63577f751" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:20:55 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-38c08e80-1fbf-4712-a658-149a15e4e905 tempest-SnapshotMetadataTestJSON-1208892347 None] Lock "cinder-quobyte-978a2e0b-1f93-44aa-9374-c3e63577f751" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:20:55 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-38c08e80-1fbf-4712-a658-149a15e4e905 tempest-SnapshotMetadataTestJSON-1208892347 None] Acquiring lock "cinder-quobyte-f92754c9-c3d3-4033-bf45-f5bb74a9799c" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:20:55 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-38c08e80-1fbf-4712-a658-149a15e4e905 tempest-SnapshotMetadataTestJSON-1208892347 None] Lock "cinder-quobyte-f92754c9-c3d3-4033-bf45-f5bb74a9799c" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:20:55 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-38c08e80-1fbf-4712-a658-149a15e4e905 tempest-SnapshotMetadataTestJSON-1208892347 None] Deleting offline snapshot f92754c9-c3d3-4033-bf45-f5bb74a9799c of volume 978a2e0b-1f93-44aa-9374-c3e63577f751 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:20:55 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-38c08e80-1fbf-4712-a658-149a15e4e905 tempest-SnapshotMetadataTestJSON-1208892347 None] snapshot_file for this snap is: volume-978a2e0b-1f93-44aa-9374-c3e63577f751.f92754c9-c3d3-4033-bf45-f5bb74a9799c {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:20:55 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[c273ee08-1896-4a57-a7dd-7eb209073f14]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:20:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-38c08e80-1fbf-4712-a658-149a15e4e905 tempest-SnapshotMetadataTestJSON-1208892347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751.f92754c9-c3d3-4033-bf45-f5bb74a9799c {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:55 devstack sudo[101127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751.f92754c9-c3d3-4033-bf45-f5bb74a9799c
Nov 04 12:20:55 devstack sudo[101127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:55 devstack sudo[101127]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-38c08e80-1fbf-4712-a658-149a15e4e905 tempest-SnapshotMetadataTestJSON-1208892347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751.f92754c9-c3d3-4033-bf45-f5bb74a9799c" returned: 0 in 0.584s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:55 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-38c08e80-1fbf-4712-a658-149a15e4e905 tempest-SnapshotMetadataTestJSON-1208892347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-978a2e0b-1f93-44aa-9374-c3e63577f751(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:20:55 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc15e5b-b9fe-4084-9cf1-34cf13d25fd5]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:20:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-38c08e80-1fbf-4712-a658-149a15e4e905 tempest-SnapshotMetadataTestJSON-1208892347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:56 devstack sudo[101134]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751
Nov 04 12:20:56 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:56 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-38c08e80-1fbf-4712-a658-149a15e4e905 tempest-SnapshotMetadataTestJSON-1208892347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751" returned: 0 in 0.518s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-38c08e80-1fbf-4712-a658-149a15e4e905 tempest-SnapshotMetadataTestJSON-1208892347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751.f92754c9-c3d3-4033-bf45-f5bb74a9799c {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:56 devstack sudo[101139]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751.f92754c9-c3d3-4033-bf45-f5bb74a9799c
Nov 04 12:20:56 devstack sudo[101139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:56 devstack sudo[101139]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-38c08e80-1fbf-4712-a658-149a15e4e905 tempest-SnapshotMetadataTestJSON-1208892347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751.f92754c9-c3d3-4033-bf45-f5bb74a9799c" returned: 0 in 0.428s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-38c08e80-1fbf-4712-a658-149a15e4e905 tempest-SnapshotMetadataTestJSON-1208892347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751.f92754c9-c3d3-4033-bf45-f5bb74a9799c {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:56 devstack sudo[101146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751.f92754c9-c3d3-4033-bf45-f5bb74a9799c
Nov 04 12:20:56 devstack sudo[101146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:57 devstack sudo[101146]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-38c08e80-1fbf-4712-a658-149a15e4e905 tempest-SnapshotMetadataTestJSON-1208892347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751.f92754c9-c3d3-4033-bf45-f5bb74a9799c" returned: 0 in 0.330s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:57 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-38c08e80-1fbf-4712-a658-149a15e4e905 tempest-SnapshotMetadataTestJSON-1208892347 None] Lock "cinder-quobyte-f92754c9-c3d3-4033-bf45-f5bb74a9799c" released by "_delete_snapshot" :: held 2.052s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:20:57 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-38c08e80-1fbf-4712-a658-149a15e4e905 tempest-SnapshotMetadataTestJSON-1208892347 None] Lock "cinder-quobyte-978a2e0b-1f93-44aa-9374-c3e63577f751" released by "delete_snapshot" :: held 2.093s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:20:57 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-38c08e80-1fbf-4712-a658-149a15e4e905 tempest-SnapshotMetadataTestJSON-1208892347 None] Created reservations ['b1819d82-70fc-47cd-95af-e56970eaef01', '3a881a87-bf96-4e5e-a151-e67a7dbe349d', '50ad0219-710e-43f5-8c38-63585a49c77b', 'ef38bf58-45fb-48a0-8758-21cc1a499585'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:20:57 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-38c08e80-1fbf-4712-a658-149a15e4e905 tempest-SnapshotMetadataTestJSON-1208892347 None] Delete snapshot completed successfully.
Nov 04 12:20:57 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-38c08e80-1fbf-4712-a658-149a15e4e905 tempest-SnapshotMetadataTestJSON-1208892347 None] Lock "cinder-f92754c9-c3d3-4033-bf45-f5bb74a9799c-delete_snapshot" released by "delete_snapshot" :: held 2.376s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:20:57 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b247354-584b-414e-9901-28ebdceb692e tempest-VolumesListTestJSON-895243107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:20:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6b247354-584b-414e-9901-28ebdceb692e tempest-VolumesListTestJSON-895243107 None] Flow 'volume_create_manager' (f08516d1-57db-4d77-bf99-63229095500c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:20:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6b247354-584b-414e-9901-28ebdceb692e tempest-VolumesListTestJSON-895243107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d03d0efd-9d4d-4eb9-8890-f607734c8d6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6b247354-584b-414e-9901-28ebdceb692e tempest-VolumesListTestJSON-895243107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d03d0efd-9d4d-4eb9-8890-f607734c8d6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:20:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-37564107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aadc8e30-7d1f-414c-b50d-137d89f21318,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='36509d8b893e410ca273f6f7feca3e6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:20:58Z,use_quota=True,user_id='1c6c0e5a507b4d5a8e0851bbc0bd7acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6b247354-584b-414e-9901-28ebdceb692e tempest-VolumesListTestJSON-895243107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a38419-3129-484c-bb22-5cbc98ac84d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6b247354-584b-414e-9901-28ebdceb692e tempest-VolumesListTestJSON-895243107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52a38419-3129-484c-bb22-5cbc98ac84d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6b247354-584b-414e-9901-28ebdceb692e tempest-VolumesListTestJSON-895243107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1df7908-2345-4d14-abb5-d4415313391d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6b247354-584b-414e-9901-28ebdceb692e tempest-VolumesListTestJSON-895243107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1df7908-2345-4d14-abb5-d4415313391d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aadc8e30-7d1f-414c-b50d-137d89f21318', 'volume_name': 'volume-aadc8e30-7d1f-414c-b50d-137d89f21318', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6b247354-584b-414e-9901-28ebdceb692e tempest-VolumesListTestJSON-895243107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6be8747-1d34-4939-8012-2a6c45d6ed8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6b247354-584b-414e-9901-28ebdceb692e tempest-VolumesListTestJSON-895243107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6be8747-1d34-4939-8012-2a6c45d6ed8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6b247354-584b-414e-9901-28ebdceb692e tempest-VolumesListTestJSON-895243107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (503aa8b0-5c60-4234-8772-c2c15c2cd253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:57 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-6b247354-584b-414e-9901-28ebdceb692e tempest-VolumesListTestJSON-895243107 None] Volume aadc8e30-7d1f-414c-b50d-137d89f21318: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aadc8e30-7d1f-414c-b50d-137d89f21318', 'volume_size': 1}
Nov 04 12:20:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-6b247354-584b-414e-9901-28ebdceb692e tempest-VolumesListTestJSON-895243107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:20:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-6b247354-584b-414e-9901-28ebdceb692e tempest-VolumesListTestJSON-895243107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:20:57 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-6b247354-584b-414e-9901-28ebdceb692e tempest-VolumesListTestJSON-895243107 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:20:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-37564107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aadc8e30-7d1f-414c-b50d-137d89f21318,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='36509d8b893e410ca273f6f7feca3e6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:20:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:20:58Z,use_quota=True,user_id='1c6c0e5a507b4d5a8e0851bbc0bd7acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:20:57 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-6b247354-584b-414e-9901-28ebdceb692e tempest-VolumesListTestJSON-895243107 None] Creating volume aadc8e30-7d1f-414c-b50d-137d89f21318 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:20:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-6b247354-584b-414e-9901-28ebdceb692e tempest-VolumesListTestJSON-895243107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:20:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-6b247354-584b-414e-9901-28ebdceb692e tempest-VolumesListTestJSON-895243107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:20:57 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-6b247354-584b-414e-9901-28ebdceb692e tempest-VolumesListTestJSON-895243107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:20:57 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-6b247354-584b-414e-9901-28ebdceb692e tempest-VolumesListTestJSON-895243107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:20:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-6b247354-584b-414e-9901-28ebdceb692e tempest-VolumesListTestJSON-895243107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:20:57 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-6b247354-584b-414e-9901-28ebdceb692e tempest-VolumesListTestJSON-895243107 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:20:57 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-6b247354-584b-414e-9901-28ebdceb692e tempest-VolumesListTestJSON-895243107 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:20:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6b247354-584b-414e-9901-28ebdceb692e tempest-VolumesListTestJSON-895243107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aadc8e30-7d1f-414c-b50d-137d89f21318 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:57 devstack sudo[101150]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aadc8e30-7d1f-414c-b50d-137d89f21318 1073741824
Nov 04 12:20:57 devstack sudo[101150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:58 devstack sudo[101150]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6b247354-584b-414e-9901-28ebdceb692e tempest-VolumesListTestJSON-895243107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aadc8e30-7d1f-414c-b50d-137d89f21318 1073741824" returned: 0 in 0.433s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6b247354-584b-414e-9901-28ebdceb692e tempest-VolumesListTestJSON-895243107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aadc8e30-7d1f-414c-b50d-137d89f21318 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:58 devstack sudo[101156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aadc8e30-7d1f-414c-b50d-137d89f21318
Nov 04 12:20:58 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:58 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6b247354-584b-414e-9901-28ebdceb692e tempest-VolumesListTestJSON-895243107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aadc8e30-7d1f-414c-b50d-137d89f21318" returned: 0 in 0.271s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:58 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-6b247354-584b-414e-9901-28ebdceb692e tempest-VolumesListTestJSON-895243107 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:20:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-6b247354-584b-414e-9901-28ebdceb692e tempest-VolumesListTestJSON-895243107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:20:58 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-301e033a-291e-471e-b883-c105f232158f tempest-SnapshotMetadataTestJSON-1208892347 None] Acquiring lock "cinder-978a2e0b-1f93-44aa-9374-c3e63577f751-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:20:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6b247354-584b-414e-9901-28ebdceb692e tempest-VolumesListTestJSON-895243107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (503aa8b0-5c60-4234-8772-c2c15c2cd253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aadc8e30-7d1f-414c-b50d-137d89f21318', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6b247354-584b-414e-9901-28ebdceb692e tempest-VolumesListTestJSON-895243107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db67f028-524e-4c75-8c84-061ae579cc10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:20:58 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-301e033a-291e-471e-b883-c105f232158f tempest-SnapshotMetadataTestJSON-1208892347 None] Lock "cinder-978a2e0b-1f93-44aa-9374-c3e63577f751-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:20:58 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-6b247354-584b-414e-9901-28ebdceb692e tempest-VolumesListTestJSON-895243107 None] Volume volume-aadc8e30-7d1f-414c-b50d-137d89f21318 (aadc8e30-7d1f-414c-b50d-137d89f21318): created successfully
Nov 04 12:20:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6b247354-584b-414e-9901-28ebdceb692e tempest-VolumesListTestJSON-895243107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db67f028-524e-4c75-8c84-061ae579cc10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:20:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6b247354-584b-414e-9901-28ebdceb692e tempest-VolumesListTestJSON-895243107 None] Flow 'volume_create_manager' (f08516d1-57db-4d77-bf99-63229095500c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:20:58 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-6b247354-584b-414e-9901-28ebdceb692e tempest-VolumesListTestJSON-895243107 None] Created volume successfully.
Nov 04 12:20:58 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-301e033a-291e-471e-b883-c105f232158f tempest-SnapshotMetadataTestJSON-1208892347 None] Acquiring lock "cinder-quobyte-978a2e0b-1f93-44aa-9374-c3e63577f751" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:20:58 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-301e033a-291e-471e-b883-c105f232158f tempest-SnapshotMetadataTestJSON-1208892347 None] Lock "cinder-quobyte-978a2e0b-1f93-44aa-9374-c3e63577f751" acquired by "delete_volume" :: waited 0.016s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:20:58 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbeff0d0-beb3-4d1f-9447-0345342e3725]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:20:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-301e033a-291e-471e-b883-c105f232158f tempest-SnapshotMetadataTestJSON-1208892347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:58 devstack sudo[101159]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751
Nov 04 12:20:58 devstack sudo[101159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:59 devstack sudo[101159]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-301e033a-291e-471e-b883-c105f232158f tempest-SnapshotMetadataTestJSON-1208892347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751" returned: 0 in 0.353s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-301e033a-291e-471e-b883-c105f232158f tempest-SnapshotMetadataTestJSON-1208892347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:59 devstack sudo[101164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751
Nov 04 12:20:59 devstack sudo[101164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:59 devstack sudo[101164]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-301e033a-291e-471e-b883-c105f232158f tempest-SnapshotMetadataTestJSON-1208892347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-978a2e0b-1f93-44aa-9374-c3e63577f751" returned: 0 in 0.239s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:59 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-301e033a-291e-471e-b883-c105f232158f tempest-SnapshotMetadataTestJSON-1208892347 None] Lock "cinder-quobyte-978a2e0b-1f93-44aa-9374-c3e63577f751" released by "delete_volume" :: held 0.652s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:20:59 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-301e033a-291e-471e-b883-c105f232158f tempest-SnapshotMetadataTestJSON-1208892347 None] Created reservations ['5028f7de-d289-4c17-89ec-61142d73cc2e', '7b34adb1-29db-4bda-951e-17c816ac23b8', 'd3e096c7-ddb0-4b6f-9f09-74522b2d664b', 'a94e6561-a01b-411a-87a5-b5a5148bc97f'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:20:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-301e033a-291e-471e-b883-c105f232158f tempest-SnapshotMetadataTestJSON-1208892347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:20:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-301e033a-291e-471e-b883-c105f232158f tempest-SnapshotMetadataTestJSON-1208892347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:20:59 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-301e033a-291e-471e-b883-c105f232158f tempest-SnapshotMetadataTestJSON-1208892347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:20:59 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-301e033a-291e-471e-b883-c105f232158f tempest-SnapshotMetadataTestJSON-1208892347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:20:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-301e033a-291e-471e-b883-c105f232158f tempest-SnapshotMetadataTestJSON-1208892347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:20:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-301e033a-291e-471e-b883-c105f232158f tempest-SnapshotMetadataTestJSON-1208892347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:20:59 devstack sudo[101167]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:20:59 devstack sudo[101167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:20:59 devstack sudo[101167]: pam_unix(sudo:session): session closed for user root
Nov 04 12:20:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-301e033a-291e-471e-b883-c105f232158f tempest-SnapshotMetadataTestJSON-1208892347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.267s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:20:59 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-301e033a-291e-471e-b883-c105f232158f tempest-SnapshotMetadataTestJSON-1208892347 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:20:59 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-301e033a-291e-471e-b883-c105f232158f tempest-SnapshotMetadataTestJSON-1208892347 None] Deleted volume successfully.
Nov 04 12:20:59 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-301e033a-291e-471e-b883-c105f232158f tempest-SnapshotMetadataTestJSON-1208892347 None] Lock "cinder-978a2e0b-1f93-44aa-9374-c3e63577f751-delete_volume" released by "delete_volume" :: held 1.166s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:21:00 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-673a9d76-0cf0-4466-aa9e-d3dc567cc0a2 tempest-VolumesListTestJSON-895243107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:21:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-673a9d76-0cf0-4466-aa9e-d3dc567cc0a2 tempest-VolumesListTestJSON-895243107 None] Flow 'volume_create_manager' (367d2f6b-5dcb-49f0-865a-1e4aa3ebb94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:21:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-673a9d76-0cf0-4466-aa9e-d3dc567cc0a2 tempest-VolumesListTestJSON-895243107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12cb25da-a347-4513-a4b0-640963bb052d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:21:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-673a9d76-0cf0-4466-aa9e-d3dc567cc0a2 tempest-VolumesListTestJSON-895243107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12cb25da-a347-4513-a4b0-640963bb052d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1326723882',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c00e2cd3-d0c9-434e-a534-9608d1f0cca2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='36509d8b893e410ca273f6f7feca3e6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:21:00Z,use_quota=True,user_id='1c6c0e5a507b4d5a8e0851bbc0bd7acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:21:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-673a9d76-0cf0-4466-aa9e-d3dc567cc0a2 tempest-VolumesListTestJSON-895243107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0292120-7279-4d0b-ba74-7dec02fd105a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:21:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-673a9d76-0cf0-4466-aa9e-d3dc567cc0a2 tempest-VolumesListTestJSON-895243107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0292120-7279-4d0b-ba74-7dec02fd105a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:21:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-673a9d76-0cf0-4466-aa9e-d3dc567cc0a2 tempest-VolumesListTestJSON-895243107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ea695d5-dcca-447d-82bc-69d0a49b31b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:21:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-673a9d76-0cf0-4466-aa9e-d3dc567cc0a2 tempest-VolumesListTestJSON-895243107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ea695d5-dcca-447d-82bc-69d0a49b31b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c00e2cd3-d0c9-434e-a534-9608d1f0cca2', 'volume_name': 'volume-c00e2cd3-d0c9-434e-a534-9608d1f0cca2', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:21:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-673a9d76-0cf0-4466-aa9e-d3dc567cc0a2 tempest-VolumesListTestJSON-895243107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85b47ed7-f3ab-4cbe-a57c-33bc7daa4f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:21:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-673a9d76-0cf0-4466-aa9e-d3dc567cc0a2 tempest-VolumesListTestJSON-895243107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85b47ed7-f3ab-4cbe-a57c-33bc7daa4f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:21:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-673a9d76-0cf0-4466-aa9e-d3dc567cc0a2 tempest-VolumesListTestJSON-895243107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2197d846-c6b0-48e5-8e2d-34bedacfccf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:21:00 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-673a9d76-0cf0-4466-aa9e-d3dc567cc0a2 tempest-VolumesListTestJSON-895243107 None] Volume c00e2cd3-d0c9-434e-a534-9608d1f0cca2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c00e2cd3-d0c9-434e-a534-9608d1f0cca2', 'volume_size': 1}
Nov 04 12:21:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-673a9d76-0cf0-4466-aa9e-d3dc567cc0a2 tempest-VolumesListTestJSON-895243107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:21:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-673a9d76-0cf0-4466-aa9e-d3dc567cc0a2 tempest-VolumesListTestJSON-895243107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:21:00 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-673a9d76-0cf0-4466-aa9e-d3dc567cc0a2 tempest-VolumesListTestJSON-895243107 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:21:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1326723882',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c00e2cd3-d0c9-434e-a534-9608d1f0cca2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='36509d8b893e410ca273f6f7feca3e6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:21:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:21:00Z,use_quota=True,user_id='1c6c0e5a507b4d5a8e0851bbc0bd7acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:21:00 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-673a9d76-0cf0-4466-aa9e-d3dc567cc0a2 tempest-VolumesListTestJSON-895243107 None] Creating volume c00e2cd3-d0c9-434e-a534-9608d1f0cca2 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:21:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-673a9d76-0cf0-4466-aa9e-d3dc567cc0a2 tempest-VolumesListTestJSON-895243107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:21:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-673a9d76-0cf0-4466-aa9e-d3dc567cc0a2 tempest-VolumesListTestJSON-895243107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:21:00 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-673a9d76-0cf0-4466-aa9e-d3dc567cc0a2 tempest-VolumesListTestJSON-895243107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:21:00 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-673a9d76-0cf0-4466-aa9e-d3dc567cc0a2 tempest-VolumesListTestJSON-895243107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:21:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-673a9d76-0cf0-4466-aa9e-d3dc567cc0a2 tempest-VolumesListTestJSON-895243107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:21:00 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-673a9d76-0cf0-4466-aa9e-d3dc567cc0a2 tempest-VolumesListTestJSON-895243107 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:21:00 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-673a9d76-0cf0-4466-aa9e-d3dc567cc0a2 tempest-VolumesListTestJSON-895243107 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:21:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-673a9d76-0cf0-4466-aa9e-d3dc567cc0a2 tempest-VolumesListTestJSON-895243107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c00e2cd3-d0c9-434e-a534-9608d1f0cca2 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:00 devstack sudo[101170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c00e2cd3-d0c9-434e-a534-9608d1f0cca2 1073741824
Nov 04 12:21:00 devstack sudo[101170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:01 devstack sudo[101170]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-673a9d76-0cf0-4466-aa9e-d3dc567cc0a2 tempest-VolumesListTestJSON-895243107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c00e2cd3-d0c9-434e-a534-9608d1f0cca2 1073741824" returned: 0 in 0.558s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-673a9d76-0cf0-4466-aa9e-d3dc567cc0a2 tempest-VolumesListTestJSON-895243107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c00e2cd3-d0c9-434e-a534-9608d1f0cca2 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:01 devstack sudo[101176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c00e2cd3-d0c9-434e-a534-9608d1f0cca2
Nov 04 12:21:01 devstack sudo[101176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:01 devstack sudo[101176]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-673a9d76-0cf0-4466-aa9e-d3dc567cc0a2 tempest-VolumesListTestJSON-895243107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c00e2cd3-d0c9-434e-a534-9608d1f0cca2" returned: 0 in 0.287s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:01 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-673a9d76-0cf0-4466-aa9e-d3dc567cc0a2 tempest-VolumesListTestJSON-895243107 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:21:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-673a9d76-0cf0-4466-aa9e-d3dc567cc0a2 tempest-VolumesListTestJSON-895243107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:21:01 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-673a9d76-0cf0-4466-aa9e-d3dc567cc0a2 tempest-VolumesListTestJSON-895243107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2197d846-c6b0-48e5-8e2d-34bedacfccf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c00e2cd3-d0c9-434e-a534-9608d1f0cca2', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:21:01 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-673a9d76-0cf0-4466-aa9e-d3dc567cc0a2 tempest-VolumesListTestJSON-895243107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6535ec5-74f3-40fb-b76d-756b6e817828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:21:01 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-673a9d76-0cf0-4466-aa9e-d3dc567cc0a2 tempest-VolumesListTestJSON-895243107 None] Volume volume-c00e2cd3-d0c9-434e-a534-9608d1f0cca2 (c00e2cd3-d0c9-434e-a534-9608d1f0cca2): created successfully
Nov 04 12:21:01 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-673a9d76-0cf0-4466-aa9e-d3dc567cc0a2 tempest-VolumesListTestJSON-895243107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6535ec5-74f3-40fb-b76d-756b6e817828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:21:01 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-673a9d76-0cf0-4466-aa9e-d3dc567cc0a2 tempest-VolumesListTestJSON-895243107 None] Flow 'volume_create_manager' (367d2f6b-5dcb-49f0-865a-1e4aa3ebb94a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:21:01 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-673a9d76-0cf0-4466-aa9e-d3dc567cc0a2 tempest-VolumesListTestJSON-895243107 None] Created volume successfully.
Nov 04 12:21:03 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-606bb7b0-ae1b-4d13-997a-c5d8653c7dfe tempest-VolumesListTestJSON-895243107 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:21:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-606bb7b0-ae1b-4d13-997a-c5d8653c7dfe tempest-VolumesListTestJSON-895243107 None] Flow 'volume_create_manager' (120faf55-bbea-45e4-8b7f-66d16e1e7753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:21:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-606bb7b0-ae1b-4d13-997a-c5d8653c7dfe tempest-VolumesListTestJSON-895243107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdeb1bfa-dd79-4809-a20b-561c65049f2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:21:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-606bb7b0-ae1b-4d13-997a-c5d8653c7dfe tempest-VolumesListTestJSON-895243107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdeb1bfa-dd79-4809-a20b-561c65049f2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1869362815',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cbddd4e-78e9-4e70-8837-e99235b3cc0f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='36509d8b893e410ca273f6f7feca3e6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:21:03Z,use_quota=True,user_id='1c6c0e5a507b4d5a8e0851bbc0bd7acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:21:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-606bb7b0-ae1b-4d13-997a-c5d8653c7dfe tempest-VolumesListTestJSON-895243107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3243d31a-bfd7-4f8c-8f22-7d0b417c6759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:21:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-606bb7b0-ae1b-4d13-997a-c5d8653c7dfe tempest-VolumesListTestJSON-895243107 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3243d31a-bfd7-4f8c-8f22-7d0b417c6759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:21:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-606bb7b0-ae1b-4d13-997a-c5d8653c7dfe tempest-VolumesListTestJSON-895243107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c43779b5-1339-4d97-9db3-0d79335da735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:21:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-606bb7b0-ae1b-4d13-997a-c5d8653c7dfe tempest-VolumesListTestJSON-895243107 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c43779b5-1339-4d97-9db3-0d79335da735) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cbddd4e-78e9-4e70-8837-e99235b3cc0f', 'volume_name': 'volume-8cbddd4e-78e9-4e70-8837-e99235b3cc0f', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:21:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-606bb7b0-ae1b-4d13-997a-c5d8653c7dfe tempest-VolumesListTestJSON-895243107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7e53b81-ad92-4e19-879c-6a691ab0c125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:21:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-606bb7b0-ae1b-4d13-997a-c5d8653c7dfe tempest-VolumesListTestJSON-895243107 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7e53b81-ad92-4e19-879c-6a691ab0c125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:21:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-606bb7b0-ae1b-4d13-997a-c5d8653c7dfe tempest-VolumesListTestJSON-895243107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2331d334-34c1-4cf9-9dba-2ede1dbf98e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:21:03 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-606bb7b0-ae1b-4d13-997a-c5d8653c7dfe tempest-VolumesListTestJSON-895243107 None] Volume 8cbddd4e-78e9-4e70-8837-e99235b3cc0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cbddd4e-78e9-4e70-8837-e99235b3cc0f', 'volume_size': 1}
Nov 04 12:21:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-606bb7b0-ae1b-4d13-997a-c5d8653c7dfe tempest-VolumesListTestJSON-895243107 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:21:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-606bb7b0-ae1b-4d13-997a-c5d8653c7dfe tempest-VolumesListTestJSON-895243107 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:21:03 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-606bb7b0-ae1b-4d13-997a-c5d8653c7dfe tempest-VolumesListTestJSON-895243107 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:21:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1869362815',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cbddd4e-78e9-4e70-8837-e99235b3cc0f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='36509d8b893e410ca273f6f7feca3e6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:21:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:21:03Z,use_quota=True,user_id='1c6c0e5a507b4d5a8e0851bbc0bd7acc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:21:03 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-606bb7b0-ae1b-4d13-997a-c5d8653c7dfe tempest-VolumesListTestJSON-895243107 None] Creating volume 8cbddd4e-78e9-4e70-8837-e99235b3cc0f {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:21:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-606bb7b0-ae1b-4d13-997a-c5d8653c7dfe tempest-VolumesListTestJSON-895243107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:21:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-606bb7b0-ae1b-4d13-997a-c5d8653c7dfe tempest-VolumesListTestJSON-895243107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:21:03 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-606bb7b0-ae1b-4d13-997a-c5d8653c7dfe tempest-VolumesListTestJSON-895243107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:21:03 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-606bb7b0-ae1b-4d13-997a-c5d8653c7dfe tempest-VolumesListTestJSON-895243107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:21:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-606bb7b0-ae1b-4d13-997a-c5d8653c7dfe tempest-VolumesListTestJSON-895243107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:21:03 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-606bb7b0-ae1b-4d13-997a-c5d8653c7dfe tempest-VolumesListTestJSON-895243107 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:21:03 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-606bb7b0-ae1b-4d13-997a-c5d8653c7dfe tempest-VolumesListTestJSON-895243107 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:21:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-606bb7b0-ae1b-4d13-997a-c5d8653c7dfe tempest-VolumesListTestJSON-895243107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8cbddd4e-78e9-4e70-8837-e99235b3cc0f 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:03 devstack sudo[101183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8cbddd4e-78e9-4e70-8837-e99235b3cc0f 1073741824
Nov 04 12:21:03 devstack sudo[101183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:03 devstack sudo[101183]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-606bb7b0-ae1b-4d13-997a-c5d8653c7dfe tempest-VolumesListTestJSON-895243107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8cbddd4e-78e9-4e70-8837-e99235b3cc0f 1073741824" returned: 0 in 0.523s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-606bb7b0-ae1b-4d13-997a-c5d8653c7dfe tempest-VolumesListTestJSON-895243107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8cbddd4e-78e9-4e70-8837-e99235b3cc0f {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:03 devstack sudo[101189]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8cbddd4e-78e9-4e70-8837-e99235b3cc0f
Nov 04 12:21:04 devstack sudo[101189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:04 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-18e61ae1-c5b2-4869-a0ba-ed034c0bcd7a tempest-VolumesDeleteCascade-98630795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:21:04 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-18e61ae1-c5b2-4869-a0ba-ed034c0bcd7a tempest-VolumesDeleteCascade-98630795 None] Flow 'volume_create_manager' (be6774d3-1d16-4fe8-945e-bc58f44d57d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:21:04 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-18e61ae1-c5b2-4869-a0ba-ed034c0bcd7a tempest-VolumesDeleteCascade-98630795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (952838db-0878-4dc5-8ec0-1a592c4c8078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:21:04 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-18e61ae1-c5b2-4869-a0ba-ed034c0bcd7a tempest-VolumesDeleteCascade-98630795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (952838db-0878-4dc5-8ec0-1a592c4c8078) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:21:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-367380348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e137263-352d-41b1-b52b-cffd9522f278,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ec395c98a404b4bb83d68f076485c99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:21:04Z,use_quota=True,user_id='39960588417141f3b77e2bc490b23176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:21:04 devstack sudo[101189]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:04 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-18e61ae1-c5b2-4869-a0ba-ed034c0bcd7a tempest-VolumesDeleteCascade-98630795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (821ff05f-758c-40d0-9365-298d9c097cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:21:04 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-18e61ae1-c5b2-4869-a0ba-ed034c0bcd7a tempest-VolumesDeleteCascade-98630795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (821ff05f-758c-40d0-9365-298d9c097cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:21:04 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-18e61ae1-c5b2-4869-a0ba-ed034c0bcd7a tempest-VolumesDeleteCascade-98630795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d14987ef-a02e-4e32-aa0c-adf4ab2d71aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:21:04 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-18e61ae1-c5b2-4869-a0ba-ed034c0bcd7a tempest-VolumesDeleteCascade-98630795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d14987ef-a02e-4e32-aa0c-adf4ab2d71aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e137263-352d-41b1-b52b-cffd9522f278', 'volume_name': 'volume-5e137263-352d-41b1-b52b-cffd9522f278', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:21:04 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-18e61ae1-c5b2-4869-a0ba-ed034c0bcd7a tempest-VolumesDeleteCascade-98630795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6c07a9e-935b-4471-bbb0-a44dfb95d691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:21:04 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-18e61ae1-c5b2-4869-a0ba-ed034c0bcd7a tempest-VolumesDeleteCascade-98630795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6c07a9e-935b-4471-bbb0-a44dfb95d691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:21:04 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-18e61ae1-c5b2-4869-a0ba-ed034c0bcd7a tempest-VolumesDeleteCascade-98630795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5901089a-c652-45f0-9aa4-54208d27626a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:21:04 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-18e61ae1-c5b2-4869-a0ba-ed034c0bcd7a tempest-VolumesDeleteCascade-98630795 None] Volume 5e137263-352d-41b1-b52b-cffd9522f278: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e137263-352d-41b1-b52b-cffd9522f278', 'volume_size': 1}
Nov 04 12:21:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-18e61ae1-c5b2-4869-a0ba-ed034c0bcd7a tempest-VolumesDeleteCascade-98630795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:21:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-606bb7b0-ae1b-4d13-997a-c5d8653c7dfe tempest-VolumesListTestJSON-895243107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8cbddd4e-78e9-4e70-8837-e99235b3cc0f" returned: 0 in 0.366s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:04 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-606bb7b0-ae1b-4d13-997a-c5d8653c7dfe tempest-VolumesListTestJSON-895243107 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:21:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-606bb7b0-ae1b-4d13-997a-c5d8653c7dfe tempest-VolumesListTestJSON-895243107 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:21:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-18e61ae1-c5b2-4869-a0ba-ed034c0bcd7a tempest-VolumesDeleteCascade-98630795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:21:04 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-18e61ae1-c5b2-4869-a0ba-ed034c0bcd7a tempest-VolumesDeleteCascade-98630795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:21:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-367380348',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e137263-352d-41b1-b52b-cffd9522f278,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ec395c98a404b4bb83d68f076485c99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:21:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:21:04Z,use_quota=True,user_id='39960588417141f3b77e2bc490b23176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:21:04 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-18e61ae1-c5b2-4869-a0ba-ed034c0bcd7a tempest-VolumesDeleteCascade-98630795 None] Creating volume 5e137263-352d-41b1-b52b-cffd9522f278 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:21:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-18e61ae1-c5b2-4869-a0ba-ed034c0bcd7a tempest-VolumesDeleteCascade-98630795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:21:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-18e61ae1-c5b2-4869-a0ba-ed034c0bcd7a tempest-VolumesDeleteCascade-98630795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:21:04 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-18e61ae1-c5b2-4869-a0ba-ed034c0bcd7a tempest-VolumesDeleteCascade-98630795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:21:04 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-18e61ae1-c5b2-4869-a0ba-ed034c0bcd7a tempest-VolumesDeleteCascade-98630795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:21:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-18e61ae1-c5b2-4869-a0ba-ed034c0bcd7a tempest-VolumesDeleteCascade-98630795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:21:04 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-18e61ae1-c5b2-4869-a0ba-ed034c0bcd7a tempest-VolumesDeleteCascade-98630795 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:21:04 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-18e61ae1-c5b2-4869-a0ba-ed034c0bcd7a tempest-VolumesDeleteCascade-98630795 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:21:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-18e61ae1-c5b2-4869-a0ba-ed034c0bcd7a tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:04 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-606bb7b0-ae1b-4d13-997a-c5d8653c7dfe tempest-VolumesListTestJSON-895243107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2331d334-34c1-4cf9-9dba-2ede1dbf98e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cbddd4e-78e9-4e70-8837-e99235b3cc0f', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:21:04 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-606bb7b0-ae1b-4d13-997a-c5d8653c7dfe tempest-VolumesListTestJSON-895243107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cec086b-e582-4f2e-8c09-936d609dd76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:21:04 devstack sudo[101192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278 1073741824
Nov 04 12:21:04 devstack sudo[101192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:04 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-606bb7b0-ae1b-4d13-997a-c5d8653c7dfe tempest-VolumesListTestJSON-895243107 None] Volume volume-8cbddd4e-78e9-4e70-8837-e99235b3cc0f (8cbddd4e-78e9-4e70-8837-e99235b3cc0f): created successfully
Nov 04 12:21:04 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-606bb7b0-ae1b-4d13-997a-c5d8653c7dfe tempest-VolumesListTestJSON-895243107 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cec086b-e582-4f2e-8c09-936d609dd76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:21:04 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-606bb7b0-ae1b-4d13-997a-c5d8653c7dfe tempest-VolumesListTestJSON-895243107 None] Flow 'volume_create_manager' (120faf55-bbea-45e4-8b7f-66d16e1e7753) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:21:04 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-606bb7b0-ae1b-4d13-997a-c5d8653c7dfe tempest-VolumesListTestJSON-895243107 None] Created volume successfully.
Nov 04 12:21:04 devstack sudo[101192]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-18e61ae1-c5b2-4869-a0ba-ed034c0bcd7a tempest-VolumesDeleteCascade-98630795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278 1073741824" returned: 0 in 0.458s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-18e61ae1-c5b2-4869-a0ba-ed034c0bcd7a tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:04 devstack sudo[101197]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278
Nov 04 12:21:04 devstack sudo[101197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:05 devstack sudo[101197]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-18e61ae1-c5b2-4869-a0ba-ed034c0bcd7a tempest-VolumesDeleteCascade-98630795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278" returned: 0 in 0.250s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:05 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-18e61ae1-c5b2-4869-a0ba-ed034c0bcd7a tempest-VolumesDeleteCascade-98630795 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:21:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-18e61ae1-c5b2-4869-a0ba-ed034c0bcd7a tempest-VolumesDeleteCascade-98630795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:21:05 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-18e61ae1-c5b2-4869-a0ba-ed034c0bcd7a tempest-VolumesDeleteCascade-98630795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5901089a-c652-45f0-9aa4-54208d27626a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e137263-352d-41b1-b52b-cffd9522f278', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:21:05 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-18e61ae1-c5b2-4869-a0ba-ed034c0bcd7a tempest-VolumesDeleteCascade-98630795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffec62d0-cd41-45aa-bbe5-157219fadb6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:21:05 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-18e61ae1-c5b2-4869-a0ba-ed034c0bcd7a tempest-VolumesDeleteCascade-98630795 None] Volume volume-5e137263-352d-41b1-b52b-cffd9522f278 (5e137263-352d-41b1-b52b-cffd9522f278): created successfully
Nov 04 12:21:05 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-18e61ae1-c5b2-4869-a0ba-ed034c0bcd7a tempest-VolumesDeleteCascade-98630795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffec62d0-cd41-45aa-bbe5-157219fadb6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:21:05 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-18e61ae1-c5b2-4869-a0ba-ed034c0bcd7a tempest-VolumesDeleteCascade-98630795 None] Flow 'volume_create_manager' (be6774d3-1d16-4fe8-945e-bc58f44d57d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:21:05 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-18e61ae1-c5b2-4869-a0ba-ed034c0bcd7a tempest-VolumesDeleteCascade-98630795 None] Created volume successfully.
Nov 04 12:21:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-cbc9cf0e-c93e-40a7-8942-5ae0676ef77c tempest-VolumesDeleteCascade-98630795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:21:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-cbc9cf0e-c93e-40a7-8942-5ae0676ef77c tempest-VolumesDeleteCascade-98630795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:21:05 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-cbc9cf0e-c93e-40a7-8942-5ae0676ef77c tempest-VolumesDeleteCascade-98630795 None] Creating offline snapshot 0600beef-dd23-4e91-a13a-1f5b4477ad2f of volume 5e137263-352d-41b1-b52b-cffd9522f278 {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:21:05 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cbe68df-44c0-4dd8-97ab-6d29c6db3e46]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:21:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-cbc9cf0e-c93e-40a7-8942-5ae0676ef77c tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:05 devstack sudo[101200]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278
Nov 04 12:21:05 devstack sudo[101200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:05 devstack sudo[101200]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-cbc9cf0e-c93e-40a7-8942-5ae0676ef77c tempest-VolumesDeleteCascade-98630795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278" returned: 0 in 0.462s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-cbc9cf0e-c93e-40a7-8942-5ae0676ef77c tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.0600beef-dd23-4e91-a13a-1f5b4477ad2f 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:06 devstack sudo[101209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.0600beef-dd23-4e91-a13a-1f5b4477ad2f 1G
Nov 04 12:21:06 devstack sudo[101209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:06 devstack sudo[101209]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-cbc9cf0e-c93e-40a7-8942-5ae0676ef77c tempest-VolumesDeleteCascade-98630795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.0600beef-dd23-4e91-a13a-1f5b4477ad2f 1G" returned: 0 in 0.605s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-cbc9cf0e-c93e-40a7-8942-5ae0676ef77c tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e137263-352d-41b1-b52b-cffd9522f278 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.0600beef-dd23-4e91-a13a-1f5b4477ad2f {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:06 devstack sudo[101217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e137263-352d-41b1-b52b-cffd9522f278 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.0600beef-dd23-4e91-a13a-1f5b4477ad2f
Nov 04 12:21:06 devstack sudo[101217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:06 devstack sudo[101217]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-cbc9cf0e-c93e-40a7-8942-5ae0676ef77c tempest-VolumesDeleteCascade-98630795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e137263-352d-41b1-b52b-cffd9522f278 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.0600beef-dd23-4e91-a13a-1f5b4477ad2f" returned: 0 in 0.341s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:06 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-cbc9cf0e-c93e-40a7-8942-5ae0676ef77c tempest-VolumesDeleteCascade-98630795 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.0600beef-dd23-4e91-a13a-1f5b4477ad2f is being set with open permissions: ugo+rw
Nov 04 12:21:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-cbc9cf0e-c93e-40a7-8942-5ae0676ef77c tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.0600beef-dd23-4e91-a13a-1f5b4477ad2f {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:06 devstack sudo[101222]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.0600beef-dd23-4e91-a13a-1f5b4477ad2f
Nov 04 12:21:06 devstack sudo[101222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:07 devstack sudo[101222]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-cbc9cf0e-c93e-40a7-8942-5ae0676ef77c tempest-VolumesDeleteCascade-98630795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.0600beef-dd23-4e91-a13a-1f5b4477ad2f" returned: 0 in 0.270s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:07 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:INSERT=48,cinder:UPDATE=151,cinder:SELECT=118,cinder:DELETE=15 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:21:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-cbc9cf0e-c93e-40a7-8942-5ae0676ef77c tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:07 devstack sudo[101235]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.info
Nov 04 12:21:07 devstack sudo[101235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:07 devstack sudo[101235]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-cbc9cf0e-c93e-40a7-8942-5ae0676ef77c tempest-VolumesDeleteCascade-98630795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.info" returned: 0 in 0.318s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:07 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-cbc9cf0e-c93e-40a7-8942-5ae0676ef77c tempest-VolumesDeleteCascade-98630795 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.info is being set with open permissions: ugo+rw
Nov 04 12:21:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-cbc9cf0e-c93e-40a7-8942-5ae0676ef77c tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:07 devstack sudo[101238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.info
Nov 04 12:21:07 devstack sudo[101238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:07 devstack sudo[101238]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-cbc9cf0e-c93e-40a7-8942-5ae0676ef77c tempest-VolumesDeleteCascade-98630795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.info" returned: 0 in 0.282s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-cbc9cf0e-c93e-40a7-8942-5ae0676ef77c tempest-VolumesDeleteCascade-98630795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.403s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:21:07 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-cbc9cf0e-c93e-40a7-8942-5ae0676ef77c tempest-VolumesDeleteCascade-98630795 None] Create snapshot completed successfully
Nov 04 12:21:08 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e323ff0a-07e6-4f88-a836-e8c969fd7636 tempest-VolumesListTestJSON-895243107 None] Acquiring lock "cinder-8cbddd4e-78e9-4e70-8837-e99235b3cc0f-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:21:08 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e323ff0a-07e6-4f88-a836-e8c969fd7636 tempest-VolumesListTestJSON-895243107 None] Lock "cinder-8cbddd4e-78e9-4e70-8837-e99235b3cc0f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:21:08 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e323ff0a-07e6-4f88-a836-e8c969fd7636 tempest-VolumesListTestJSON-895243107 None] Acquiring lock "cinder-quobyte-8cbddd4e-78e9-4e70-8837-e99235b3cc0f" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:21:08 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e323ff0a-07e6-4f88-a836-e8c969fd7636 tempest-VolumesListTestJSON-895243107 None] Lock "cinder-quobyte-8cbddd4e-78e9-4e70-8837-e99235b3cc0f" acquired by "delete_volume" :: waited 0.015s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:21:08 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dd73287-d95d-4eda-95dc-5f16b652d0d0]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:21:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e323ff0a-07e6-4f88-a836-e8c969fd7636 tempest-VolumesListTestJSON-895243107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8cbddd4e-78e9-4e70-8837-e99235b3cc0f {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:08 devstack sudo[101265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8cbddd4e-78e9-4e70-8837-e99235b3cc0f
Nov 04 12:21:08 devstack sudo[101265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:08 devstack sudo[101265]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e323ff0a-07e6-4f88-a836-e8c969fd7636 tempest-VolumesListTestJSON-895243107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8cbddd4e-78e9-4e70-8837-e99235b3cc0f" returned: 0 in 0.401s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e323ff0a-07e6-4f88-a836-e8c969fd7636 tempest-VolumesListTestJSON-895243107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8cbddd4e-78e9-4e70-8837-e99235b3cc0f {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:08 devstack sudo[101270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8cbddd4e-78e9-4e70-8837-e99235b3cc0f
Nov 04 12:21:08 devstack sudo[101270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b2f117ca-0188-4ae2-82d7-16418868d54a tempest-VolumesDeleteCascade-98630795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:21:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b2f117ca-0188-4ae2-82d7-16418868d54a tempest-VolumesDeleteCascade-98630795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:21:08 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-b2f117ca-0188-4ae2-82d7-16418868d54a tempest-VolumesDeleteCascade-98630795 None] Creating offline snapshot 97010e1f-7590-49fb-8e21-814d0b7e7c04 of volume 5e137263-352d-41b1-b52b-cffd9522f278 {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:21:08 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96909b7-d2c1-4fb7-9117-25f8de1aea8a]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:21:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b2f117ca-0188-4ae2-82d7-16418868d54a tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.0600beef-dd23-4e91-a13a-1f5b4477ad2f {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:08 devstack sudo[101270]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e323ff0a-07e6-4f88-a836-e8c969fd7636 tempest-VolumesListTestJSON-895243107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8cbddd4e-78e9-4e70-8837-e99235b3cc0f" returned: 0 in 0.268s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:08 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e323ff0a-07e6-4f88-a836-e8c969fd7636 tempest-VolumesListTestJSON-895243107 None] Lock "cinder-quobyte-8cbddd4e-78e9-4e70-8837-e99235b3cc0f" released by "delete_volume" :: held 0.718s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:21:08 devstack sudo[101272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.0600beef-dd23-4e91-a13a-1f5b4477ad2f
Nov 04 12:21:08 devstack sudo[101272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:09 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-e323ff0a-07e6-4f88-a836-e8c969fd7636 tempest-VolumesListTestJSON-895243107 None] Created reservations ['eff8e101-8d41-4c72-b9f0-ce3b6bf9bf28', 'a5e7b2cf-c907-40ae-8b50-aea7efb335cc', '4132af7a-1771-4292-9471-824159c03f2f', '1874390c-6b53-4dc7-895b-971d38078541'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:21:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e323ff0a-07e6-4f88-a836-e8c969fd7636 tempest-VolumesListTestJSON-895243107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:21:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e323ff0a-07e6-4f88-a836-e8c969fd7636 tempest-VolumesListTestJSON-895243107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:21:09 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e323ff0a-07e6-4f88-a836-e8c969fd7636 tempest-VolumesListTestJSON-895243107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:21:09 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e323ff0a-07e6-4f88-a836-e8c969fd7636 tempest-VolumesListTestJSON-895243107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:21:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e323ff0a-07e6-4f88-a836-e8c969fd7636 tempest-VolumesListTestJSON-895243107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:21:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e323ff0a-07e6-4f88-a836-e8c969fd7636 tempest-VolumesListTestJSON-895243107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:09 devstack sudo[101275]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:21:09 devstack sudo[101275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:09 devstack sudo[101272]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b2f117ca-0188-4ae2-82d7-16418868d54a tempest-VolumesDeleteCascade-98630795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.0600beef-dd23-4e91-a13a-1f5b4477ad2f" returned: 0 in 0.374s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:09 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-b2f117ca-0188-4ae2-82d7-16418868d54a tempest-VolumesDeleteCascade-98630795 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e137263-352d-41b1-b52b-cffd9522f278(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:21:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b2f117ca-0188-4ae2-82d7-16418868d54a tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.0600beef-dd23-4e91-a13a-1f5b4477ad2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.97010e1f-7590-49fb-8e21-814d0b7e7c04 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:09 devstack sudo[101280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.0600beef-dd23-4e91-a13a-1f5b4477ad2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.97010e1f-7590-49fb-8e21-814d0b7e7c04 1G
Nov 04 12:21:09 devstack sudo[101280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:09 devstack sudo[101275]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e323ff0a-07e6-4f88-a836-e8c969fd7636 tempest-VolumesListTestJSON-895243107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.249s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:09 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-e323ff0a-07e6-4f88-a836-e8c969fd7636 tempest-VolumesListTestJSON-895243107 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:21:09 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-e323ff0a-07e6-4f88-a836-e8c969fd7636 tempest-VolumesListTestJSON-895243107 None] Deleted volume successfully.
Nov 04 12:21:09 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e323ff0a-07e6-4f88-a836-e8c969fd7636 tempest-VolumesListTestJSON-895243107 None] Lock "cinder-8cbddd4e-78e9-4e70-8837-e99235b3cc0f-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:21:09 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c6bad762-debc-48ee-ba0d-227b0544d525 tempest-VolumesListTestJSON-895243107 None] Acquiring lock "cinder-c00e2cd3-d0c9-434e-a534-9608d1f0cca2-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:21:09 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c6bad762-debc-48ee-ba0d-227b0544d525 tempest-VolumesListTestJSON-895243107 None] Lock "cinder-c00e2cd3-d0c9-434e-a534-9608d1f0cca2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:21:09 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c6bad762-debc-48ee-ba0d-227b0544d525 tempest-VolumesListTestJSON-895243107 None] Acquiring lock "cinder-quobyte-c00e2cd3-d0c9-434e-a534-9608d1f0cca2" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:21:09 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c6bad762-debc-48ee-ba0d-227b0544d525 tempest-VolumesListTestJSON-895243107 None] Lock "cinder-quobyte-c00e2cd3-d0c9-434e-a534-9608d1f0cca2" acquired by "delete_volume" :: waited 0.014s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:21:09 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a45291b-a4e2-46cb-ab71-31025978a90b]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:21:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c6bad762-debc-48ee-ba0d-227b0544d525 tempest-VolumesListTestJSON-895243107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c00e2cd3-d0c9-434e-a534-9608d1f0cca2 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:09 devstack sudo[101285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c00e2cd3-d0c9-434e-a534-9608d1f0cca2
Nov 04 12:21:09 devstack sudo[101285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:09 devstack sudo[101280]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b2f117ca-0188-4ae2-82d7-16418868d54a tempest-VolumesDeleteCascade-98630795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.0600beef-dd23-4e91-a13a-1f5b4477ad2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.97010e1f-7590-49fb-8e21-814d0b7e7c04 1G" returned: 0 in 0.500s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b2f117ca-0188-4ae2-82d7-16418868d54a tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e137263-352d-41b1-b52b-cffd9522f278.0600beef-dd23-4e91-a13a-1f5b4477ad2f -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.97010e1f-7590-49fb-8e21-814d0b7e7c04 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:09 devstack sudo[101289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e137263-352d-41b1-b52b-cffd9522f278.0600beef-dd23-4e91-a13a-1f5b4477ad2f -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.97010e1f-7590-49fb-8e21-814d0b7e7c04
Nov 04 12:21:09 devstack sudo[101289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:09 devstack sudo[101285]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c6bad762-debc-48ee-ba0d-227b0544d525 tempest-VolumesListTestJSON-895243107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c00e2cd3-d0c9-434e-a534-9608d1f0cca2" returned: 0 in 0.391s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c6bad762-debc-48ee-ba0d-227b0544d525 tempest-VolumesListTestJSON-895243107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c00e2cd3-d0c9-434e-a534-9608d1f0cca2 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:09 devstack sudo[101294]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c00e2cd3-d0c9-434e-a534-9608d1f0cca2
Nov 04 12:21:09 devstack sudo[101294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:10 devstack sudo[101289]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b2f117ca-0188-4ae2-82d7-16418868d54a tempest-VolumesDeleteCascade-98630795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e137263-352d-41b1-b52b-cffd9522f278.0600beef-dd23-4e91-a13a-1f5b4477ad2f -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.97010e1f-7590-49fb-8e21-814d0b7e7c04" returned: 0 in 0.315s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:10 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-b2f117ca-0188-4ae2-82d7-16418868d54a tempest-VolumesDeleteCascade-98630795 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.97010e1f-7590-49fb-8e21-814d0b7e7c04 is being set with open permissions: ugo+rw
Nov 04 12:21:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b2f117ca-0188-4ae2-82d7-16418868d54a tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.97010e1f-7590-49fb-8e21-814d0b7e7c04 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:10 devstack sudo[101299]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.97010e1f-7590-49fb-8e21-814d0b7e7c04
Nov 04 12:21:10 devstack sudo[101299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:10 devstack sudo[101294]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c6bad762-debc-48ee-ba0d-227b0544d525 tempest-VolumesListTestJSON-895243107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c00e2cd3-d0c9-434e-a534-9608d1f0cca2" returned: 0 in 0.254s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:10 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c6bad762-debc-48ee-ba0d-227b0544d525 tempest-VolumesListTestJSON-895243107 None] Lock "cinder-quobyte-c00e2cd3-d0c9-434e-a534-9608d1f0cca2" released by "delete_volume" :: held 0.697s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:21:10 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-c6bad762-debc-48ee-ba0d-227b0544d525 tempest-VolumesListTestJSON-895243107 None] Created reservations ['69d69d59-682a-4d00-ace3-41ec0bb1dd11', 'bf7e0c5b-44dd-4d67-851a-0d235b864863', 'fe19f2e2-2994-44c5-a037-106b03807b3f', '554d5fae-fcc1-4fe9-83a8-9e2cbd413fe7'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:21:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c6bad762-debc-48ee-ba0d-227b0544d525 tempest-VolumesListTestJSON-895243107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:21:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c6bad762-debc-48ee-ba0d-227b0544d525 tempest-VolumesListTestJSON-895243107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:21:10 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c6bad762-debc-48ee-ba0d-227b0544d525 tempest-VolumesListTestJSON-895243107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:21:10 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c6bad762-debc-48ee-ba0d-227b0544d525 tempest-VolumesListTestJSON-895243107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:21:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c6bad762-debc-48ee-ba0d-227b0544d525 tempest-VolumesListTestJSON-895243107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:21:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c6bad762-debc-48ee-ba0d-227b0544d525 tempest-VolumesListTestJSON-895243107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:10 devstack sudo[101299]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b2f117ca-0188-4ae2-82d7-16418868d54a tempest-VolumesDeleteCascade-98630795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.97010e1f-7590-49fb-8e21-814d0b7e7c04" returned: 0 in 0.261s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:10 devstack sudo[101303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:21:10 devstack sudo[101303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b2f117ca-0188-4ae2-82d7-16418868d54a tempest-VolumesDeleteCascade-98630795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.554s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:21:10 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-b2f117ca-0188-4ae2-82d7-16418868d54a tempest-VolumesDeleteCascade-98630795 None] Create snapshot completed successfully
Nov 04 12:21:10 devstack sudo[101303]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c6bad762-debc-48ee-ba0d-227b0544d525 tempest-VolumesListTestJSON-895243107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.255s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:10 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-c6bad762-debc-48ee-ba0d-227b0544d525 tempest-VolumesListTestJSON-895243107 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:21:10 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-c6bad762-debc-48ee-ba0d-227b0544d525 tempest-VolumesListTestJSON-895243107 None] Deleted volume successfully.
Nov 04 12:21:10 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c6bad762-debc-48ee-ba0d-227b0544d525 tempest-VolumesListTestJSON-895243107 None] Lock "cinder-c00e2cd3-d0c9-434e-a534-9608d1f0cca2-delete_volume" released by "delete_volume" :: held 1.153s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:21:10 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c6b818f4-a6c6-4119-8a8a-333445ff514b tempest-VolumesListTestJSON-895243107 None] Acquiring lock "cinder-aadc8e30-7d1f-414c-b50d-137d89f21318-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:21:10 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c6b818f4-a6c6-4119-8a8a-333445ff514b tempest-VolumesListTestJSON-895243107 None] Lock "cinder-aadc8e30-7d1f-414c-b50d-137d89f21318-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:21:10 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c6b818f4-a6c6-4119-8a8a-333445ff514b tempest-VolumesListTestJSON-895243107 None] Acquiring lock "cinder-quobyte-aadc8e30-7d1f-414c-b50d-137d89f21318" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:21:10 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c6b818f4-a6c6-4119-8a8a-333445ff514b tempest-VolumesListTestJSON-895243107 None] Lock "cinder-quobyte-aadc8e30-7d1f-414c-b50d-137d89f21318" acquired by "delete_volume" :: waited 0.014s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:21:10 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[46097273-a798-4aba-89fe-d3636f96d8c7]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:21:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c6b818f4-a6c6-4119-8a8a-333445ff514b tempest-VolumesListTestJSON-895243107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aadc8e30-7d1f-414c-b50d-137d89f21318 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:10 devstack sudo[101306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aadc8e30-7d1f-414c-b50d-137d89f21318
Nov 04 12:21:10 devstack sudo[101306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:10 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Acquiring lock "cinder-5e137263-352d-41b1-b52b-cffd9522f278-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:21:10 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Lock "cinder-5e137263-352d-41b1-b52b-cffd9522f278-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:21:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Performing cascade delete. {{(pid=87169) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Nov 04 12:21:11 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Acquiring lock "cinder-0600beef-dd23-4e91-a13a-1f5b4477ad2f-delete_snapshot" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:21:11 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Lock "cinder-0600beef-dd23-4e91-a13a-1f5b4477ad2f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:21:11 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Acquiring lock "cinder-quobyte-5e137263-352d-41b1-b52b-cffd9522f278" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:21:11 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Lock "cinder-quobyte-5e137263-352d-41b1-b52b-cffd9522f278" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:21:11 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Acquiring lock "cinder-quobyte-0600beef-dd23-4e91-a13a-1f5b4477ad2f" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:21:11 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Lock "cinder-quobyte-0600beef-dd23-4e91-a13a-1f5b4477ad2f" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:21:11 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Deleting offline snapshot 0600beef-dd23-4e91-a13a-1f5b4477ad2f of volume 5e137263-352d-41b1-b52b-cffd9522f278 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:21:11 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] snapshot_file for this snap is: volume-5e137263-352d-41b1-b52b-cffd9522f278.0600beef-dd23-4e91-a13a-1f5b4477ad2f {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:21:11 devstack sudo[101306]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c6b818f4-a6c6-4119-8a8a-333445ff514b tempest-VolumesListTestJSON-895243107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aadc8e30-7d1f-414c-b50d-137d89f21318" returned: 0 in 0.388s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c6b818f4-a6c6-4119-8a8a-333445ff514b tempest-VolumesListTestJSON-895243107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aadc8e30-7d1f-414c-b50d-137d89f21318 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:11 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e93c325-b8d9-4f18-b1d3-8881e6e24e78]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:21:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.0600beef-dd23-4e91-a13a-1f5b4477ad2f {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:11 devstack sudo[101312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aadc8e30-7d1f-414c-b50d-137d89f21318
Nov 04 12:21:11 devstack sudo[101312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:11 devstack sudo[101313]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.0600beef-dd23-4e91-a13a-1f5b4477ad2f
Nov 04 12:21:11 devstack sudo[101313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:11 devstack sudo[101312]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c6b818f4-a6c6-4119-8a8a-333445ff514b tempest-VolumesListTestJSON-895243107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-aadc8e30-7d1f-414c-b50d-137d89f21318" returned: 0 in 0.270s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:11 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c6b818f4-a6c6-4119-8a8a-333445ff514b tempest-VolumesListTestJSON-895243107 None] Lock "cinder-quobyte-aadc8e30-7d1f-414c-b50d-137d89f21318" released by "delete_volume" :: held 0.704s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:21:11 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-c6b818f4-a6c6-4119-8a8a-333445ff514b tempest-VolumesListTestJSON-895243107 None] Created reservations ['85cfb891-c668-4c18-a5d3-85b78b37bb93', 'e47b09e0-a4e5-45f6-a816-61dda3d79635', '2eb8b853-a092-44f6-98a7-d4d1cb3e15f2', '319fb27a-1055-4646-85d3-b5fc799f690a'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:21:11 devstack sudo[101313]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.0600beef-dd23-4e91-a13a-1f5b4477ad2f" returned: 0 in 0.381s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:11 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e137263-352d-41b1-b52b-cffd9522f278(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:21:11 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18c6751-4fd6-413f-8b37-43e0fd9460e8]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:21:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c6b818f4-a6c6-4119-8a8a-333445ff514b tempest-VolumesListTestJSON-895243107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:21:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c6b818f4-a6c6-4119-8a8a-333445ff514b tempest-VolumesListTestJSON-895243107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:21:11 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c6b818f4-a6c6-4119-8a8a-333445ff514b tempest-VolumesListTestJSON-895243107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:21:11 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c6b818f4-a6c6-4119-8a8a-333445ff514b tempest-VolumesListTestJSON-895243107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:21:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c6b818f4-a6c6-4119-8a8a-333445ff514b tempest-VolumesListTestJSON-895243107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:21:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c6b818f4-a6c6-4119-8a8a-333445ff514b tempest-VolumesListTestJSON-895243107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:11 devstack sudo[101321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:21:11 devstack sudo[101321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:11 devstack sudo[101320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278
Nov 04 12:21:11 devstack sudo[101320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:11 devstack sudo[101321]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c6b818f4-a6c6-4119-8a8a-333445ff514b tempest-VolumesListTestJSON-895243107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.262s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:11 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-c6b818f4-a6c6-4119-8a8a-333445ff514b tempest-VolumesListTestJSON-895243107 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:21:11 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-c6b818f4-a6c6-4119-8a8a-333445ff514b tempest-VolumesListTestJSON-895243107 None] Deleted volume successfully.
Nov 04 12:21:11 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c6b818f4-a6c6-4119-8a8a-333445ff514b tempest-VolumesListTestJSON-895243107 None] Lock "cinder-aadc8e30-7d1f-414c-b50d-137d89f21318-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:21:11 devstack sudo[101320]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278" returned: 0 in 0.381s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:11 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[40597186-a087-4bd4-bb11-83bcbee42662]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:21:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.97010e1f-7590-49fb-8e21-814d0b7e7c04 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:12 devstack sudo[101328]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.97010e1f-7590-49fb-8e21-814d0b7e7c04
Nov 04 12:21:12 devstack sudo[101328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:12 devstack sudo[101328]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.97010e1f-7590-49fb-8e21-814d0b7e7c04" returned: 0 in 0.363s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:12 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e137263-352d-41b1-b52b-cffd9522f278(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:21:12 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[93755b70-3277-45a4-9642-90fb0a5e5140]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:21:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.0600beef-dd23-4e91-a13a-1f5b4477ad2f {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:12 devstack sudo[101333]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.0600beef-dd23-4e91-a13a-1f5b4477ad2f
Nov 04 12:21:12 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:12 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.0600beef-dd23-4e91-a13a-1f5b4477ad2f" returned: 0 in 0.397s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:12 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e137263-352d-41b1-b52b-cffd9522f278(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:21:12 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6db8df9-5789-4d75-b9c0-b4e06f588d5f]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:21:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:12 devstack sudo[101338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278
Nov 04 12:21:12 devstack sudo[101338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:13 devstack sudo[101338]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278" returned: 0 in 0.401s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.0600beef-dd23-4e91-a13a-1f5b4477ad2f {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:13 devstack sudo[101343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.0600beef-dd23-4e91-a13a-1f5b4477ad2f
Nov 04 12:21:13 devstack sudo[101343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:13 devstack sudo[101343]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.0600beef-dd23-4e91-a13a-1f5b4477ad2f" returned: 0 in 0.371s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.0600beef-dd23-4e91-a13a-1f5b4477ad2f {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:13 devstack sudo[101349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.0600beef-dd23-4e91-a13a-1f5b4477ad2f
Nov 04 12:21:13 devstack sudo[101349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:13 devstack sudo[101349]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.0600beef-dd23-4e91-a13a-1f5b4477ad2f" returned: 0 in 0.270s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e137263-352d-41b1-b52b-cffd9522f278 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.97010e1f-7590-49fb-8e21-814d0b7e7c04 -F qcow2 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:13 devstack sudo[101352]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e137263-352d-41b1-b52b-cffd9522f278 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.97010e1f-7590-49fb-8e21-814d0b7e7c04 -F qcow2
Nov 04 12:21:13 devstack sudo[101352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:14 devstack sudo[101352]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e137263-352d-41b1-b52b-cffd9522f278 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.97010e1f-7590-49fb-8e21-814d0b7e7c04 -F qcow2" returned: 0 in 0.305s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:14 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Lock "cinder-quobyte-0600beef-dd23-4e91-a13a-1f5b4477ad2f" released by "_delete_snapshot" :: held 3.047s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:21:14 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Lock "cinder-quobyte-5e137263-352d-41b1-b52b-cffd9522f278" released by "delete_snapshot" :: held 3.070s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:21:14 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Created reservations ['130da5ad-f7fe-413b-8a5f-dc839ae4d2a6', '9e67ff52-a381-4904-92e7-edbb2e8aae1a', '934031a2-04c7-4498-88b6-c8b1d54928fa', '462fa2b1-0b3c-42ad-a48f-f123766a96e4'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:21:14 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Delete snapshot completed successfully.
Nov 04 12:21:14 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Lock "cinder-0600beef-dd23-4e91-a13a-1f5b4477ad2f-delete_snapshot" released by "delete_snapshot" :: held 3.227s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:21:14 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Acquiring lock "cinder-97010e1f-7590-49fb-8e21-814d0b7e7c04-delete_snapshot" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:21:14 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Lock "cinder-97010e1f-7590-49fb-8e21-814d0b7e7c04-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:21:14 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Acquiring lock "cinder-quobyte-5e137263-352d-41b1-b52b-cffd9522f278" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:21:14 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Lock "cinder-quobyte-5e137263-352d-41b1-b52b-cffd9522f278" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:21:14 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Acquiring lock "cinder-quobyte-97010e1f-7590-49fb-8e21-814d0b7e7c04" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:21:14 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Lock "cinder-quobyte-97010e1f-7590-49fb-8e21-814d0b7e7c04" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:21:14 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Deleting offline snapshot 97010e1f-7590-49fb-8e21-814d0b7e7c04 of volume 5e137263-352d-41b1-b52b-cffd9522f278 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:21:14 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] snapshot_file for this snap is: volume-5e137263-352d-41b1-b52b-cffd9522f278.97010e1f-7590-49fb-8e21-814d0b7e7c04 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:21:14 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[942cafa2-2304-4545-ada3-c4096d747038]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:21:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.97010e1f-7590-49fb-8e21-814d0b7e7c04 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:14 devstack sudo[101357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.97010e1f-7590-49fb-8e21-814d0b7e7c04
Nov 04 12:21:14 devstack sudo[101357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:14 devstack sudo[101357]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.97010e1f-7590-49fb-8e21-814d0b7e7c04" returned: 0 in 0.440s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:14 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e137263-352d-41b1-b52b-cffd9522f278(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:21:14 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c7242b4-f5b3-4419-a81a-fa62e10f71c4]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:21:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:15 devstack sudo[101362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278
Nov 04 12:21:15 devstack sudo[101362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:15 devstack sudo[101362]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278" returned: 0 in 0.445s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.97010e1f-7590-49fb-8e21-814d0b7e7c04 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:15 devstack sudo[101368]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.97010e1f-7590-49fb-8e21-814d0b7e7c04
Nov 04 12:21:15 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:15 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.97010e1f-7590-49fb-8e21-814d0b7e7c04" returned: 0 in 0.418s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.97010e1f-7590-49fb-8e21-814d0b7e7c04 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:15 devstack sudo[101373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.97010e1f-7590-49fb-8e21-814d0b7e7c04
Nov 04 12:21:15 devstack sudo[101373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:16 devstack sudo[101373]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278.97010e1f-7590-49fb-8e21-814d0b7e7c04" returned: 0 in 0.300s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:16 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Lock "cinder-quobyte-97010e1f-7590-49fb-8e21-814d0b7e7c04" released by "_delete_snapshot" :: held 1.741s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:21:16 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Lock "cinder-quobyte-5e137263-352d-41b1-b52b-cffd9522f278" released by "delete_snapshot" :: held 1.766s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:21:16 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Created reservations ['bb6956cf-a611-4c38-8163-c152e0dc64fc', '534e4514-0943-4909-8579-926f20d2175e', '5a11c7f6-f4cc-4447-8fd5-6cd48611477a', '9e525756-8d30-42cc-9a0a-0345bbb92c34'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:21:16 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Delete snapshot completed successfully.
Nov 04 12:21:16 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Lock "cinder-97010e1f-7590-49fb-8e21-814d0b7e7c04-delete_snapshot" released by "delete_snapshot" :: held 1.926s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:21:16 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Snapshots deleted, issuing volume delete {{(pid=87169) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Nov 04 12:21:16 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Acquiring lock "cinder-quobyte-5e137263-352d-41b1-b52b-cffd9522f278" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:21:16 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Lock "cinder-quobyte-5e137263-352d-41b1-b52b-cffd9522f278" acquired by "delete_volume" :: waited 0.025s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:21:16 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[1884ac5c-4af7-4f01-a294-fb8aa113a79e]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:21:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:16 devstack sudo[101376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278
Nov 04 12:21:16 devstack sudo[101376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:16 devstack sudo[101376]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278" returned: 0 in 0.427s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:16 devstack sudo[101381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278
Nov 04 12:21:16 devstack sudo[101381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:17 devstack sudo[101381]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5e137263-352d-41b1-b52b-cffd9522f278" returned: 0 in 0.265s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:17 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Lock "cinder-quobyte-5e137263-352d-41b1-b52b-cffd9522f278" released by "delete_volume" :: held 0.766s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:21:17 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Created reservations ['f033cad8-9779-4bb7-8b68-542e4b16b729', '200bf7d2-2d97-4079-ab4d-dc1f6e34d6ef', '425fe7c4-20e7-4fa7-be04-f14bc5c42f7b', '3e7a54b5-e830-453a-8ac1-eaa4fa0b99fb'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:21:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:21:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:21:17 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:21:17 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:21:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:21:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:17 devstack sudo[101391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:21:17 devstack sudo[101391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:17 devstack sudo[101391]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.315s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:17 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:21:17 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Deleted volume successfully.
Nov 04 12:21:17 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d0d3de3a-bb5f-49f4-baea-475c8e74e6d5 tempest-VolumesDeleteCascade-98630795 None] Lock "cinder-5e137263-352d-41b1-b52b-cffd9522f278-delete_volume" released by "delete_volume" :: held 6.530s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:21:18 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dfb4463-f186-4484-9fe7-885b1875a37e tempest-VolumesDeleteCascade-98630795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:21:18 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1dfb4463-f186-4484-9fe7-885b1875a37e tempest-VolumesDeleteCascade-98630795 None] Flow 'volume_create_manager' (193ec068-8480-49db-a361-855f808a1bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:21:18 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1dfb4463-f186-4484-9fe7-885b1875a37e tempest-VolumesDeleteCascade-98630795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cde2e8b0-8a62-4684-8a04-ef6bf367d6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:21:18 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1dfb4463-f186-4484-9fe7-885b1875a37e tempest-VolumesDeleteCascade-98630795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cde2e8b0-8a62-4684-8a04-ef6bf367d6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1083886927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37e21d5d-b867-4ab0-a485-81c809b686e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ec395c98a404b4bb83d68f076485c99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:21:18Z,use_quota=True,user_id='39960588417141f3b77e2bc490b23176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:21:18 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1dfb4463-f186-4484-9fe7-885b1875a37e tempest-VolumesDeleteCascade-98630795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (028a7a09-07a7-4ae2-91ec-3f96ac2222d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:21:18 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1dfb4463-f186-4484-9fe7-885b1875a37e tempest-VolumesDeleteCascade-98630795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (028a7a09-07a7-4ae2-91ec-3f96ac2222d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:21:18 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1dfb4463-f186-4484-9fe7-885b1875a37e tempest-VolumesDeleteCascade-98630795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff6aa103-bd5e-4370-a20e-b97034272de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:21:18 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1dfb4463-f186-4484-9fe7-885b1875a37e tempest-VolumesDeleteCascade-98630795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff6aa103-bd5e-4370-a20e-b97034272de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37e21d5d-b867-4ab0-a485-81c809b686e2', 'volume_name': 'volume-37e21d5d-b867-4ab0-a485-81c809b686e2', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:21:18 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1dfb4463-f186-4484-9fe7-885b1875a37e tempest-VolumesDeleteCascade-98630795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ee80f40-ca74-44b0-a953-45c2745b2653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:21:18 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1dfb4463-f186-4484-9fe7-885b1875a37e tempest-VolumesDeleteCascade-98630795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ee80f40-ca74-44b0-a953-45c2745b2653) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:21:18 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1dfb4463-f186-4484-9fe7-885b1875a37e tempest-VolumesDeleteCascade-98630795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29cbbb64-1510-4793-b8b2-da26e6f23492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:21:18 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-1dfb4463-f186-4484-9fe7-885b1875a37e tempest-VolumesDeleteCascade-98630795 None] Volume 37e21d5d-b867-4ab0-a485-81c809b686e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37e21d5d-b867-4ab0-a485-81c809b686e2', 'volume_size': 1}
Nov 04 12:21:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1dfb4463-f186-4484-9fe7-885b1875a37e tempest-VolumesDeleteCascade-98630795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:21:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1dfb4463-f186-4484-9fe7-885b1875a37e tempest-VolumesDeleteCascade-98630795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:21:18 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1dfb4463-f186-4484-9fe7-885b1875a37e tempest-VolumesDeleteCascade-98630795 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:21:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1083886927',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37e21d5d-b867-4ab0-a485-81c809b686e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ec395c98a404b4bb83d68f076485c99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:21:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:21:18Z,use_quota=True,user_id='39960588417141f3b77e2bc490b23176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:21:18 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-1dfb4463-f186-4484-9fe7-885b1875a37e tempest-VolumesDeleteCascade-98630795 None] Creating volume 37e21d5d-b867-4ab0-a485-81c809b686e2 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:21:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1dfb4463-f186-4484-9fe7-885b1875a37e tempest-VolumesDeleteCascade-98630795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:21:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1dfb4463-f186-4484-9fe7-885b1875a37e tempest-VolumesDeleteCascade-98630795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:21:18 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1dfb4463-f186-4484-9fe7-885b1875a37e tempest-VolumesDeleteCascade-98630795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:21:18 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1dfb4463-f186-4484-9fe7-885b1875a37e tempest-VolumesDeleteCascade-98630795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:21:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1dfb4463-f186-4484-9fe7-885b1875a37e tempest-VolumesDeleteCascade-98630795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:21:18 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1dfb4463-f186-4484-9fe7-885b1875a37e tempest-VolumesDeleteCascade-98630795 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:21:18 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-1dfb4463-f186-4484-9fe7-885b1875a37e tempest-VolumesDeleteCascade-98630795 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:21:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1dfb4463-f186-4484-9fe7-885b1875a37e tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:18 devstack sudo[101394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2 1073741824
Nov 04 12:21:18 devstack sudo[101394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:18 devstack sudo[101394]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1dfb4463-f186-4484-9fe7-885b1875a37e tempest-VolumesDeleteCascade-98630795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2 1073741824" returned: 0 in 0.429s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1dfb4463-f186-4484-9fe7-885b1875a37e tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:19 devstack sudo[101400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2
Nov 04 12:21:19 devstack sudo[101400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:19 devstack sudo[101400]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1dfb4463-f186-4484-9fe7-885b1875a37e tempest-VolumesDeleteCascade-98630795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2" returned: 0 in 0.314s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:19 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1dfb4463-f186-4484-9fe7-885b1875a37e tempest-VolumesDeleteCascade-98630795 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:21:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1dfb4463-f186-4484-9fe7-885b1875a37e tempest-VolumesDeleteCascade-98630795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:21:19 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1dfb4463-f186-4484-9fe7-885b1875a37e tempest-VolumesDeleteCascade-98630795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29cbbb64-1510-4793-b8b2-da26e6f23492) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37e21d5d-b867-4ab0-a485-81c809b686e2', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:21:19 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1dfb4463-f186-4484-9fe7-885b1875a37e tempest-VolumesDeleteCascade-98630795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73649ec0-36f3-48c5-8cd5-873da3d2ae02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:21:19 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-1dfb4463-f186-4484-9fe7-885b1875a37e tempest-VolumesDeleteCascade-98630795 None] Volume volume-37e21d5d-b867-4ab0-a485-81c809b686e2 (37e21d5d-b867-4ab0-a485-81c809b686e2): created successfully
Nov 04 12:21:19 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1dfb4463-f186-4484-9fe7-885b1875a37e tempest-VolumesDeleteCascade-98630795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73649ec0-36f3-48c5-8cd5-873da3d2ae02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:21:19 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1dfb4463-f186-4484-9fe7-885b1875a37e tempest-VolumesDeleteCascade-98630795 None] Flow 'volume_create_manager' (193ec068-8480-49db-a361-855f808a1bc7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:21:19 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-1dfb4463-f186-4484-9fe7-885b1875a37e tempest-VolumesDeleteCascade-98630795 None] Created volume successfully.
Nov 04 12:21:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b89a3b8b-7607-47a8-89b0-b38b6678c1ab tempest-VolumesDeleteCascade-98630795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:21:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b89a3b8b-7607-47a8-89b0-b38b6678c1ab tempest-VolumesDeleteCascade-98630795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:21:20 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-b89a3b8b-7607-47a8-89b0-b38b6678c1ab tempest-VolumesDeleteCascade-98630795 None] Creating offline snapshot 59fb577d-3045-4691-bbfd-af8082365dcb of volume 37e21d5d-b867-4ab0-a485-81c809b686e2 {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:21:20 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff4197c-33da-4572-bd0d-bf1796581be2]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:21:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b89a3b8b-7607-47a8-89b0-b38b6678c1ab tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:20 devstack sudo[101414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2
Nov 04 12:21:20 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:21 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b89a3b8b-7607-47a8-89b0-b38b6678c1ab tempest-VolumesDeleteCascade-98630795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2" returned: 0 in 0.418s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b89a3b8b-7607-47a8-89b0-b38b6678c1ab tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2.59fb577d-3045-4691-bbfd-af8082365dcb 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:21 devstack sudo[101421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2.59fb577d-3045-4691-bbfd-af8082365dcb 1G
Nov 04 12:21:21 devstack sudo[101421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:21 devstack sudo[101421]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b89a3b8b-7607-47a8-89b0-b38b6678c1ab tempest-VolumesDeleteCascade-98630795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2.59fb577d-3045-4691-bbfd-af8082365dcb 1G" returned: 0 in 0.509s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b89a3b8b-7607-47a8-89b0-b38b6678c1ab tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37e21d5d-b867-4ab0-a485-81c809b686e2 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2.59fb577d-3045-4691-bbfd-af8082365dcb {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:21 devstack sudo[101427]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37e21d5d-b867-4ab0-a485-81c809b686e2 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2.59fb577d-3045-4691-bbfd-af8082365dcb
Nov 04 12:21:21 devstack sudo[101427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:22 devstack sudo[101427]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b89a3b8b-7607-47a8-89b0-b38b6678c1ab tempest-VolumesDeleteCascade-98630795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37e21d5d-b867-4ab0-a485-81c809b686e2 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2.59fb577d-3045-4691-bbfd-af8082365dcb" returned: 0 in 0.367s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:22 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-b89a3b8b-7607-47a8-89b0-b38b6678c1ab tempest-VolumesDeleteCascade-98630795 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2.59fb577d-3045-4691-bbfd-af8082365dcb is being set with open permissions: ugo+rw
Nov 04 12:21:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b89a3b8b-7607-47a8-89b0-b38b6678c1ab tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2.59fb577d-3045-4691-bbfd-af8082365dcb {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:22 devstack sudo[101432]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2.59fb577d-3045-4691-bbfd-af8082365dcb
Nov 04 12:21:22 devstack sudo[101432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:22 devstack sudo[101432]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b89a3b8b-7607-47a8-89b0-b38b6678c1ab tempest-VolumesDeleteCascade-98630795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2.59fb577d-3045-4691-bbfd-af8082365dcb" returned: 0 in 0.292s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b89a3b8b-7607-47a8-89b0-b38b6678c1ab tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:22 devstack sudo[101435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2.info
Nov 04 12:21:22 devstack sudo[101435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:22 devstack sudo[101435]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b89a3b8b-7607-47a8-89b0-b38b6678c1ab tempest-VolumesDeleteCascade-98630795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2.info" returned: 0 in 0.287s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:22 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-b89a3b8b-7607-47a8-89b0-b38b6678c1ab tempest-VolumesDeleteCascade-98630795 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2.info is being set with open permissions: ugo+rw
Nov 04 12:21:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b89a3b8b-7607-47a8-89b0-b38b6678c1ab tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:22 devstack sudo[101438]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2.info
Nov 04 12:21:22 devstack sudo[101438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:23 devstack sudo[101438]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b89a3b8b-7607-47a8-89b0-b38b6678c1ab tempest-VolumesDeleteCascade-98630795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2.info" returned: 0 in 0.319s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b89a3b8b-7607-47a8-89b0-b38b6678c1ab tempest-VolumesDeleteCascade-98630795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.356s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:21:23 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:UPDATE=180,cinder:INSERT=53,cinder:DELETE=14,cinder:SELECT=150 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:21:23 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-b89a3b8b-7607-47a8-89b0-b38b6678c1ab tempest-VolumesDeleteCascade-98630795 None] Create snapshot completed successfully
Nov 04 12:21:24 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:21:24 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Flow 'volume_create_manager' (4539f91b-b614-4754-9424-13edd45280dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:21:24 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0ee76c5-1026-4f84-9744-031381432349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:21:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0ee76c5-1026-4f84-9744-031381432349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-779037818',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5455af3e-8965-4ebf-81b7-ef33138bc46d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ec395c98a404b4bb83d68f076485c99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=59fb577d-3045-4691-bbfd-af8082365dcb,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:21:25Z,use_quota=True,user_id='39960588417141f3b77e2bc490b23176',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:21:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbf2c5fb-8567-4b7f-885d-81bf64ae26aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:21:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fbf2c5fb-8567-4b7f-885d-81bf64ae26aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:21:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (177192c1-33b5-443c-af87-bddaa524b7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:21:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (177192c1-33b5-443c-af87-bddaa524b7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5455af3e-8965-4ebf-81b7-ef33138bc46d', 'volume_name': 'volume-5455af3e-8965-4ebf-81b7-ef33138bc46d', 'volume_size': 1, 'snapshot_id': '59fb577d-3045-4691-bbfd-af8082365dcb'}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:21:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d53cf751-03fa-4fbe-9bdc-9a0204e317ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:21:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d53cf751-03fa-4fbe-9bdc-9a0204e317ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:21:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd1b9984-7755-4ebd-a236-1ecd709f6a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:21:25 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Volume 5455af3e-8965-4ebf-81b7-ef33138bc46d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5455af3e-8965-4ebf-81b7-ef33138bc46d', 'volume_size': 1, 'snapshot_id': '59fb577d-3045-4691-bbfd-af8082365dcb'}
Nov 04 12:21:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:21:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:21:25 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Acquiring lock "cinder-quobyte-59fb577d-3045-4691-bbfd-af8082365dcb-5455af3e-8965-4ebf-81b7-ef33138bc46d" by "_create_volume_from_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:21:25 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-926ef6f9-f056-4f81-aaa8-2b6475179b29 req-fde6488e-2fe6-457e-82d9-d9f182c7f051 tempest-TestShelveInstance-1519749939 None] Terminate volume connection completed successfully.
Nov 04 12:21:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-926ef6f9-f056-4f81-aaa8-2b6475179b29 req-fde6488e-2fe6-457e-82d9-d9f182c7f051 tempest-TestShelveInstance-1519749939 None] Deleting attachment a077e0b9-f92c-426a-a413-4e66933f673b. {{(pid=87169) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 12:21:25 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Lock "cinder-quobyte-59fb577d-3045-4691-bbfd-af8082365dcb-5455af3e-8965-4ebf-81b7-ef33138bc46d" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:21:25 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Creating volume 5455af3e-8965-4ebf-81b7-ef33138bc46d from snapshot 59fb577d-3045-4691-bbfd-af8082365dcb {{(pid=87169) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 04 12:21:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:21:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:21:25 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:21:25 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:21:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:21:25 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:21:25 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Acquiring lock "cinder-quobyte-5455af3e-8965-4ebf-81b7-ef33138bc46d" by "_copy_volume_from_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:21:25 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Lock "cinder-quobyte-5455af3e-8965-4ebf-81b7-ef33138bc46d" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:21:25 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] snapshot: 59fb577d-3045-4691-bbfd-af8082365dcb, volume: 5455af3e-8965-4ebf-81b7-ef33138bc46d,  {{(pid=87169) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 04 12:21:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:21:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:21:25 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:21:25 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:21:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:21:25 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a2d14f-a0f9-495e-b28a-0f6a37412490]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:21:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2.59fb577d-3045-4691-bbfd-af8082365dcb {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:25 devstack sudo[101461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2.59fb577d-3045-4691-bbfd-af8082365dcb
Nov 04 12:21:25 devstack sudo[101461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:25 devstack sudo[101461]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2.59fb577d-3045-4691-bbfd-af8082365dcb" returned: 0 in 0.509s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:25 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37e21d5d-b867-4ab0-a485-81c809b686e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:21:25 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c09ad4-8998-463d-afc3-34e1ed47c1b6]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:21:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:25 devstack sudo[101466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2
Nov 04 12:21:25 devstack sudo[101466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:26 devstack sudo[101466]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2" returned: 0 in 0.513s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:26 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2 {{(pid=87169) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 04 12:21:26 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Creating direct copy from snapshot {{(pid=87169) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 04 12:21:26 devstack cinder-volume[87169]: DEBUG cinder.utils [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Path /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5455af3e-8965-4ebf-81b7-ef33138bc46d not found in is_blk_device check {{(pid=87169) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 04 12:21:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5455af3e-8965-4ebf-81b7-ef33138bc46d {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:26 devstack sudo[101472]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5455af3e-8965-4ebf-81b7-ef33138bc46d
Nov 04 12:21:26 devstack sudo[101472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-6d8ac2ec-0413-4184-b3fd-d7748211072f req-c6d45f3c-97ef-4b36-9252-40c9992f801e tempest-TestShelveInstance-1519749939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:21:34 devstack sudo[101472]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5455af3e-8965-4ebf-81b7-ef33138bc46d" returned: 0 in 8.644s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:34 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Image conversion details: src /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2, size 1024.00 MB, duration 8.64 sec, destination /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5455af3e-8965-4ebf-81b7-ef33138bc46d {{(pid=87169) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 12:21:34 devstack cinder-volume[87169]: INFO cinder.image.image_utils [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Converted 1024.00 MB image at 118.45 MB/s
Nov 04 12:21:34 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5455af3e-8965-4ebf-81b7-ef33138bc46d is being set with open permissions: ugo+rw
Nov 04 12:21:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5455af3e-8965-4ebf-81b7-ef33138bc46d {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:34 devstack sudo[101540]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5455af3e-8965-4ebf-81b7-ef33138bc46d
Nov 04 12:21:34 devstack sudo[101540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:35 devstack sudo[101540]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5455af3e-8965-4ebf-81b7-ef33138bc46d" returned: 0 in 0.247s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:35 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Lock "cinder-quobyte-5455af3e-8965-4ebf-81b7-ef33138bc46d" released by "_copy_volume_from_snapshot" :: held 10.041s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:21:35 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Lock "cinder-quobyte-59fb577d-3045-4691-bbfd-af8082365dcb-5455af3e-8965-4ebf-81b7-ef33138bc46d" released by "_create_volume_from_snapshot" :: held 10.121s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:21:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.146s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:21:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-6d8ac2ec-0413-4184-b3fd-d7748211072f req-c6d45f3c-97ef-4b36-9252-40c9992f801e tempest-TestShelveInstance-1519749939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.145s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:21:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-6d8ac2ec-0413-4184-b3fd-d7748211072f req-c6d45f3c-97ef-4b36-9252-40c9992f801e tempest-TestShelveInstance-1519749939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:21:35 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd1b9984-7755-4ebd-a236-1ecd709f6a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5455af3e-8965-4ebf-81b7-ef33138bc46d', 'volume_size': 1, 'snapshot_id': '59fb577d-3045-4691-bbfd-af8082365dcb'}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:21:35 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8d2be86-ca42-4bf4-9a51-c01b7feca820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:21:35 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Volume volume-5455af3e-8965-4ebf-81b7-ef33138bc46d (5455af3e-8965-4ebf-81b7-ef33138bc46d): created successfully
Nov 04 12:21:35 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8d2be86-ca42-4bf4-9a51-c01b7feca820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:21:35 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Flow 'volume_create_manager' (4539f91b-b614-4754-9424-13edd45280dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:21:35 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-6d8ac2ec-0413-4184-b3fd-d7748211072f req-c6d45f3c-97ef-4b36-9252-40c9992f801e tempest-TestShelveInstance-1519749939 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79', 'name': 'volume-1fef71b7-a8de-409c-b1b9-7d0cef41603a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '75ec1dbd-c310-47cf-b5fa-3a65e5863da9', 'enforce_multipath': True} {{(pid=87169) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 04 12:21:35 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-c44a1576-66bb-414e-b58b-66c80a672a8d tempest-VolumesDeleteCascade-98630795 None] Created volume successfully.
Nov 04 12:21:35 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-6d8ac2ec-0413-4184-b3fd-d7748211072f req-c6d45f3c-97ef-4b36-9252-40c9992f801e tempest-TestShelveInstance-1519749939 None] attachment_update completed successfully.
Nov 04 12:21:36 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-33071e07-7283-4a62-b3a7-370a3a821873 tempest-VolumesDeleteCascade-98630795 None] Acquiring lock "cinder-37e21d5d-b867-4ab0-a485-81c809b686e2-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:21:36 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-33071e07-7283-4a62-b3a7-370a3a821873 tempest-VolumesDeleteCascade-98630795 None] Lock "cinder-37e21d5d-b867-4ab0-a485-81c809b686e2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:21:36 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-33071e07-7283-4a62-b3a7-370a3a821873 tempest-VolumesDeleteCascade-98630795 None] Performing cascade delete. {{(pid=87169) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Nov 04 12:21:36 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-33071e07-7283-4a62-b3a7-370a3a821873 tempest-VolumesDeleteCascade-98630795 None] Acquiring lock "cinder-59fb577d-3045-4691-bbfd-af8082365dcb-delete_snapshot" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:21:36 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-33071e07-7283-4a62-b3a7-370a3a821873 tempest-VolumesDeleteCascade-98630795 None] Lock "cinder-59fb577d-3045-4691-bbfd-af8082365dcb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:21:36 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-33071e07-7283-4a62-b3a7-370a3a821873 tempest-VolumesDeleteCascade-98630795 None] Acquiring lock "cinder-quobyte-37e21d5d-b867-4ab0-a485-81c809b686e2" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:21:36 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-33071e07-7283-4a62-b3a7-370a3a821873 tempest-VolumesDeleteCascade-98630795 None] Lock "cinder-quobyte-37e21d5d-b867-4ab0-a485-81c809b686e2" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:21:36 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-33071e07-7283-4a62-b3a7-370a3a821873 tempest-VolumesDeleteCascade-98630795 None] Acquiring lock "cinder-quobyte-59fb577d-3045-4691-bbfd-af8082365dcb" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:21:36 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-33071e07-7283-4a62-b3a7-370a3a821873 tempest-VolumesDeleteCascade-98630795 None] Lock "cinder-quobyte-59fb577d-3045-4691-bbfd-af8082365dcb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:21:36 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-33071e07-7283-4a62-b3a7-370a3a821873 tempest-VolumesDeleteCascade-98630795 None] Deleting offline snapshot 59fb577d-3045-4691-bbfd-af8082365dcb of volume 37e21d5d-b867-4ab0-a485-81c809b686e2 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:21:36 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-33071e07-7283-4a62-b3a7-370a3a821873 tempest-VolumesDeleteCascade-98630795 None] snapshot_file for this snap is: volume-37e21d5d-b867-4ab0-a485-81c809b686e2.59fb577d-3045-4691-bbfd-af8082365dcb {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:21:36 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[9327a3bf-ddeb-49ef-bf7c-12592d46a02d]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:21:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-33071e07-7283-4a62-b3a7-370a3a821873 tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2.59fb577d-3045-4691-bbfd-af8082365dcb {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:36 devstack sudo[101543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2.59fb577d-3045-4691-bbfd-af8082365dcb
Nov 04 12:21:36 devstack sudo[101543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:36 devstack sudo[101543]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-33071e07-7283-4a62-b3a7-370a3a821873 tempest-VolumesDeleteCascade-98630795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2.59fb577d-3045-4691-bbfd-af8082365dcb" returned: 0 in 0.404s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:36 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-33071e07-7283-4a62-b3a7-370a3a821873 tempest-VolumesDeleteCascade-98630795 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37e21d5d-b867-4ab0-a485-81c809b686e2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:21:36 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c88c2c-25a3-48b6-b5d6-632d8eb1b0bb]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:21:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-33071e07-7283-4a62-b3a7-370a3a821873 tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:36 devstack sudo[101549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2
Nov 04 12:21:36 devstack sudo[101549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:37 devstack sudo[101549]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-33071e07-7283-4a62-b3a7-370a3a821873 tempest-VolumesDeleteCascade-98630795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2" returned: 0 in 0.639s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-33071e07-7283-4a62-b3a7-370a3a821873 tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2.59fb577d-3045-4691-bbfd-af8082365dcb {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:37 devstack sudo[101555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2.59fb577d-3045-4691-bbfd-af8082365dcb
Nov 04 12:21:37 devstack sudo[101555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:37 devstack sudo[101555]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-33071e07-7283-4a62-b3a7-370a3a821873 tempest-VolumesDeleteCascade-98630795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2.59fb577d-3045-4691-bbfd-af8082365dcb" returned: 0 in 0.415s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-33071e07-7283-4a62-b3a7-370a3a821873 tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2.59fb577d-3045-4691-bbfd-af8082365dcb {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:37 devstack sudo[101562]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2.59fb577d-3045-4691-bbfd-af8082365dcb
Nov 04 12:21:37 devstack sudo[101562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:38 devstack sudo[101562]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-33071e07-7283-4a62-b3a7-370a3a821873 tempest-VolumesDeleteCascade-98630795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2.59fb577d-3045-4691-bbfd-af8082365dcb" returned: 0 in 0.333s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:38 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-33071e07-7283-4a62-b3a7-370a3a821873 tempest-VolumesDeleteCascade-98630795 None] Lock "cinder-quobyte-59fb577d-3045-4691-bbfd-af8082365dcb" released by "_delete_snapshot" :: held 1.959s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:21:38 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-33071e07-7283-4a62-b3a7-370a3a821873 tempest-VolumesDeleteCascade-98630795 None] Lock "cinder-quobyte-37e21d5d-b867-4ab0-a485-81c809b686e2" released by "delete_snapshot" :: held 1.991s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:21:38 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-33071e07-7283-4a62-b3a7-370a3a821873 tempest-VolumesDeleteCascade-98630795 None] Created reservations ['6acce666-6ff1-4496-a0ec-b814f6749395', 'bbe8ff98-710f-4268-a34b-2b7e0df52b24', '298924cc-69a7-47f9-b7b3-fe184bc77d78', '4337f16c-d784-4296-a671-ea037ae7307e'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:21:38 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-33071e07-7283-4a62-b3a7-370a3a821873 tempest-VolumesDeleteCascade-98630795 None] Delete snapshot completed successfully.
Nov 04 12:21:38 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-33071e07-7283-4a62-b3a7-370a3a821873 tempest-VolumesDeleteCascade-98630795 None] Lock "cinder-59fb577d-3045-4691-bbfd-af8082365dcb-delete_snapshot" released by "delete_snapshot" :: held 2.388s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:21:38 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-33071e07-7283-4a62-b3a7-370a3a821873 tempest-VolumesDeleteCascade-98630795 None] Snapshots deleted, issuing volume delete {{(pid=87169) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Nov 04 12:21:38 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-33071e07-7283-4a62-b3a7-370a3a821873 tempest-VolumesDeleteCascade-98630795 None] Acquiring lock "cinder-quobyte-37e21d5d-b867-4ab0-a485-81c809b686e2" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:21:38 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-33071e07-7283-4a62-b3a7-370a3a821873 tempest-VolumesDeleteCascade-98630795 None] Lock "cinder-quobyte-37e21d5d-b867-4ab0-a485-81c809b686e2" acquired by "delete_volume" :: waited 0.026s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:21:38 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed13a7db-8553-4ae3-8c0a-b8672f19d382]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:21:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-33071e07-7283-4a62-b3a7-370a3a821873 tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:38 devstack sudo[102012]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2
Nov 04 12:21:38 devstack sudo[102012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:39 devstack sudo[102012]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-33071e07-7283-4a62-b3a7-370a3a821873 tempest-VolumesDeleteCascade-98630795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2" returned: 0 in 0.579s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-33071e07-7283-4a62-b3a7-370a3a821873 tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:39 devstack sudo[102042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2
Nov 04 12:21:39 devstack sudo[102042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:39 devstack sudo[102042]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-33071e07-7283-4a62-b3a7-370a3a821873 tempest-VolumesDeleteCascade-98630795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37e21d5d-b867-4ab0-a485-81c809b686e2" returned: 0 in 0.358s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:39 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-33071e07-7283-4a62-b3a7-370a3a821873 tempest-VolumesDeleteCascade-98630795 None] Lock "cinder-quobyte-37e21d5d-b867-4ab0-a485-81c809b686e2" released by "delete_volume" :: held 1.072s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:21:39 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-33071e07-7283-4a62-b3a7-370a3a821873 tempest-VolumesDeleteCascade-98630795 None] Created reservations ['3973c52b-7780-499b-a4d7-2e88f23919e9', '00cc928c-266f-4bc6-927d-df4e61067deb', 'ddf0cb59-bff3-4d44-8d75-d59f59dabe53', 'e692d686-2d96-4aba-9673-90e75cd034e0'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:21:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-33071e07-7283-4a62-b3a7-370a3a821873 tempest-VolumesDeleteCascade-98630795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:21:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-33071e07-7283-4a62-b3a7-370a3a821873 tempest-VolumesDeleteCascade-98630795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:21:39 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-33071e07-7283-4a62-b3a7-370a3a821873 tempest-VolumesDeleteCascade-98630795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:21:39 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-33071e07-7283-4a62-b3a7-370a3a821873 tempest-VolumesDeleteCascade-98630795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:21:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-33071e07-7283-4a62-b3a7-370a3a821873 tempest-VolumesDeleteCascade-98630795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:21:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-33071e07-7283-4a62-b3a7-370a3a821873 tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:40 devstack sudo[102047]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:21:40 devstack sudo[102047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:40 devstack sudo[102047]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-33071e07-7283-4a62-b3a7-370a3a821873 tempest-VolumesDeleteCascade-98630795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.343s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:40 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-33071e07-7283-4a62-b3a7-370a3a821873 tempest-VolumesDeleteCascade-98630795 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:21:40 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-33071e07-7283-4a62-b3a7-370a3a821873 tempest-VolumesDeleteCascade-98630795 None] Deleted volume successfully.
Nov 04 12:21:40 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-33071e07-7283-4a62-b3a7-370a3a821873 tempest-VolumesDeleteCascade-98630795 None] Lock "cinder-37e21d5d-b867-4ab0-a485-81c809b686e2-delete_volume" released by "delete_volume" :: held 4.206s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:21:41 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-26817c4a-1ea2-4198-8f6f-2d7d0478d718 tempest-VolumesDeleteCascade-98630795 None] Acquiring lock "cinder-5455af3e-8965-4ebf-81b7-ef33138bc46d-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:21:41 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-26817c4a-1ea2-4198-8f6f-2d7d0478d718 tempest-VolumesDeleteCascade-98630795 None] Lock "cinder-5455af3e-8965-4ebf-81b7-ef33138bc46d-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:21:41 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-26817c4a-1ea2-4198-8f6f-2d7d0478d718 tempest-VolumesDeleteCascade-98630795 None] Acquiring lock "cinder-quobyte-5455af3e-8965-4ebf-81b7-ef33138bc46d" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:21:41 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-26817c4a-1ea2-4198-8f6f-2d7d0478d718 tempest-VolumesDeleteCascade-98630795 None] Lock "cinder-quobyte-5455af3e-8965-4ebf-81b7-ef33138bc46d" acquired by "delete_volume" :: waited 0.034s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:21:41 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eab1d3d-fed2-4dbc-8597-eb295952f8bb]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:21:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-26817c4a-1ea2-4198-8f6f-2d7d0478d718 tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5455af3e-8965-4ebf-81b7-ef33138bc46d {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:41 devstack sudo[102055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5455af3e-8965-4ebf-81b7-ef33138bc46d
Nov 04 12:21:41 devstack sudo[102055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:41 devstack sudo[102055]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-26817c4a-1ea2-4198-8f6f-2d7d0478d718 tempest-VolumesDeleteCascade-98630795 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5455af3e-8965-4ebf-81b7-ef33138bc46d" returned: 0 in 0.552s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-26817c4a-1ea2-4198-8f6f-2d7d0478d718 tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5455af3e-8965-4ebf-81b7-ef33138bc46d {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:41 devstack sudo[102060]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5455af3e-8965-4ebf-81b7-ef33138bc46d
Nov 04 12:21:41 devstack sudo[102060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:42 devstack sudo[102060]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-26817c4a-1ea2-4198-8f6f-2d7d0478d718 tempest-VolumesDeleteCascade-98630795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-5455af3e-8965-4ebf-81b7-ef33138bc46d" returned: 0 in 0.313s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:42 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-26817c4a-1ea2-4198-8f6f-2d7d0478d718 tempest-VolumesDeleteCascade-98630795 None] Lock "cinder-quobyte-5455af3e-8965-4ebf-81b7-ef33138bc46d" released by "delete_volume" :: held 0.934s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:21:42 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-26817c4a-1ea2-4198-8f6f-2d7d0478d718 tempest-VolumesDeleteCascade-98630795 None] Created reservations ['fffa3fdc-c329-45ca-a8d3-4e2abb9c12fc', '503d5eb1-adf4-4fef-bd00-ed1b88eeea0b', '69624ff2-91c7-4c4f-9d14-186fe5374102', '6c198149-e4fb-4400-bec7-f37537e80301'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:21:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-26817c4a-1ea2-4198-8f6f-2d7d0478d718 tempest-VolumesDeleteCascade-98630795 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:21:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-26817c4a-1ea2-4198-8f6f-2d7d0478d718 tempest-VolumesDeleteCascade-98630795 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:21:42 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-26817c4a-1ea2-4198-8f6f-2d7d0478d718 tempest-VolumesDeleteCascade-98630795 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:21:42 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-26817c4a-1ea2-4198-8f6f-2d7d0478d718 tempest-VolumesDeleteCascade-98630795 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:21:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-26817c4a-1ea2-4198-8f6f-2d7d0478d718 tempest-VolumesDeleteCascade-98630795 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:21:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-26817c4a-1ea2-4198-8f6f-2d7d0478d718 tempest-VolumesDeleteCascade-98630795 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:42 devstack sudo[102064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:21:42 devstack sudo[102064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:42 devstack sudo[102064]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-26817c4a-1ea2-4198-8f6f-2d7d0478d718 tempest-VolumesDeleteCascade-98630795 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.340s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:42 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-26817c4a-1ea2-4198-8f6f-2d7d0478d718 tempest-VolumesDeleteCascade-98630795 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:21:42 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-26817c4a-1ea2-4198-8f6f-2d7d0478d718 tempest-VolumesDeleteCascade-98630795 None] Deleted volume successfully.
Nov 04 12:21:42 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-26817c4a-1ea2-4198-8f6f-2d7d0478d718 tempest-VolumesDeleteCascade-98630795 None] Lock "cinder-5455af3e-8965-4ebf-81b7-ef33138bc46d-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:21:49 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:21:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:21:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:21:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:21:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:21:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:21:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:49 devstack sudo[102143]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:21:49 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:50 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.497s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:50 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:21:50 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager._thread_info {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:21:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread count: 28 {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 12:21:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread info: [<_MainThread(MainThread, started 137165867425920)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137165754678912)>, <Thread(Thread-3 (stat_writer), started daemon 137165754130752)>, <Thread(Rabbit-heartbeat, started daemon 137165752997504)>, <Thread(Thread-5 (_runner), started daemon 137165753227712)>, <Thread(Thread-7 (_runner), started daemon 137165751273856)>, <Thread(fd_logger, started daemon 137165755322048)>, <Thread(privsep_reader, started daemon 137165748896704)>, <Thread(tpool_thread_0, started daemon 137165742520000)>, <Thread(tpool_thread_1, started daemon 137165734127296)>, <Thread(tpool_thread_2, started daemon 137165725734592)>, <Thread(tpool_thread_3, started daemon 137165717341888)>, <Thread(tpool_thread_4, started daemon 137165708949184)>, <Thread(tpool_thread_5, started daemon 137165700556480)>, <Thread(tpool_thread_6, started daemon 137165692163776)>, <Thread(tpool_thread_7, started daemon 137165683771072)>, <Thread(tpool_thread_8, started daemon 137165675378368)>, <Thread(tpool_thread_9, started daemon 137165666985664)>, <Thread(tpool_thread_10, started daemon 137165658592960)>, <Thread(tpool_thread_11, started daemon 137165650183872)>, <Thread(tpool_thread_12, started daemon 137165641774784)>, <Thread(tpool_thread_13, started daemon 137165633365696)>, <Thread(tpool_thread_14, started daemon 137165624956608)>, <Thread(tpool_thread_15, started daemon 137165616547520)>, <Thread(tpool_thread_16, started daemon 137165608138432)>, <Thread(tpool_thread_17, started daemon 137165599729344)>, <Thread(tpool_thread_18, started daemon 137165591320256)>, <Thread(tpool_thread_19, started daemon 137165582911168)>] {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 12:21:51 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-f026a7f1-9b89-4a8d-9742-eceaa97c1db6 tempest-VolumesTransfersV357Test-1273322579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:21:51 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f026a7f1-9b89-4a8d-9742-eceaa97c1db6 tempest-VolumesTransfersV357Test-1273322579 None] Flow 'volume_create_manager' (b7977c46-cdd0-48aa-8d9a-3ff070046019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:21:51 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f026a7f1-9b89-4a8d-9742-eceaa97c1db6 tempest-VolumesTransfersV357Test-1273322579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f39d42c6-a8db-4670-b7e4-115310f8cdac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:21:51 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f026a7f1-9b89-4a8d-9742-eceaa97c1db6 tempest-VolumesTransfersV357Test-1273322579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f39d42c6-a8db-4670-b7e4-115310f8cdac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1337642661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af82544e-ab06-43ce-a293-19cafcee7acb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='977a07e372254b7fa37ee4e53ef430e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:21:51Z,use_quota=True,user_id='f537ca5b29df477f8ecd5194417740c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:21:51 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f026a7f1-9b89-4a8d-9742-eceaa97c1db6 tempest-VolumesTransfersV357Test-1273322579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d731f493-df9f-4b4c-9380-74d724bd0647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:21:51 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f026a7f1-9b89-4a8d-9742-eceaa97c1db6 tempest-VolumesTransfersV357Test-1273322579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d731f493-df9f-4b4c-9380-74d724bd0647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:21:51 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f026a7f1-9b89-4a8d-9742-eceaa97c1db6 tempest-VolumesTransfersV357Test-1273322579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9a84092-6043-4dba-832e-c7c6d8201912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:21:51 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f026a7f1-9b89-4a8d-9742-eceaa97c1db6 tempest-VolumesTransfersV357Test-1273322579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9a84092-6043-4dba-832e-c7c6d8201912) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af82544e-ab06-43ce-a293-19cafcee7acb', 'volume_name': 'volume-af82544e-ab06-43ce-a293-19cafcee7acb', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:21:51 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f026a7f1-9b89-4a8d-9742-eceaa97c1db6 tempest-VolumesTransfersV357Test-1273322579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0c11272-c782-4398-9400-eb9c1309a759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:21:51 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f026a7f1-9b89-4a8d-9742-eceaa97c1db6 tempest-VolumesTransfersV357Test-1273322579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0c11272-c782-4398-9400-eb9c1309a759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:21:51 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f026a7f1-9b89-4a8d-9742-eceaa97c1db6 tempest-VolumesTransfersV357Test-1273322579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cc5a685-b2e1-4c8f-b660-1d7ffaf0d96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:21:51 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-f026a7f1-9b89-4a8d-9742-eceaa97c1db6 tempest-VolumesTransfersV357Test-1273322579 None] Volume af82544e-ab06-43ce-a293-19cafcee7acb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af82544e-ab06-43ce-a293-19cafcee7acb', 'volume_size': 1}
Nov 04 12:21:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f026a7f1-9b89-4a8d-9742-eceaa97c1db6 tempest-VolumesTransfersV357Test-1273322579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:21:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f026a7f1-9b89-4a8d-9742-eceaa97c1db6 tempest-VolumesTransfersV357Test-1273322579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:21:51 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f026a7f1-9b89-4a8d-9742-eceaa97c1db6 tempest-VolumesTransfersV357Test-1273322579 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1337642661',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af82544e-ab06-43ce-a293-19cafcee7acb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='977a07e372254b7fa37ee4e53ef430e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:21:51Z,use_quota=True,user_id='f537ca5b29df477f8ecd5194417740c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:21:51 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-f026a7f1-9b89-4a8d-9742-eceaa97c1db6 tempest-VolumesTransfersV357Test-1273322579 None] Creating volume af82544e-ab06-43ce-a293-19cafcee7acb {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:21:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f026a7f1-9b89-4a8d-9742-eceaa97c1db6 tempest-VolumesTransfersV357Test-1273322579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:21:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f026a7f1-9b89-4a8d-9742-eceaa97c1db6 tempest-VolumesTransfersV357Test-1273322579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:21:51 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f026a7f1-9b89-4a8d-9742-eceaa97c1db6 tempest-VolumesTransfersV357Test-1273322579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:21:51 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f026a7f1-9b89-4a8d-9742-eceaa97c1db6 tempest-VolumesTransfersV357Test-1273322579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:21:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f026a7f1-9b89-4a8d-9742-eceaa97c1db6 tempest-VolumesTransfersV357Test-1273322579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:21:51 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f026a7f1-9b89-4a8d-9742-eceaa97c1db6 tempest-VolumesTransfersV357Test-1273322579 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:21:51 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-f026a7f1-9b89-4a8d-9742-eceaa97c1db6 tempest-VolumesTransfersV357Test-1273322579 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:21:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f026a7f1-9b89-4a8d-9742-eceaa97c1db6 tempest-VolumesTransfersV357Test-1273322579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-af82544e-ab06-43ce-a293-19cafcee7acb 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:51 devstack sudo[102164]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-af82544e-ab06-43ce-a293-19cafcee7acb 1073741824
Nov 04 12:21:51 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:52 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f026a7f1-9b89-4a8d-9742-eceaa97c1db6 tempest-VolumesTransfersV357Test-1273322579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-af82544e-ab06-43ce-a293-19cafcee7acb 1073741824" returned: 0 in 0.694s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f026a7f1-9b89-4a8d-9742-eceaa97c1db6 tempest-VolumesTransfersV357Test-1273322579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-af82544e-ab06-43ce-a293-19cafcee7acb {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:52 devstack sudo[102170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-af82544e-ab06-43ce-a293-19cafcee7acb
Nov 04 12:21:52 devstack sudo[102170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:52 devstack sudo[102170]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f026a7f1-9b89-4a8d-9742-eceaa97c1db6 tempest-VolumesTransfersV357Test-1273322579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-af82544e-ab06-43ce-a293-19cafcee7acb" returned: 0 in 0.299s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:52 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f026a7f1-9b89-4a8d-9742-eceaa97c1db6 tempest-VolumesTransfersV357Test-1273322579 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:21:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f026a7f1-9b89-4a8d-9742-eceaa97c1db6 tempest-VolumesTransfersV357Test-1273322579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:21:52 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f026a7f1-9b89-4a8d-9742-eceaa97c1db6 tempest-VolumesTransfersV357Test-1273322579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cc5a685-b2e1-4c8f-b660-1d7ffaf0d96e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af82544e-ab06-43ce-a293-19cafcee7acb', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:21:52 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f026a7f1-9b89-4a8d-9742-eceaa97c1db6 tempest-VolumesTransfersV357Test-1273322579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a326715-7edb-4969-824b-0eec6b39c13e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:21:52 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-f026a7f1-9b89-4a8d-9742-eceaa97c1db6 tempest-VolumesTransfersV357Test-1273322579 None] Volume volume-af82544e-ab06-43ce-a293-19cafcee7acb (af82544e-ab06-43ce-a293-19cafcee7acb): created successfully
Nov 04 12:21:52 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f026a7f1-9b89-4a8d-9742-eceaa97c1db6 tempest-VolumesTransfersV357Test-1273322579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a326715-7edb-4969-824b-0eec6b39c13e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:21:52 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f026a7f1-9b89-4a8d-9742-eceaa97c1db6 tempest-VolumesTransfersV357Test-1273322579 None] Flow 'volume_create_manager' (b7977c46-cdd0-48aa-8d9a-3ff070046019) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:21:52 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-f026a7f1-9b89-4a8d-9742-eceaa97c1db6 tempest-VolumesTransfersV357Test-1273322579 None] Created volume successfully.
Nov 04 12:21:54 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-4274ef51-1b91-49b1-be1f-9014ab839689 tempest-VolumesTransfersV357Test-1217174355 None] Transfer volume completed successfully.
Nov 04 12:21:55 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ab3cb883-bf95-49d0-a711-6db374091051 tempest-VolumesTransfersV357Test-1662587561 None] Acquiring lock "cinder-af82544e-ab06-43ce-a293-19cafcee7acb-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:21:55 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ab3cb883-bf95-49d0-a711-6db374091051 tempest-VolumesTransfersV357Test-1662587561 None] Lock "cinder-af82544e-ab06-43ce-a293-19cafcee7acb-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:21:55 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ab3cb883-bf95-49d0-a711-6db374091051 tempest-VolumesTransfersV357Test-1662587561 None] Acquiring lock "cinder-quobyte-af82544e-ab06-43ce-a293-19cafcee7acb" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:21:55 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ab3cb883-bf95-49d0-a711-6db374091051 tempest-VolumesTransfersV357Test-1662587561 None] Lock "cinder-quobyte-af82544e-ab06-43ce-a293-19cafcee7acb" acquired by "delete_volume" :: waited 0.031s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:21:55 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a6b86f6-5cca-4438-b73f-cce1eefb3894]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:21:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ab3cb883-bf95-49d0-a711-6db374091051 tempest-VolumesTransfersV357Test-1662587561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-af82544e-ab06-43ce-a293-19cafcee7acb {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:55 devstack sudo[102176]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-af82544e-ab06-43ce-a293-19cafcee7acb
Nov 04 12:21:55 devstack sudo[102176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:55 devstack sudo[102176]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ab3cb883-bf95-49d0-a711-6db374091051 tempest-VolumesTransfersV357Test-1662587561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-af82544e-ab06-43ce-a293-19cafcee7acb" returned: 0 in 0.437s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ab3cb883-bf95-49d0-a711-6db374091051 tempest-VolumesTransfersV357Test-1662587561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-af82544e-ab06-43ce-a293-19cafcee7acb {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:55 devstack sudo[102183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-af82544e-ab06-43ce-a293-19cafcee7acb
Nov 04 12:21:55 devstack sudo[102183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:56 devstack sudo[102183]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ab3cb883-bf95-49d0-a711-6db374091051 tempest-VolumesTransfersV357Test-1662587561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-af82544e-ab06-43ce-a293-19cafcee7acb" returned: 0 in 0.272s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:56 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ab3cb883-bf95-49d0-a711-6db374091051 tempest-VolumesTransfersV357Test-1662587561 None] Lock "cinder-quobyte-af82544e-ab06-43ce-a293-19cafcee7acb" released by "delete_volume" :: held 0.781s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:21:56 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-ab3cb883-bf95-49d0-a711-6db374091051 tempest-VolumesTransfersV357Test-1662587561 None] Created reservations ['74e4e898-c701-4620-b1eb-9eac7e78d5b6', 'a8069a5f-5545-4828-b9fb-8cdc4ded5dac', 'c889578b-a6f5-4e16-9f7c-7dd11836f061', '0534e97a-a71b-4e47-b408-70081a31672a'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:21:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ab3cb883-bf95-49d0-a711-6db374091051 tempest-VolumesTransfersV357Test-1662587561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:21:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ab3cb883-bf95-49d0-a711-6db374091051 tempest-VolumesTransfersV357Test-1662587561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:21:56 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ab3cb883-bf95-49d0-a711-6db374091051 tempest-VolumesTransfersV357Test-1662587561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:21:56 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ab3cb883-bf95-49d0-a711-6db374091051 tempest-VolumesTransfersV357Test-1662587561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:21:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ab3cb883-bf95-49d0-a711-6db374091051 tempest-VolumesTransfersV357Test-1662587561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:21:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ab3cb883-bf95-49d0-a711-6db374091051 tempest-VolumesTransfersV357Test-1662587561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:56 devstack sudo[102186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:21:56 devstack sudo[102186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:56 devstack sudo[102186]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ab3cb883-bf95-49d0-a711-6db374091051 tempest-VolumesTransfersV357Test-1662587561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.314s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:56 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-ab3cb883-bf95-49d0-a711-6db374091051 tempest-VolumesTransfersV357Test-1662587561 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:21:56 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-ab3cb883-bf95-49d0-a711-6db374091051 tempest-VolumesTransfersV357Test-1662587561 None] Deleted volume successfully.
Nov 04 12:21:56 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ab3cb883-bf95-49d0-a711-6db374091051 tempest-VolumesTransfersV357Test-1662587561 None] Lock "cinder-af82544e-ab06-43ce-a293-19cafcee7acb-delete_volume" released by "delete_volume" :: held 1.404s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:21:57 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b3b7402-edf7-48ce-968a-7743154558eb tempest-VolumesTransfersV357Test-1273322579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:21:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-9b3b7402-edf7-48ce-968a-7743154558eb tempest-VolumesTransfersV357Test-1273322579 None] Flow 'volume_create_manager' (00522799-5173-48c0-9e40-d617ccec709e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:21:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-9b3b7402-edf7-48ce-968a-7743154558eb tempest-VolumesTransfersV357Test-1273322579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (139620b9-559c-40e5-875c-dd806bf46662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:21:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-9b3b7402-edf7-48ce-968a-7743154558eb tempest-VolumesTransfersV357Test-1273322579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (139620b9-559c-40e5-875c-dd806bf46662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1061089825',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=167cf568-001a-4c95-a42b-15063c3502cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='977a07e372254b7fa37ee4e53ef430e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:21:57Z,use_quota=True,user_id='f537ca5b29df477f8ecd5194417740c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:21:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-9b3b7402-edf7-48ce-968a-7743154558eb tempest-VolumesTransfersV357Test-1273322579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcba8517-3ae1-4419-a4fc-04cd7d713cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:21:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-9b3b7402-edf7-48ce-968a-7743154558eb tempest-VolumesTransfersV357Test-1273322579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcba8517-3ae1-4419-a4fc-04cd7d713cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:21:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-9b3b7402-edf7-48ce-968a-7743154558eb tempest-VolumesTransfersV357Test-1273322579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d9676fc-90ab-4abb-a8dd-5a85bde892fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:21:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-9b3b7402-edf7-48ce-968a-7743154558eb tempest-VolumesTransfersV357Test-1273322579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d9676fc-90ab-4abb-a8dd-5a85bde892fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '167cf568-001a-4c95-a42b-15063c3502cc', 'volume_name': 'volume-167cf568-001a-4c95-a42b-15063c3502cc', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:21:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-9b3b7402-edf7-48ce-968a-7743154558eb tempest-VolumesTransfersV357Test-1273322579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22f9d82a-624b-422e-b63d-14f641246aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:21:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-9b3b7402-edf7-48ce-968a-7743154558eb tempest-VolumesTransfersV357Test-1273322579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22f9d82a-624b-422e-b63d-14f641246aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:21:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-9b3b7402-edf7-48ce-968a-7743154558eb tempest-VolumesTransfersV357Test-1273322579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b289116d-4bf2-4b1b-b84f-0b731c66ea59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:21:57 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-9b3b7402-edf7-48ce-968a-7743154558eb tempest-VolumesTransfersV357Test-1273322579 None] Volume 167cf568-001a-4c95-a42b-15063c3502cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-167cf568-001a-4c95-a42b-15063c3502cc', 'volume_size': 1}
Nov 04 12:21:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-9b3b7402-edf7-48ce-968a-7743154558eb tempest-VolumesTransfersV357Test-1273322579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:21:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-9b3b7402-edf7-48ce-968a-7743154558eb tempest-VolumesTransfersV357Test-1273322579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:21:57 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-9b3b7402-edf7-48ce-968a-7743154558eb tempest-VolumesTransfersV357Test-1273322579 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:21:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1061089825',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=167cf568-001a-4c95-a42b-15063c3502cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='977a07e372254b7fa37ee4e53ef430e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:21:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:21:57Z,use_quota=True,user_id='f537ca5b29df477f8ecd5194417740c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:21:57 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-9b3b7402-edf7-48ce-968a-7743154558eb tempest-VolumesTransfersV357Test-1273322579 None] Creating volume 167cf568-001a-4c95-a42b-15063c3502cc {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:21:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-9b3b7402-edf7-48ce-968a-7743154558eb tempest-VolumesTransfersV357Test-1273322579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:21:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-9b3b7402-edf7-48ce-968a-7743154558eb tempest-VolumesTransfersV357Test-1273322579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:21:57 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-9b3b7402-edf7-48ce-968a-7743154558eb tempest-VolumesTransfersV357Test-1273322579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:21:57 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-9b3b7402-edf7-48ce-968a-7743154558eb tempest-VolumesTransfersV357Test-1273322579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:21:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-9b3b7402-edf7-48ce-968a-7743154558eb tempest-VolumesTransfersV357Test-1273322579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:21:57 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-9b3b7402-edf7-48ce-968a-7743154558eb tempest-VolumesTransfersV357Test-1273322579 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:21:57 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-9b3b7402-edf7-48ce-968a-7743154558eb tempest-VolumesTransfersV357Test-1273322579 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:21:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9b3b7402-edf7-48ce-968a-7743154558eb tempest-VolumesTransfersV357Test-1273322579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-167cf568-001a-4c95-a42b-15063c3502cc 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:57 devstack sudo[102201]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-167cf568-001a-4c95-a42b-15063c3502cc 1073741824
Nov 04 12:21:57 devstack sudo[102201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:57 devstack sudo[102201]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9b3b7402-edf7-48ce-968a-7743154558eb tempest-VolumesTransfersV357Test-1273322579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-167cf568-001a-4c95-a42b-15063c3502cc 1073741824" returned: 0 in 0.412s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9b3b7402-edf7-48ce-968a-7743154558eb tempest-VolumesTransfersV357Test-1273322579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-167cf568-001a-4c95-a42b-15063c3502cc {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:57 devstack sudo[102206]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-167cf568-001a-4c95-a42b-15063c3502cc
Nov 04 12:21:57 devstack sudo[102206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:57 devstack sudo[102206]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9b3b7402-edf7-48ce-968a-7743154558eb tempest-VolumesTransfersV357Test-1273322579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-167cf568-001a-4c95-a42b-15063c3502cc" returned: 0 in 0.233s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:57 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-9b3b7402-edf7-48ce-968a-7743154558eb tempest-VolumesTransfersV357Test-1273322579 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:21:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-9b3b7402-edf7-48ce-968a-7743154558eb tempest-VolumesTransfersV357Test-1273322579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:21:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-9b3b7402-edf7-48ce-968a-7743154558eb tempest-VolumesTransfersV357Test-1273322579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b289116d-4bf2-4b1b-b84f-0b731c66ea59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-167cf568-001a-4c95-a42b-15063c3502cc', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:21:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-9b3b7402-edf7-48ce-968a-7743154558eb tempest-VolumesTransfersV357Test-1273322579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a1165d9-fa98-47ed-ad6b-53eb511c26ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:21:57 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-9b3b7402-edf7-48ce-968a-7743154558eb tempest-VolumesTransfersV357Test-1273322579 None] Volume volume-167cf568-001a-4c95-a42b-15063c3502cc (167cf568-001a-4c95-a42b-15063c3502cc): created successfully
Nov 04 12:21:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-9b3b7402-edf7-48ce-968a-7743154558eb tempest-VolumesTransfersV357Test-1273322579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a1165d9-fa98-47ed-ad6b-53eb511c26ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:21:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-9b3b7402-edf7-48ce-968a-7743154558eb tempest-VolumesTransfersV357Test-1273322579 None] Flow 'volume_create_manager' (00522799-5173-48c0-9e40-d617ccec709e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:21:57 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-9b3b7402-edf7-48ce-968a-7743154558eb tempest-VolumesTransfersV357Test-1273322579 None] Created volume successfully.
Nov 04 12:21:58 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-81d54f96-4c88-44b6-947f-c6b378ddfb24 tempest-VolumesTransfersV357Test-1662587561 None] Acquiring lock "cinder-167cf568-001a-4c95-a42b-15063c3502cc-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:21:58 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-81d54f96-4c88-44b6-947f-c6b378ddfb24 tempest-VolumesTransfersV357Test-1662587561 None] Lock "cinder-167cf568-001a-4c95-a42b-15063c3502cc-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:21:58 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-81d54f96-4c88-44b6-947f-c6b378ddfb24 tempest-VolumesTransfersV357Test-1662587561 None] Acquiring lock "cinder-quobyte-167cf568-001a-4c95-a42b-15063c3502cc" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:21:58 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-81d54f96-4c88-44b6-947f-c6b378ddfb24 tempest-VolumesTransfersV357Test-1662587561 None] Lock "cinder-quobyte-167cf568-001a-4c95-a42b-15063c3502cc" acquired by "delete_volume" :: waited 0.017s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:21:58 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[08559d3f-a906-49b7-b32f-a724d5a32ef2]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:21:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-81d54f96-4c88-44b6-947f-c6b378ddfb24 tempest-VolumesTransfersV357Test-1662587561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-167cf568-001a-4c95-a42b-15063c3502cc {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:58 devstack sudo[102233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-167cf568-001a-4c95-a42b-15063c3502cc
Nov 04 12:21:58 devstack sudo[102233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:58 devstack sudo[102233]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-81d54f96-4c88-44b6-947f-c6b378ddfb24 tempest-VolumesTransfersV357Test-1662587561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-167cf568-001a-4c95-a42b-15063c3502cc" returned: 0 in 0.404s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-81d54f96-4c88-44b6-947f-c6b378ddfb24 tempest-VolumesTransfersV357Test-1662587561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-167cf568-001a-4c95-a42b-15063c3502cc {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:58 devstack sudo[102238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-167cf568-001a-4c95-a42b-15063c3502cc
Nov 04 12:21:58 devstack sudo[102238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:59 devstack sudo[102238]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-81d54f96-4c88-44b6-947f-c6b378ddfb24 tempest-VolumesTransfersV357Test-1662587561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-167cf568-001a-4c95-a42b-15063c3502cc" returned: 0 in 0.267s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:59 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-81d54f96-4c88-44b6-947f-c6b378ddfb24 tempest-VolumesTransfersV357Test-1662587561 None] Lock "cinder-quobyte-167cf568-001a-4c95-a42b-15063c3502cc" released by "delete_volume" :: held 0.716s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:21:59 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-81d54f96-4c88-44b6-947f-c6b378ddfb24 tempest-VolumesTransfersV357Test-1662587561 None] Created reservations ['b131bd8e-d6a4-4a3a-970d-a4834edc1550', 'f7986c81-8f6a-481a-a0e6-7cfd0f4f8164', '9cf13aea-d0fa-4de6-aa90-acb5b2c3126b', '96fa41cb-4b74-4942-a135-a9aa16c96b94'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:21:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-81d54f96-4c88-44b6-947f-c6b378ddfb24 tempest-VolumesTransfersV357Test-1662587561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:21:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-81d54f96-4c88-44b6-947f-c6b378ddfb24 tempest-VolumesTransfersV357Test-1662587561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:21:59 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-81d54f96-4c88-44b6-947f-c6b378ddfb24 tempest-VolumesTransfersV357Test-1662587561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:21:59 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-81d54f96-4c88-44b6-947f-c6b378ddfb24 tempest-VolumesTransfersV357Test-1662587561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:21:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-81d54f96-4c88-44b6-947f-c6b378ddfb24 tempest-VolumesTransfersV357Test-1662587561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:21:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-81d54f96-4c88-44b6-947f-c6b378ddfb24 tempest-VolumesTransfersV357Test-1662587561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:21:59 devstack sudo[102241]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:21:59 devstack sudo[102241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:21:59 devstack sudo[102241]: pam_unix(sudo:session): session closed for user root
Nov 04 12:21:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-81d54f96-4c88-44b6-947f-c6b378ddfb24 tempest-VolumesTransfersV357Test-1662587561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.256s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:21:59 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-81d54f96-4c88-44b6-947f-c6b378ddfb24 tempest-VolumesTransfersV357Test-1662587561 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:21:59 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-81d54f96-4c88-44b6-947f-c6b378ddfb24 tempest-VolumesTransfersV357Test-1662587561 None] Deleted volume successfully.
Nov 04 12:21:59 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-81d54f96-4c88-44b6-947f-c6b378ddfb24 tempest-VolumesTransfersV357Test-1662587561 None] Lock "cinder-167cf568-001a-4c95-a42b-15063c3502cc-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:22:06 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-4db5fa34-195e-4f4f-bc7a-61dbcb424fa4 tempest-VolumesSnapshotListTestJSON-527112925 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:22:06 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-4db5fa34-195e-4f4f-bc7a-61dbcb424fa4 tempest-VolumesSnapshotListTestJSON-527112925 None] Flow 'volume_create_manager' (ac305a4d-dafd-4435-b47e-9860ae1967ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:22:06 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-4db5fa34-195e-4f4f-bc7a-61dbcb424fa4 tempest-VolumesSnapshotListTestJSON-527112925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce16d4a5-bf96-4526-bb07-85b66d16763e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:22:06 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-4db5fa34-195e-4f4f-bc7a-61dbcb424fa4 tempest-VolumesSnapshotListTestJSON-527112925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce16d4a5-bf96-4526-bb07-85b66d16763e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2067734840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1a54cfd-b4f9-41fe-94c3-b40351625f31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19ac3ae3217441ffbaf9a8c603222998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:22:06Z,use_quota=True,user_id='cf10b013855c4c46a1688025f0aa20f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:22:06 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-4db5fa34-195e-4f4f-bc7a-61dbcb424fa4 tempest-VolumesSnapshotListTestJSON-527112925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (713febac-337b-45ec-9039-1a5f055758cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:22:06 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-4db5fa34-195e-4f4f-bc7a-61dbcb424fa4 tempest-VolumesSnapshotListTestJSON-527112925 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (713febac-337b-45ec-9039-1a5f055758cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:22:06 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-4db5fa34-195e-4f4f-bc7a-61dbcb424fa4 tempest-VolumesSnapshotListTestJSON-527112925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e8073f4-298e-460f-aaa9-b5c19ab066b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:22:06 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-4db5fa34-195e-4f4f-bc7a-61dbcb424fa4 tempest-VolumesSnapshotListTestJSON-527112925 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e8073f4-298e-460f-aaa9-b5c19ab066b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1a54cfd-b4f9-41fe-94c3-b40351625f31', 'volume_name': 'volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:22:06 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-4db5fa34-195e-4f4f-bc7a-61dbcb424fa4 tempest-VolumesSnapshotListTestJSON-527112925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4440e0f-a6d1-41e5-b85a-e2a941a974af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:22:06 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-4db5fa34-195e-4f4f-bc7a-61dbcb424fa4 tempest-VolumesSnapshotListTestJSON-527112925 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4440e0f-a6d1-41e5-b85a-e2a941a974af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:22:06 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-4db5fa34-195e-4f4f-bc7a-61dbcb424fa4 tempest-VolumesSnapshotListTestJSON-527112925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf9fce23-e660-428f-b710-78c4bf33af06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:22:06 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-4db5fa34-195e-4f4f-bc7a-61dbcb424fa4 tempest-VolumesSnapshotListTestJSON-527112925 None] Volume a1a54cfd-b4f9-41fe-94c3-b40351625f31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31', 'volume_size': 1}
Nov 04 12:22:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-4db5fa34-195e-4f4f-bc7a-61dbcb424fa4 tempest-VolumesSnapshotListTestJSON-527112925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:22:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-4db5fa34-195e-4f4f-bc7a-61dbcb424fa4 tempest-VolumesSnapshotListTestJSON-527112925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:22:06 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-4db5fa34-195e-4f4f-bc7a-61dbcb424fa4 tempest-VolumesSnapshotListTestJSON-527112925 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2067734840',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1a54cfd-b4f9-41fe-94c3-b40351625f31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19ac3ae3217441ffbaf9a8c603222998',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:22:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:22:06Z,use_quota=True,user_id='cf10b013855c4c46a1688025f0aa20f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:22:06 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-4db5fa34-195e-4f4f-bc7a-61dbcb424fa4 tempest-VolumesSnapshotListTestJSON-527112925 None] Creating volume a1a54cfd-b4f9-41fe-94c3-b40351625f31 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:22:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-4db5fa34-195e-4f4f-bc7a-61dbcb424fa4 tempest-VolumesSnapshotListTestJSON-527112925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:22:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-4db5fa34-195e-4f4f-bc7a-61dbcb424fa4 tempest-VolumesSnapshotListTestJSON-527112925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:22:06 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-4db5fa34-195e-4f4f-bc7a-61dbcb424fa4 tempest-VolumesSnapshotListTestJSON-527112925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:22:06 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-4db5fa34-195e-4f4f-bc7a-61dbcb424fa4 tempest-VolumesSnapshotListTestJSON-527112925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:22:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-4db5fa34-195e-4f4f-bc7a-61dbcb424fa4 tempest-VolumesSnapshotListTestJSON-527112925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:22:06 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-4db5fa34-195e-4f4f-bc7a-61dbcb424fa4 tempest-VolumesSnapshotListTestJSON-527112925 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:22:06 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-4db5fa34-195e-4f4f-bc7a-61dbcb424fa4 tempest-VolumesSnapshotListTestJSON-527112925 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:22:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4db5fa34-195e-4f4f-bc7a-61dbcb424fa4 tempest-VolumesSnapshotListTestJSON-527112925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:06 devstack sudo[102268]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31 1073741824
Nov 04 12:22:06 devstack sudo[102268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:06 devstack sudo[102268]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4db5fa34-195e-4f4f-bc7a-61dbcb424fa4 tempest-VolumesSnapshotListTestJSON-527112925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31 1073741824" returned: 0 in 0.412s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4db5fa34-195e-4f4f-bc7a-61dbcb424fa4 tempest-VolumesSnapshotListTestJSON-527112925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:06 devstack sudo[102274]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31
Nov 04 12:22:06 devstack sudo[102274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:07 devstack sudo[102274]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4db5fa34-195e-4f4f-bc7a-61dbcb424fa4 tempest-VolumesSnapshotListTestJSON-527112925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31" returned: 0 in 0.264s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:07 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-4db5fa34-195e-4f4f-bc7a-61dbcb424fa4 tempest-VolumesSnapshotListTestJSON-527112925 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:22:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-4db5fa34-195e-4f4f-bc7a-61dbcb424fa4 tempest-VolumesSnapshotListTestJSON-527112925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.725s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:22:07 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-4db5fa34-195e-4f4f-bc7a-61dbcb424fa4 tempest-VolumesSnapshotListTestJSON-527112925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf9fce23-e660-428f-b710-78c4bf33af06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:22:07 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-4db5fa34-195e-4f4f-bc7a-61dbcb424fa4 tempest-VolumesSnapshotListTestJSON-527112925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d940f236-5454-4a58-8cf6-d636b0bd54f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:22:07 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-4db5fa34-195e-4f4f-bc7a-61dbcb424fa4 tempest-VolumesSnapshotListTestJSON-527112925 None] Volume volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31 (a1a54cfd-b4f9-41fe-94c3-b40351625f31): created successfully
Nov 04 12:22:07 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-4db5fa34-195e-4f4f-bc7a-61dbcb424fa4 tempest-VolumesSnapshotListTestJSON-527112925 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d940f236-5454-4a58-8cf6-d636b0bd54f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:22:07 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-4db5fa34-195e-4f4f-bc7a-61dbcb424fa4 tempest-VolumesSnapshotListTestJSON-527112925 None] Flow 'volume_create_manager' (ac305a4d-dafd-4435-b47e-9860ae1967ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:22:07 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-4db5fa34-195e-4f4f-bc7a-61dbcb424fa4 tempest-VolumesSnapshotListTestJSON-527112925 None] Created volume successfully.
Nov 04 12:22:07 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:DELETE=7,cinder:SELECT=85,cinder:UPDATE=99,cinder:INSERT=23 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:22:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-70970bbe-5b73-4321-856c-82f7abd24ae6 tempest-VolumesSnapshotListTestJSON-527112925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:22:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-70970bbe-5b73-4321-856c-82f7abd24ae6 tempest-VolumesSnapshotListTestJSON-527112925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:22:07 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-70970bbe-5b73-4321-856c-82f7abd24ae6 tempest-VolumesSnapshotListTestJSON-527112925 None] Creating offline snapshot b6a4d183-8512-4e03-8ef2-bf171da291cb of volume a1a54cfd-b4f9-41fe-94c3-b40351625f31 {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:22:07 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e56fdd-57fd-4cd9-ba11-ec372a9293ed]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:22:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-70970bbe-5b73-4321-856c-82f7abd24ae6 tempest-VolumesSnapshotListTestJSON-527112925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:07 devstack sudo[102277]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31
Nov 04 12:22:07 devstack sudo[102277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:07 devstack sudo[102277]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-70970bbe-5b73-4321-856c-82f7abd24ae6 tempest-VolumesSnapshotListTestJSON-527112925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31" returned: 0 in 0.361s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-70970bbe-5b73-4321-856c-82f7abd24ae6 tempest-VolumesSnapshotListTestJSON-527112925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.b6a4d183-8512-4e03-8ef2-bf171da291cb 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:07 devstack sudo[102282]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.b6a4d183-8512-4e03-8ef2-bf171da291cb 1G
Nov 04 12:22:07 devstack sudo[102282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:08 devstack sudo[102282]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-70970bbe-5b73-4321-856c-82f7abd24ae6 tempest-VolumesSnapshotListTestJSON-527112925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.b6a4d183-8512-4e03-8ef2-bf171da291cb 1G" returned: 0 in 0.383s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-70970bbe-5b73-4321-856c-82f7abd24ae6 tempest-VolumesSnapshotListTestJSON-527112925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.b6a4d183-8512-4e03-8ef2-bf171da291cb {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:08 devstack sudo[102287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.b6a4d183-8512-4e03-8ef2-bf171da291cb
Nov 04 12:22:08 devstack sudo[102287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:08 devstack sudo[102287]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-70970bbe-5b73-4321-856c-82f7abd24ae6 tempest-VolumesSnapshotListTestJSON-527112925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.b6a4d183-8512-4e03-8ef2-bf171da291cb" returned: 0 in 0.294s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:08 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-70970bbe-5b73-4321-856c-82f7abd24ae6 tempest-VolumesSnapshotListTestJSON-527112925 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.b6a4d183-8512-4e03-8ef2-bf171da291cb is being set with open permissions: ugo+rw
Nov 04 12:22:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-70970bbe-5b73-4321-856c-82f7abd24ae6 tempest-VolumesSnapshotListTestJSON-527112925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.b6a4d183-8512-4e03-8ef2-bf171da291cb {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:08 devstack sudo[102292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.b6a4d183-8512-4e03-8ef2-bf171da291cb
Nov 04 12:22:08 devstack sudo[102292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:08 devstack sudo[102292]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-70970bbe-5b73-4321-856c-82f7abd24ae6 tempest-VolumesSnapshotListTestJSON-527112925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.b6a4d183-8512-4e03-8ef2-bf171da291cb" returned: 0 in 0.248s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-70970bbe-5b73-4321-856c-82f7abd24ae6 tempest-VolumesSnapshotListTestJSON-527112925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:08 devstack sudo[102295]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.info
Nov 04 12:22:08 devstack sudo[102295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:09 devstack sudo[102295]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-70970bbe-5b73-4321-856c-82f7abd24ae6 tempest-VolumesSnapshotListTestJSON-527112925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.info" returned: 0 in 0.284s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:09 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-70970bbe-5b73-4321-856c-82f7abd24ae6 tempest-VolumesSnapshotListTestJSON-527112925 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.info is being set with open permissions: ugo+rw
Nov 04 12:22:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-70970bbe-5b73-4321-856c-82f7abd24ae6 tempest-VolumesSnapshotListTestJSON-527112925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:09 devstack sudo[102298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.info
Nov 04 12:22:09 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:09 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-70970bbe-5b73-4321-856c-82f7abd24ae6 tempest-VolumesSnapshotListTestJSON-527112925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.info" returned: 0 in 0.264s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-70970bbe-5b73-4321-856c-82f7abd24ae6 tempest-VolumesSnapshotListTestJSON-527112925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.927s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:22:09 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-70970bbe-5b73-4321-856c-82f7abd24ae6 tempest-VolumesSnapshotListTestJSON-527112925 None] Create snapshot completed successfully
Nov 04 12:22:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-32e66ea1-77db-42a5-b00e-775c3f1db004 tempest-VolumesSnapshotListTestJSON-527112925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:22:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-32e66ea1-77db-42a5-b00e-775c3f1db004 tempest-VolumesSnapshotListTestJSON-527112925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:22:09 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-32e66ea1-77db-42a5-b00e-775c3f1db004 tempest-VolumesSnapshotListTestJSON-527112925 None] Creating offline snapshot 17802886-02ba-46db-8d13-755123b271e8 of volume a1a54cfd-b4f9-41fe-94c3-b40351625f31 {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:22:09 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d084ce-c295-47da-962d-a40089a7e93d]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:22:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-32e66ea1-77db-42a5-b00e-775c3f1db004 tempest-VolumesSnapshotListTestJSON-527112925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.b6a4d183-8512-4e03-8ef2-bf171da291cb {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:09 devstack sudo[102301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.b6a4d183-8512-4e03-8ef2-bf171da291cb
Nov 04 12:22:09 devstack sudo[102301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:10 devstack sudo[102301]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-32e66ea1-77db-42a5-b00e-775c3f1db004 tempest-VolumesSnapshotListTestJSON-527112925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.b6a4d183-8512-4e03-8ef2-bf171da291cb" returned: 0 in 0.390s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:10 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-32e66ea1-77db-42a5-b00e-775c3f1db004 tempest-VolumesSnapshotListTestJSON-527112925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:22:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-32e66ea1-77db-42a5-b00e-775c3f1db004 tempest-VolumesSnapshotListTestJSON-527112925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.b6a4d183-8512-4e03-8ef2-bf171da291cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.17802886-02ba-46db-8d13-755123b271e8 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:10 devstack sudo[102306]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.b6a4d183-8512-4e03-8ef2-bf171da291cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.17802886-02ba-46db-8d13-755123b271e8 1G
Nov 04 12:22:10 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:10 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-32e66ea1-77db-42a5-b00e-775c3f1db004 tempest-VolumesSnapshotListTestJSON-527112925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.b6a4d183-8512-4e03-8ef2-bf171da291cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.17802886-02ba-46db-8d13-755123b271e8 1G" returned: 0 in 0.450s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-32e66ea1-77db-42a5-b00e-775c3f1db004 tempest-VolumesSnapshotListTestJSON-527112925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.b6a4d183-8512-4e03-8ef2-bf171da291cb -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.17802886-02ba-46db-8d13-755123b271e8 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:10 devstack sudo[102312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.b6a4d183-8512-4e03-8ef2-bf171da291cb -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.17802886-02ba-46db-8d13-755123b271e8
Nov 04 12:22:10 devstack sudo[102312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:10 devstack sudo[102312]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-32e66ea1-77db-42a5-b00e-775c3f1db004 tempest-VolumesSnapshotListTestJSON-527112925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.b6a4d183-8512-4e03-8ef2-bf171da291cb -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.17802886-02ba-46db-8d13-755123b271e8" returned: 0 in 0.299s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:10 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-32e66ea1-77db-42a5-b00e-775c3f1db004 tempest-VolumesSnapshotListTestJSON-527112925 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.17802886-02ba-46db-8d13-755123b271e8 is being set with open permissions: ugo+rw
Nov 04 12:22:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-32e66ea1-77db-42a5-b00e-775c3f1db004 tempest-VolumesSnapshotListTestJSON-527112925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.17802886-02ba-46db-8d13-755123b271e8 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:10 devstack sudo[102317]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.17802886-02ba-46db-8d13-755123b271e8
Nov 04 12:22:10 devstack sudo[102317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:11 devstack sudo[102317]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-32e66ea1-77db-42a5-b00e-775c3f1db004 tempest-VolumesSnapshotListTestJSON-527112925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.17802886-02ba-46db-8d13-755123b271e8" returned: 0 in 0.252s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-32e66ea1-77db-42a5-b00e-775c3f1db004 tempest-VolumesSnapshotListTestJSON-527112925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.489s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:22:11 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-32e66ea1-77db-42a5-b00e-775c3f1db004 tempest-VolumesSnapshotListTestJSON-527112925 None] Create snapshot completed successfully
Nov 04 12:22:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a28eea57-2058-4d4a-ac57-644e2232da4b tempest-VolumesSnapshotListTestJSON-527112925 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:22:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a28eea57-2058-4d4a-ac57-644e2232da4b tempest-VolumesSnapshotListTestJSON-527112925 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:22:11 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-a28eea57-2058-4d4a-ac57-644e2232da4b tempest-VolumesSnapshotListTestJSON-527112925 None] Creating offline snapshot feaa7293-0526-438f-8475-095aee45afff of volume a1a54cfd-b4f9-41fe-94c3-b40351625f31 {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:22:12 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5aa6710-ed05-4772-97b3-69c6667b4713]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:22:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a28eea57-2058-4d4a-ac57-644e2232da4b tempest-VolumesSnapshotListTestJSON-527112925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.17802886-02ba-46db-8d13-755123b271e8 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:12 devstack sudo[102321]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.17802886-02ba-46db-8d13-755123b271e8
Nov 04 12:22:12 devstack sudo[102321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:12 devstack sudo[102321]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a28eea57-2058-4d4a-ac57-644e2232da4b tempest-VolumesSnapshotListTestJSON-527112925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.17802886-02ba-46db-8d13-755123b271e8" returned: 0 in 0.383s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:12 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-a28eea57-2058-4d4a-ac57-644e2232da4b tempest-VolumesSnapshotListTestJSON-527112925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:22:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a28eea57-2058-4d4a-ac57-644e2232da4b tempest-VolumesSnapshotListTestJSON-527112925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.17802886-02ba-46db-8d13-755123b271e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.feaa7293-0526-438f-8475-095aee45afff 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:12 devstack sudo[102326]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.17802886-02ba-46db-8d13-755123b271e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.feaa7293-0526-438f-8475-095aee45afff 1G
Nov 04 12:22:12 devstack sudo[102326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:12 devstack sudo[102326]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a28eea57-2058-4d4a-ac57-644e2232da4b tempest-VolumesSnapshotListTestJSON-527112925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.17802886-02ba-46db-8d13-755123b271e8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.feaa7293-0526-438f-8475-095aee45afff 1G" returned: 0 in 0.472s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a28eea57-2058-4d4a-ac57-644e2232da4b tempest-VolumesSnapshotListTestJSON-527112925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.17802886-02ba-46db-8d13-755123b271e8 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.feaa7293-0526-438f-8475-095aee45afff {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:12 devstack sudo[102332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.17802886-02ba-46db-8d13-755123b271e8 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.feaa7293-0526-438f-8475-095aee45afff
Nov 04 12:22:12 devstack sudo[102332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:13 devstack sudo[102332]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a28eea57-2058-4d4a-ac57-644e2232da4b tempest-VolumesSnapshotListTestJSON-527112925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.17802886-02ba-46db-8d13-755123b271e8 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.feaa7293-0526-438f-8475-095aee45afff" returned: 0 in 0.306s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:13 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-a28eea57-2058-4d4a-ac57-644e2232da4b tempest-VolumesSnapshotListTestJSON-527112925 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.feaa7293-0526-438f-8475-095aee45afff is being set with open permissions: ugo+rw
Nov 04 12:22:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a28eea57-2058-4d4a-ac57-644e2232da4b tempest-VolumesSnapshotListTestJSON-527112925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.feaa7293-0526-438f-8475-095aee45afff {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:13 devstack sudo[102337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.feaa7293-0526-438f-8475-095aee45afff
Nov 04 12:22:13 devstack sudo[102337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:13 devstack sudo[102337]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a28eea57-2058-4d4a-ac57-644e2232da4b tempest-VolumesSnapshotListTestJSON-527112925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.feaa7293-0526-438f-8475-095aee45afff" returned: 0 in 0.243s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a28eea57-2058-4d4a-ac57-644e2232da4b tempest-VolumesSnapshotListTestJSON-527112925 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.530s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:22:13 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-a28eea57-2058-4d4a-ac57-644e2232da4b tempest-VolumesSnapshotListTestJSON-527112925 None] Create snapshot completed successfully
Nov 04 12:22:14 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c94c49e3-1046-4c42-8437-0dde6c72b407 tempest-VolumesSnapshotListTestJSON-527112925 None] Acquiring lock "cinder-feaa7293-0526-438f-8475-095aee45afff-delete_snapshot" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:22:14 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c94c49e3-1046-4c42-8437-0dde6c72b407 tempest-VolumesSnapshotListTestJSON-527112925 None] Lock "cinder-feaa7293-0526-438f-8475-095aee45afff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:22:14 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c94c49e3-1046-4c42-8437-0dde6c72b407 tempest-VolumesSnapshotListTestJSON-527112925 None] Acquiring lock "cinder-quobyte-a1a54cfd-b4f9-41fe-94c3-b40351625f31" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:22:14 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c94c49e3-1046-4c42-8437-0dde6c72b407 tempest-VolumesSnapshotListTestJSON-527112925 None] Lock "cinder-quobyte-a1a54cfd-b4f9-41fe-94c3-b40351625f31" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:22:14 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c94c49e3-1046-4c42-8437-0dde6c72b407 tempest-VolumesSnapshotListTestJSON-527112925 None] Acquiring lock "cinder-quobyte-feaa7293-0526-438f-8475-095aee45afff" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:22:14 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c94c49e3-1046-4c42-8437-0dde6c72b407 tempest-VolumesSnapshotListTestJSON-527112925 None] Lock "cinder-quobyte-feaa7293-0526-438f-8475-095aee45afff" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:22:14 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-c94c49e3-1046-4c42-8437-0dde6c72b407 tempest-VolumesSnapshotListTestJSON-527112925 None] Deleting offline snapshot feaa7293-0526-438f-8475-095aee45afff of volume a1a54cfd-b4f9-41fe-94c3-b40351625f31 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:22:14 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-c94c49e3-1046-4c42-8437-0dde6c72b407 tempest-VolumesSnapshotListTestJSON-527112925 None] snapshot_file for this snap is: volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.feaa7293-0526-438f-8475-095aee45afff {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:22:14 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b0f779-15c9-4e2d-987a-dea35e5c446f]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:22:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c94c49e3-1046-4c42-8437-0dde6c72b407 tempest-VolumesSnapshotListTestJSON-527112925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.feaa7293-0526-438f-8475-095aee45afff {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:15 devstack sudo[102342]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.feaa7293-0526-438f-8475-095aee45afff
Nov 04 12:22:15 devstack sudo[102342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:15 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d98a4a5-dd18-4af8-a453-dfb4b438453a tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:22:15 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5d98a4a5-dd18-4af8-a453-dfb4b438453a tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Flow 'volume_create_manager' (ceed8dff-2c80-4022-9991-8f205f8f64ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:22:15 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5d98a4a5-dd18-4af8-a453-dfb4b438453a tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac7b5168-34de-4cdf-80b3-cddb4a8929c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:22:15 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5d98a4a5-dd18-4af8-a453-dfb4b438453a tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac7b5168-34de-4cdf-80b3-cddb4a8929c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-816526873',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=001ca110-bf64-4794-9a93-d418796bf384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7914425012964f7b9341c1b6b57d0941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:22:15Z,use_quota=True,user_id='790fe66b6fce451b87e2fba814db59ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:22:15 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5d98a4a5-dd18-4af8-a453-dfb4b438453a tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da767ba5-cc15-4146-9fb6-1d6d119a142b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:22:15 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5d98a4a5-dd18-4af8-a453-dfb4b438453a tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da767ba5-cc15-4146-9fb6-1d6d119a142b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:22:15 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5d98a4a5-dd18-4af8-a453-dfb4b438453a tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed686493-529b-4075-94e6-f0dbd3fd649d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:22:15 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5d98a4a5-dd18-4af8-a453-dfb4b438453a tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed686493-529b-4075-94e6-f0dbd3fd649d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '001ca110-bf64-4794-9a93-d418796bf384', 'volume_name': 'volume-001ca110-bf64-4794-9a93-d418796bf384', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:22:15 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5d98a4a5-dd18-4af8-a453-dfb4b438453a tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a6eeea2-b218-4cf5-9345-7dfeda710a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:22:15 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5d98a4a5-dd18-4af8-a453-dfb4b438453a tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a6eeea2-b218-4cf5-9345-7dfeda710a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:22:15 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5d98a4a5-dd18-4af8-a453-dfb4b438453a tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25af8518-e1ae-4577-b09e-f7e47a0e7432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:22:15 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-5d98a4a5-dd18-4af8-a453-dfb4b438453a tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Volume 001ca110-bf64-4794-9a93-d418796bf384: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-001ca110-bf64-4794-9a93-d418796bf384', 'volume_size': 1}
Nov 04 12:22:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5d98a4a5-dd18-4af8-a453-dfb4b438453a tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:22:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5d98a4a5-dd18-4af8-a453-dfb4b438453a tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:22:15 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5d98a4a5-dd18-4af8-a453-dfb4b438453a tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:22:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-816526873',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=001ca110-bf64-4794-9a93-d418796bf384,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7914425012964f7b9341c1b6b57d0941',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:22:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:22:15Z,use_quota=True,user_id='790fe66b6fce451b87e2fba814db59ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:22:15 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-5d98a4a5-dd18-4af8-a453-dfb4b438453a tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Creating volume 001ca110-bf64-4794-9a93-d418796bf384 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:22:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5d98a4a5-dd18-4af8-a453-dfb4b438453a tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:22:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5d98a4a5-dd18-4af8-a453-dfb4b438453a tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:22:15 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5d98a4a5-dd18-4af8-a453-dfb4b438453a tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:22:15 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5d98a4a5-dd18-4af8-a453-dfb4b438453a tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:22:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5d98a4a5-dd18-4af8-a453-dfb4b438453a tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:22:15 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5d98a4a5-dd18-4af8-a453-dfb4b438453a tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:22:15 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-5d98a4a5-dd18-4af8-a453-dfb4b438453a tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:22:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5d98a4a5-dd18-4af8-a453-dfb4b438453a tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-001ca110-bf64-4794-9a93-d418796bf384 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:15 devstack sudo[102345]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-001ca110-bf64-4794-9a93-d418796bf384 1073741824
Nov 04 12:22:15 devstack sudo[102345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:15 devstack sudo[102342]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c94c49e3-1046-4c42-8437-0dde6c72b407 tempest-VolumesSnapshotListTestJSON-527112925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.feaa7293-0526-438f-8475-095aee45afff" returned: 0 in 0.413s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:15 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-c94c49e3-1046-4c42-8437-0dde6c72b407 tempest-VolumesSnapshotListTestJSON-527112925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:22:15 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa193a81-9aaa-4ff9-89f0-01768425ab46]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:22:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c94c49e3-1046-4c42-8437-0dde6c72b407 tempest-VolumesSnapshotListTestJSON-527112925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.17802886-02ba-46db-8d13-755123b271e8 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:15 devstack sudo[102349]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.17802886-02ba-46db-8d13-755123b271e8
Nov 04 12:22:15 devstack sudo[102349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:15 devstack sudo[102345]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5d98a4a5-dd18-4af8-a453-dfb4b438453a tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-001ca110-bf64-4794-9a93-d418796bf384 1073741824" returned: 0 in 0.435s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5d98a4a5-dd18-4af8-a453-dfb4b438453a tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-001ca110-bf64-4794-9a93-d418796bf384 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:15 devstack sudo[102356]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-001ca110-bf64-4794-9a93-d418796bf384
Nov 04 12:22:15 devstack sudo[102356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:15 devstack sudo[102349]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c94c49e3-1046-4c42-8437-0dde6c72b407 tempest-VolumesSnapshotListTestJSON-527112925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.17802886-02ba-46db-8d13-755123b271e8" returned: 0 in 0.414s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:15 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-c94c49e3-1046-4c42-8437-0dde6c72b407 tempest-VolumesSnapshotListTestJSON-527112925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:22:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c94c49e3-1046-4c42-8437-0dde6c72b407 tempest-VolumesSnapshotListTestJSON-527112925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.feaa7293-0526-438f-8475-095aee45afff {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:15 devstack sudo[102359]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.feaa7293-0526-438f-8475-095aee45afff
Nov 04 12:22:15 devstack sudo[102359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:15 devstack sudo[102356]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5d98a4a5-dd18-4af8-a453-dfb4b438453a tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-001ca110-bf64-4794-9a93-d418796bf384" returned: 0 in 0.268s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:15 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5d98a4a5-dd18-4af8-a453-dfb4b438453a tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:22:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5d98a4a5-dd18-4af8-a453-dfb4b438453a tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:22:16 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5d98a4a5-dd18-4af8-a453-dfb4b438453a tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25af8518-e1ae-4577-b09e-f7e47a0e7432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-001ca110-bf64-4794-9a93-d418796bf384', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:22:16 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5d98a4a5-dd18-4af8-a453-dfb4b438453a tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (676506b1-d0c7-4446-982e-912ca32eddd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:22:16 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-5d98a4a5-dd18-4af8-a453-dfb4b438453a tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Volume volume-001ca110-bf64-4794-9a93-d418796bf384 (001ca110-bf64-4794-9a93-d418796bf384): created successfully
Nov 04 12:22:16 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5d98a4a5-dd18-4af8-a453-dfb4b438453a tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (676506b1-d0c7-4446-982e-912ca32eddd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:22:16 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5d98a4a5-dd18-4af8-a453-dfb4b438453a tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Flow 'volume_create_manager' (ceed8dff-2c80-4022-9991-8f205f8f64ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:22:16 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-5d98a4a5-dd18-4af8-a453-dfb4b438453a tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Created volume successfully.
Nov 04 12:22:16 devstack sudo[102359]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c94c49e3-1046-4c42-8437-0dde6c72b407 tempest-VolumesSnapshotListTestJSON-527112925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.feaa7293-0526-438f-8475-095aee45afff" returned: 0 in 0.481s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c94c49e3-1046-4c42-8437-0dde6c72b407 tempest-VolumesSnapshotListTestJSON-527112925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.feaa7293-0526-438f-8475-095aee45afff {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:16 devstack sudo[102365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.feaa7293-0526-438f-8475-095aee45afff
Nov 04 12:22:16 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:16 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c94c49e3-1046-4c42-8437-0dde6c72b407 tempest-VolumesSnapshotListTestJSON-527112925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.feaa7293-0526-438f-8475-095aee45afff" returned: 0 in 0.280s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:16 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c94c49e3-1046-4c42-8437-0dde6c72b407 tempest-VolumesSnapshotListTestJSON-527112925 None] Lock "cinder-quobyte-feaa7293-0526-438f-8475-095aee45afff" released by "_delete_snapshot" :: held 1.692s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:22:16 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c94c49e3-1046-4c42-8437-0dde6c72b407 tempest-VolumesSnapshotListTestJSON-527112925 None] Lock "cinder-quobyte-a1a54cfd-b4f9-41fe-94c3-b40351625f31" released by "delete_snapshot" :: held 1.717s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:22:16 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-c94c49e3-1046-4c42-8437-0dde6c72b407 tempest-VolumesSnapshotListTestJSON-527112925 None] Created reservations ['d2c5b255-080a-41af-a4e8-2825f254d171', '2b3e143f-a6c1-4b95-b481-3830726e235b', 'd6d9e95b-1da0-4162-90f8-5b1ee1dd9527', '4523104f-c963-4dd8-b513-29bb6f56fbf7'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:22:16 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-c94c49e3-1046-4c42-8437-0dde6c72b407 tempest-VolumesSnapshotListTestJSON-527112925 None] Delete snapshot completed successfully.
Nov 04 12:22:16 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c94c49e3-1046-4c42-8437-0dde6c72b407 tempest-VolumesSnapshotListTestJSON-527112925 None] Lock "cinder-feaa7293-0526-438f-8475-095aee45afff-delete_snapshot" released by "delete_snapshot" :: held 1.890s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:22:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-ae935de9-7b7b-4eb2-894e-8c9a13f7618b req-311de3ac-2c37-4d49-bbb2-1ad64b586fdb tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:22:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-ae935de9-7b7b-4eb2-894e-8c9a13f7618b req-311de3ac-2c37-4d49-bbb2-1ad64b586fdb tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:22:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-ae935de9-7b7b-4eb2-894e-8c9a13f7618b req-311de3ac-2c37-4d49-bbb2-1ad64b586fdb tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:22:16 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-ae935de9-7b7b-4eb2-894e-8c9a13f7618b req-311de3ac-2c37-4d49-bbb2-1ad64b586fdb tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79', 'name': 'volume-001ca110-bf64-4794-9a93-d418796bf384', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b169e467-47af-40be-8c81-e58d09309df4', 'enforce_multipath': True} {{(pid=87169) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 04 12:22:16 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-717b66f1-42ce-442b-ab94-f25dee825e05 tempest-VolumesSnapshotListTestJSON-527112925 None] Acquiring lock "cinder-17802886-02ba-46db-8d13-755123b271e8-delete_snapshot" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:22:17 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-717b66f1-42ce-442b-ab94-f25dee825e05 tempest-VolumesSnapshotListTestJSON-527112925 None] Lock "cinder-17802886-02ba-46db-8d13-755123b271e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:22:17 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-717b66f1-42ce-442b-ab94-f25dee825e05 tempest-VolumesSnapshotListTestJSON-527112925 None] Acquiring lock "cinder-quobyte-a1a54cfd-b4f9-41fe-94c3-b40351625f31" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:22:17 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-717b66f1-42ce-442b-ab94-f25dee825e05 tempest-VolumesSnapshotListTestJSON-527112925 None] Lock "cinder-quobyte-a1a54cfd-b4f9-41fe-94c3-b40351625f31" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:22:17 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-717b66f1-42ce-442b-ab94-f25dee825e05 tempest-VolumesSnapshotListTestJSON-527112925 None] Acquiring lock "cinder-quobyte-17802886-02ba-46db-8d13-755123b271e8" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:22:17 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-717b66f1-42ce-442b-ab94-f25dee825e05 tempest-VolumesSnapshotListTestJSON-527112925 None] Lock "cinder-quobyte-17802886-02ba-46db-8d13-755123b271e8" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:22:17 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-717b66f1-42ce-442b-ab94-f25dee825e05 tempest-VolumesSnapshotListTestJSON-527112925 None] Deleting offline snapshot 17802886-02ba-46db-8d13-755123b271e8 of volume a1a54cfd-b4f9-41fe-94c3-b40351625f31 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:22:17 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-717b66f1-42ce-442b-ab94-f25dee825e05 tempest-VolumesSnapshotListTestJSON-527112925 None] snapshot_file for this snap is: volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.17802886-02ba-46db-8d13-755123b271e8 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:22:17 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-ae935de9-7b7b-4eb2-894e-8c9a13f7618b req-311de3ac-2c37-4d49-bbb2-1ad64b586fdb tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] attachment_update completed successfully.
Nov 04 12:22:17 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02c4f03-1a08-4774-80c1-015ad9b9f918]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:22:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-717b66f1-42ce-442b-ab94-f25dee825e05 tempest-VolumesSnapshotListTestJSON-527112925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.17802886-02ba-46db-8d13-755123b271e8 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:17 devstack sudo[102379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.17802886-02ba-46db-8d13-755123b271e8
Nov 04 12:22:17 devstack sudo[102379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:17 devstack sudo[102379]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-717b66f1-42ce-442b-ab94-f25dee825e05 tempest-VolumesSnapshotListTestJSON-527112925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.17802886-02ba-46db-8d13-755123b271e8" returned: 0 in 0.430s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:17 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-717b66f1-42ce-442b-ab94-f25dee825e05 tempest-VolumesSnapshotListTestJSON-527112925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:22:17 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad428fe-2d9b-4433-9eb4-2287791dd631]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:22:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-717b66f1-42ce-442b-ab94-f25dee825e05 tempest-VolumesSnapshotListTestJSON-527112925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.b6a4d183-8512-4e03-8ef2-bf171da291cb {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:17 devstack sudo[102391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.b6a4d183-8512-4e03-8ef2-bf171da291cb
Nov 04 12:22:17 devstack sudo[102391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:17 devstack sudo[102391]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-717b66f1-42ce-442b-ab94-f25dee825e05 tempest-VolumesSnapshotListTestJSON-527112925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.b6a4d183-8512-4e03-8ef2-bf171da291cb" returned: 0 in 0.413s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:18 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-717b66f1-42ce-442b-ab94-f25dee825e05 tempest-VolumesSnapshotListTestJSON-527112925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:22:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-717b66f1-42ce-442b-ab94-f25dee825e05 tempest-VolumesSnapshotListTestJSON-527112925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.17802886-02ba-46db-8d13-755123b271e8 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:18 devstack sudo[102396]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.17802886-02ba-46db-8d13-755123b271e8
Nov 04 12:22:18 devstack sudo[102396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:18 devstack sudo[102396]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-717b66f1-42ce-442b-ab94-f25dee825e05 tempest-VolumesSnapshotListTestJSON-527112925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.17802886-02ba-46db-8d13-755123b271e8" returned: 0 in 0.432s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-717b66f1-42ce-442b-ab94-f25dee825e05 tempest-VolumesSnapshotListTestJSON-527112925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.17802886-02ba-46db-8d13-755123b271e8 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:18 devstack sudo[102401]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.17802886-02ba-46db-8d13-755123b271e8
Nov 04 12:22:18 devstack sudo[102401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:18 devstack sudo[102401]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-717b66f1-42ce-442b-ab94-f25dee825e05 tempest-VolumesSnapshotListTestJSON-527112925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.17802886-02ba-46db-8d13-755123b271e8" returned: 0 in 0.334s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:18 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-717b66f1-42ce-442b-ab94-f25dee825e05 tempest-VolumesSnapshotListTestJSON-527112925 None] Lock "cinder-quobyte-17802886-02ba-46db-8d13-755123b271e8" released by "_delete_snapshot" :: held 1.767s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:22:18 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-717b66f1-42ce-442b-ab94-f25dee825e05 tempest-VolumesSnapshotListTestJSON-527112925 None] Lock "cinder-quobyte-a1a54cfd-b4f9-41fe-94c3-b40351625f31" released by "delete_snapshot" :: held 1.801s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:22:18 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-717b66f1-42ce-442b-ab94-f25dee825e05 tempest-VolumesSnapshotListTestJSON-527112925 None] Created reservations ['844e7227-22c6-40aa-9c02-ec62e321b2df', 'f5eae08b-38f4-479d-a047-cb8e8637579b', 'fe02312e-6e08-4852-a660-d671181dbfea', 'bcbe48df-4f34-40e0-be71-be726ac25c1f'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:22:19 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-717b66f1-42ce-442b-ab94-f25dee825e05 tempest-VolumesSnapshotListTestJSON-527112925 None] Delete snapshot completed successfully.
Nov 04 12:22:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-717b66f1-42ce-442b-ab94-f25dee825e05 tempest-VolumesSnapshotListTestJSON-527112925 None] Lock "cinder-17802886-02ba-46db-8d13-755123b271e8-delete_snapshot" released by "delete_snapshot" :: held 2.031s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:22:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fc570202-5352-4962-8511-a3c7f4c872ae tempest-VolumesSnapshotListTestJSON-527112925 None] Acquiring lock "cinder-b6a4d183-8512-4e03-8ef2-bf171da291cb-delete_snapshot" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:22:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fc570202-5352-4962-8511-a3c7f4c872ae tempest-VolumesSnapshotListTestJSON-527112925 None] Lock "cinder-b6a4d183-8512-4e03-8ef2-bf171da291cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:22:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fc570202-5352-4962-8511-a3c7f4c872ae tempest-VolumesSnapshotListTestJSON-527112925 None] Acquiring lock "cinder-quobyte-a1a54cfd-b4f9-41fe-94c3-b40351625f31" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:22:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fc570202-5352-4962-8511-a3c7f4c872ae tempest-VolumesSnapshotListTestJSON-527112925 None] Lock "cinder-quobyte-a1a54cfd-b4f9-41fe-94c3-b40351625f31" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:22:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fc570202-5352-4962-8511-a3c7f4c872ae tempest-VolumesSnapshotListTestJSON-527112925 None] Acquiring lock "cinder-quobyte-b6a4d183-8512-4e03-8ef2-bf171da291cb" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:22:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fc570202-5352-4962-8511-a3c7f4c872ae tempest-VolumesSnapshotListTestJSON-527112925 None] Lock "cinder-quobyte-b6a4d183-8512-4e03-8ef2-bf171da291cb" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:22:19 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-fc570202-5352-4962-8511-a3c7f4c872ae tempest-VolumesSnapshotListTestJSON-527112925 None] Deleting offline snapshot b6a4d183-8512-4e03-8ef2-bf171da291cb of volume a1a54cfd-b4f9-41fe-94c3-b40351625f31 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:22:19 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-fc570202-5352-4962-8511-a3c7f4c872ae tempest-VolumesSnapshotListTestJSON-527112925 None] snapshot_file for this snap is: volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.b6a4d183-8512-4e03-8ef2-bf171da291cb {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:22:19 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c23420-c4aa-4be4-92ef-4099417b7f0b]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:22:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fc570202-5352-4962-8511-a3c7f4c872ae tempest-VolumesSnapshotListTestJSON-527112925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.b6a4d183-8512-4e03-8ef2-bf171da291cb {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:19 devstack sudo[102415]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.b6a4d183-8512-4e03-8ef2-bf171da291cb
Nov 04 12:22:19 devstack sudo[102415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:20 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-0817b594-d314-4d48-8c67-9866f6edcfcf req-ec267cfe-56de-461e-971e-eb9b0e90585a tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Terminate volume connection completed successfully.
Nov 04 12:22:20 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-0817b594-d314-4d48-8c67-9866f6edcfcf req-ec267cfe-56de-461e-971e-eb9b0e90585a tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Deleting attachment b169e467-47af-40be-8c81-e58d09309df4. {{(pid=87169) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 12:22:20 devstack sudo[102415]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fc570202-5352-4962-8511-a3c7f4c872ae tempest-VolumesSnapshotListTestJSON-527112925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.b6a4d183-8512-4e03-8ef2-bf171da291cb" returned: 0 in 0.628s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:20 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-fc570202-5352-4962-8511-a3c7f4c872ae tempest-VolumesSnapshotListTestJSON-527112925 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:22:20 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d04e6b6-c0e1-4a78-818c-c41b0c9a6d5c]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:22:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fc570202-5352-4962-8511-a3c7f4c872ae tempest-VolumesSnapshotListTestJSON-527112925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:20 devstack sudo[102434]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31
Nov 04 12:22:20 devstack sudo[102434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:20 devstack sudo[102434]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fc570202-5352-4962-8511-a3c7f4c872ae tempest-VolumesSnapshotListTestJSON-527112925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31" returned: 0 in 0.532s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fc570202-5352-4962-8511-a3c7f4c872ae tempest-VolumesSnapshotListTestJSON-527112925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.b6a4d183-8512-4e03-8ef2-bf171da291cb {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:20 devstack sudo[102441]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.b6a4d183-8512-4e03-8ef2-bf171da291cb
Nov 04 12:22:20 devstack sudo[102441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ddca7478-db58-4817-bec2-1292e2f5ca21 tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Acquiring lock "cinder-001ca110-bf64-4794-9a93-d418796bf384-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:22:20 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-79e98548-cd20-455e-b2af-2ba6c74d993e req-4dae40c7-5d33-49a9-8069-4f43396dc254 tempest-TestShelveInstance-1519749939 None] Terminate volume connection completed successfully.
Nov 04 12:22:20 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-79e98548-cd20-455e-b2af-2ba6c74d993e req-4dae40c7-5d33-49a9-8069-4f43396dc254 tempest-TestShelveInstance-1519749939 None] Deleting attachment 75ec1dbd-c310-47cf-b5fa-3a65e5863da9. {{(pid=87169) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 12:22:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ddca7478-db58-4817-bec2-1292e2f5ca21 tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Lock "cinder-001ca110-bf64-4794-9a93-d418796bf384-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:22:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ddca7478-db58-4817-bec2-1292e2f5ca21 tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Acquiring lock "cinder-quobyte-001ca110-bf64-4794-9a93-d418796bf384" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:22:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ddca7478-db58-4817-bec2-1292e2f5ca21 tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Lock "cinder-quobyte-001ca110-bf64-4794-9a93-d418796bf384" acquired by "delete_volume" :: waited 0.022s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:22:20 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[493aceb4-b233-431f-85b7-5b1f2376b861]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:22:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ddca7478-db58-4817-bec2-1292e2f5ca21 tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-001ca110-bf64-4794-9a93-d418796bf384 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:21 devstack cinder-volume[87169]: DEBUG cinder.coordination [req-79e98548-cd20-455e-b2af-2ba6c74d993e req-1ba3b79c-f5aa-4a9a-b9e4-e93cd274cc3f tempest-TestShelveInstance-1519749939 None] Acquiring lock "cinder-1fef71b7-a8de-409c-b1b9-7d0cef41603a-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:22:21 devstack cinder-volume[87169]: DEBUG cinder.coordination [req-79e98548-cd20-455e-b2af-2ba6c74d993e req-1ba3b79c-f5aa-4a9a-b9e4-e93cd274cc3f tempest-TestShelveInstance-1519749939 None] Lock "cinder-1fef71b7-a8de-409c-b1b9-7d0cef41603a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:22:21 devstack sudo[102444]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-001ca110-bf64-4794-9a93-d418796bf384
Nov 04 12:22:21 devstack sudo[102444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:21 devstack cinder-volume[87169]: DEBUG cinder.coordination [req-79e98548-cd20-455e-b2af-2ba6c74d993e req-1ba3b79c-f5aa-4a9a-b9e4-e93cd274cc3f tempest-TestShelveInstance-1519749939 None] Acquiring lock "cinder-quobyte-1fef71b7-a8de-409c-b1b9-7d0cef41603a" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:22:21 devstack sudo[102441]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fc570202-5352-4962-8511-a3c7f4c872ae tempest-VolumesSnapshotListTestJSON-527112925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.b6a4d183-8512-4e03-8ef2-bf171da291cb" returned: 0 in 0.421s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fc570202-5352-4962-8511-a3c7f4c872ae tempest-VolumesSnapshotListTestJSON-527112925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.b6a4d183-8512-4e03-8ef2-bf171da291cb {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:21 devstack cinder-volume[87169]: DEBUG cinder.coordination [req-79e98548-cd20-455e-b2af-2ba6c74d993e req-1ba3b79c-f5aa-4a9a-b9e4-e93cd274cc3f tempest-TestShelveInstance-1519749939 None] Lock "cinder-quobyte-1fef71b7-a8de-409c-b1b9-7d0cef41603a" acquired by "delete_volume" :: waited 0.031s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:22:21 devstack sudo[102450]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.b6a4d183-8512-4e03-8ef2-bf171da291cb
Nov 04 12:22:21 devstack sudo[102450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:21 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df88e69-04e9-4428-a177-a3c302ffd11e]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:22:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-79e98548-cd20-455e-b2af-2ba6c74d993e req-1ba3b79c-f5aa-4a9a-b9e4-e93cd274cc3f tempest-TestShelveInstance-1519749939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1fef71b7-a8de-409c-b1b9-7d0cef41603a {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:21 devstack sudo[102452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1fef71b7-a8de-409c-b1b9-7d0cef41603a
Nov 04 12:22:21 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:21 devstack sudo[102444]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ddca7478-db58-4817-bec2-1292e2f5ca21 tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-001ca110-bf64-4794-9a93-d418796bf384" returned: 0 in 0.464s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ddca7478-db58-4817-bec2-1292e2f5ca21 tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-001ca110-bf64-4794-9a93-d418796bf384 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:21 devstack sudo[102450]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fc570202-5352-4962-8511-a3c7f4c872ae tempest-VolumesSnapshotListTestJSON-527112925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31.b6a4d183-8512-4e03-8ef2-bf171da291cb" returned: 0 in 0.312s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:21 devstack sudo[102459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-001ca110-bf64-4794-9a93-d418796bf384
Nov 04 12:22:21 devstack sudo[102459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:21 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fc570202-5352-4962-8511-a3c7f4c872ae tempest-VolumesSnapshotListTestJSON-527112925 None] Lock "cinder-quobyte-b6a4d183-8512-4e03-8ef2-bf171da291cb" released by "_delete_snapshot" :: held 2.069s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:22:21 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fc570202-5352-4962-8511-a3c7f4c872ae tempest-VolumesSnapshotListTestJSON-527112925 None] Lock "cinder-quobyte-a1a54cfd-b4f9-41fe-94c3-b40351625f31" released by "delete_snapshot" :: held 2.108s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:22:21 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-fc570202-5352-4962-8511-a3c7f4c872ae tempest-VolumesSnapshotListTestJSON-527112925 None] Created reservations ['4f14b4cb-cfe4-46e9-9f76-f6c2c4111f4c', '6d24ad5e-4ddd-4ead-87ae-ed7c7f2bf2dd', '2a7aaca5-2c5a-4947-b50c-82324bd214cc', '1b40693e-9fd2-48a2-886c-ca9edbd7c447'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:22:21 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-fc570202-5352-4962-8511-a3c7f4c872ae tempest-VolumesSnapshotListTestJSON-527112925 None] Delete snapshot completed successfully.
Nov 04 12:22:21 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:21 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fc570202-5352-4962-8511-a3c7f4c872ae tempest-VolumesSnapshotListTestJSON-527112925 None] Lock "cinder-b6a4d183-8512-4e03-8ef2-bf171da291cb-delete_snapshot" released by "delete_snapshot" :: held 2.326s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:22:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-79e98548-cd20-455e-b2af-2ba6c74d993e req-1ba3b79c-f5aa-4a9a-b9e4-e93cd274cc3f tempest-TestShelveInstance-1519749939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1fef71b7-a8de-409c-b1b9-7d0cef41603a" returned: 0 in 0.496s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-79e98548-cd20-455e-b2af-2ba6c74d993e req-1ba3b79c-f5aa-4a9a-b9e4-e93cd274cc3f tempest-TestShelveInstance-1519749939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1fef71b7-a8de-409c-b1b9-7d0cef41603a {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:21 devstack sudo[102464]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1fef71b7-a8de-409c-b1b9-7d0cef41603a
Nov 04 12:22:21 devstack sudo[102464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:21 devstack sudo[102459]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ddca7478-db58-4817-bec2-1292e2f5ca21 tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-001ca110-bf64-4794-9a93-d418796bf384" returned: 0 in 0.341s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:21 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ddca7478-db58-4817-bec2-1292e2f5ca21 tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Lock "cinder-quobyte-001ca110-bf64-4794-9a93-d418796bf384" released by "delete_volume" :: held 0.861s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:22:21 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-ddca7478-db58-4817-bec2-1292e2f5ca21 tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Created reservations ['75d71c5a-0fb0-465e-a8e4-573281469101', '120eb7f5-b582-40f4-8155-7b28767cdeb6', '21169997-63bf-4391-abd2-1f5c9ea9221b', '08df414c-fa61-4e69-8dfb-a70b66da59d4'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:22:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ddca7478-db58-4817-bec2-1292e2f5ca21 tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:22:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ddca7478-db58-4817-bec2-1292e2f5ca21 tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:22:21 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ddca7478-db58-4817-bec2-1292e2f5ca21 tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:22:21 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ddca7478-db58-4817-bec2-1292e2f5ca21 tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:22:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ddca7478-db58-4817-bec2-1292e2f5ca21 tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:22:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ddca7478-db58-4817-bec2-1292e2f5ca21 tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:21 devstack sudo[102468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:22:21 devstack sudo[102468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:21 devstack sudo[102464]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-79e98548-cd20-455e-b2af-2ba6c74d993e req-1ba3b79c-f5aa-4a9a-b9e4-e93cd274cc3f tempest-TestShelveInstance-1519749939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1fef71b7-a8de-409c-b1b9-7d0cef41603a" returned: 0 in 0.300s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:21 devstack cinder-volume[87169]: DEBUG cinder.coordination [req-79e98548-cd20-455e-b2af-2ba6c74d993e req-1ba3b79c-f5aa-4a9a-b9e4-e93cd274cc3f tempest-TestShelveInstance-1519749939 None] Lock "cinder-quobyte-1fef71b7-a8de-409c-b1b9-7d0cef41603a" released by "delete_volume" :: held 0.856s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:22:22 devstack cinder-volume[87169]: DEBUG cinder.quota [req-79e98548-cd20-455e-b2af-2ba6c74d993e req-1ba3b79c-f5aa-4a9a-b9e4-e93cd274cc3f tempest-TestShelveInstance-1519749939 None] Created reservations ['e9838eff-1de1-4f71-9143-1c18d6568bfc', '6d273902-e1f2-4d1c-b030-63825d043b90', 'ef171f2d-0850-4eb6-a285-1ca75d98a2be', '63f3d9ab-afb0-4f4d-bff5-a962b35ea756'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:22:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-79e98548-cd20-455e-b2af-2ba6c74d993e req-1ba3b79c-f5aa-4a9a-b9e4-e93cd274cc3f tempest-TestShelveInstance-1519749939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:22:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-79e98548-cd20-455e-b2af-2ba6c74d993e req-1ba3b79c-f5aa-4a9a-b9e4-e93cd274cc3f tempest-TestShelveInstance-1519749939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:22:22 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [req-79e98548-cd20-455e-b2af-2ba6c74d993e req-1ba3b79c-f5aa-4a9a-b9e4-e93cd274cc3f tempest-TestShelveInstance-1519749939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:22:22 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [req-79e98548-cd20-455e-b2af-2ba6c74d993e req-1ba3b79c-f5aa-4a9a-b9e4-e93cd274cc3f tempest-TestShelveInstance-1519749939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:22:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-79e98548-cd20-455e-b2af-2ba6c74d993e req-1ba3b79c-f5aa-4a9a-b9e4-e93cd274cc3f tempest-TestShelveInstance-1519749939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:22:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-79e98548-cd20-455e-b2af-2ba6c74d993e req-1ba3b79c-f5aa-4a9a-b9e4-e93cd274cc3f tempest-TestShelveInstance-1519749939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:22 devstack sudo[102471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:22:22 devstack sudo[102471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:22 devstack sudo[102468]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ddca7478-db58-4817-bec2-1292e2f5ca21 tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.329s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:22 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-ddca7478-db58-4817-bec2-1292e2f5ca21 tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:22:22 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-ddca7478-db58-4817-bec2-1292e2f5ca21 tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Deleted volume successfully.
Nov 04 12:22:22 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ddca7478-db58-4817-bec2-1292e2f5ca21 tempest-TestServerVolumeAttachScenarioOldVersion-2092094074 None] Lock "cinder-001ca110-bf64-4794-9a93-d418796bf384-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:22:22 devstack sudo[102471]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [req-79e98548-cd20-455e-b2af-2ba6c74d993e req-1ba3b79c-f5aa-4a9a-b9e4-e93cd274cc3f tempest-TestShelveInstance-1519749939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.330s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:22 devstack cinder-volume[87169]: DEBUG cinder.manager [req-79e98548-cd20-455e-b2af-2ba6c74d993e req-1ba3b79c-f5aa-4a9a-b9e4-e93cd274cc3f tempest-TestShelveInstance-1519749939 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:22:22 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-79e98548-cd20-455e-b2af-2ba6c74d993e req-1ba3b79c-f5aa-4a9a-b9e4-e93cd274cc3f tempest-TestShelveInstance-1519749939 None] Deleted volume successfully.
Nov 04 12:22:22 devstack cinder-volume[87169]: DEBUG cinder.coordination [req-79e98548-cd20-455e-b2af-2ba6c74d993e req-1ba3b79c-f5aa-4a9a-b9e4-e93cd274cc3f tempest-TestShelveInstance-1519749939 None] Lock "cinder-1fef71b7-a8de-409c-b1b9-7d0cef41603a-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:22:22 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-b87de471-7028-483c-9454-f845f4638c5f tempest-VolumesSnapshotListTestJSON-527112925 None] Acquiring lock "cinder-a1a54cfd-b4f9-41fe-94c3-b40351625f31-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:22:22 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-b87de471-7028-483c-9454-f845f4638c5f tempest-VolumesSnapshotListTestJSON-527112925 None] Lock "cinder-a1a54cfd-b4f9-41fe-94c3-b40351625f31-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:22:22 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-b87de471-7028-483c-9454-f845f4638c5f tempest-VolumesSnapshotListTestJSON-527112925 None] Acquiring lock "cinder-quobyte-a1a54cfd-b4f9-41fe-94c3-b40351625f31" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:22:22 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-b87de471-7028-483c-9454-f845f4638c5f tempest-VolumesSnapshotListTestJSON-527112925 None] Lock "cinder-quobyte-a1a54cfd-b4f9-41fe-94c3-b40351625f31" acquired by "delete_volume" :: waited 0.022s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:22:22 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[70099261-6ffa-47b1-9713-a2c9aa729436]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:22:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b87de471-7028-483c-9454-f845f4638c5f tempest-VolumesSnapshotListTestJSON-527112925 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:23 devstack sudo[102492]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31
Nov 04 12:22:23 devstack sudo[102492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:23 devstack sudo[102492]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b87de471-7028-483c-9454-f845f4638c5f tempest-VolumesSnapshotListTestJSON-527112925 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31" returned: 0 in 0.451s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b87de471-7028-483c-9454-f845f4638c5f tempest-VolumesSnapshotListTestJSON-527112925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:23 devstack sudo[102498]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31
Nov 04 12:22:23 devstack sudo[102498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:23 devstack sudo[102498]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b87de471-7028-483c-9454-f845f4638c5f tempest-VolumesSnapshotListTestJSON-527112925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a1a54cfd-b4f9-41fe-94c3-b40351625f31" returned: 0 in 0.295s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:23 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-b87de471-7028-483c-9454-f845f4638c5f tempest-VolumesSnapshotListTestJSON-527112925 None] Lock "cinder-quobyte-a1a54cfd-b4f9-41fe-94c3-b40351625f31" released by "delete_volume" :: held 0.852s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:22:23 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=87,cinder:UPDATE=95,cinder:INSERT=26,cinder:DELETE=8 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:22:23 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-b87de471-7028-483c-9454-f845f4638c5f tempest-VolumesSnapshotListTestJSON-527112925 None] Created reservations ['b5621e48-7839-4fcf-8991-bcce63e02ad5', '9e0e65b4-43cc-47c9-9bc8-0db1961b032d', '6076e214-c8ee-4fa3-a1b3-76424c74b1b8', '950efbfd-5b92-4fcd-b101-77eec1c4ca52'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:22:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b87de471-7028-483c-9454-f845f4638c5f tempest-VolumesSnapshotListTestJSON-527112925 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:22:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b87de471-7028-483c-9454-f845f4638c5f tempest-VolumesSnapshotListTestJSON-527112925 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:22:23 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-b87de471-7028-483c-9454-f845f4638c5f tempest-VolumesSnapshotListTestJSON-527112925 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:22:23 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-b87de471-7028-483c-9454-f845f4638c5f tempest-VolumesSnapshotListTestJSON-527112925 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:22:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b87de471-7028-483c-9454-f845f4638c5f tempest-VolumesSnapshotListTestJSON-527112925 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:22:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b87de471-7028-483c-9454-f845f4638c5f tempest-VolumesSnapshotListTestJSON-527112925 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:23 devstack sudo[102503]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:22:23 devstack sudo[102503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:24 devstack sudo[102503]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b87de471-7028-483c-9454-f845f4638c5f tempest-VolumesSnapshotListTestJSON-527112925 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.400s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:24 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-b87de471-7028-483c-9454-f845f4638c5f tempest-VolumesSnapshotListTestJSON-527112925 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:22:24 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-b87de471-7028-483c-9454-f845f4638c5f tempest-VolumesSnapshotListTestJSON-527112925 None] Deleted volume successfully.
Nov 04 12:22:24 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-b87de471-7028-483c-9454-f845f4638c5f tempest-VolumesSnapshotListTestJSON-527112925 None] Lock "cinder-a1a54cfd-b4f9-41fe-94c3-b40351625f31-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:22:33 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:INSERT=2,cinder:UPDATE=6,cinder:SELECT=2 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:22:34 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=49,cinder:INSERT=12,cinder:UPDATE=49,cinder:DELETE=5 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:22:47 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:22:47 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Flow 'volume_create_manager' (f9ce2996-11a3-469a-9004-3e2580c21790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:22:47 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8811d4c3-45f7-4b7e-9c30-87b3559b3a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:22:47 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8811d4c3-45f7-4b7e-9c30-87b3559b3a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=836c0d5f-81ba-4199-bf6d-677b95c2d392,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38ccdae86a6345a9a357bf220f61717d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:22:47Z,use_quota=True,user_id='559d19172c634f1dadaab8f27b89ab4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c35dfff9-4ed6-488e-bfae-e754c0392621),volume_type_id=c35dfff9-4ed6-488e-bfae-e754c0392621)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:22:47 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73fe949c-175e-4b96-8298-232196f9300b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:22:47 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73fe949c-175e-4b96-8298-232196f9300b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:22:47 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f04ea060-fcbe-4e1c-bdf5-bf56c6921c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:22:47 devstack cinder-volume[87169]: DEBUG cinder.image.glance [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Creating Keystone auth plugin from conf {{(pid=87169) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 04 12:22:47 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f04ea060-fcbe-4e1c-bdf5-bf56c6921c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '836c0d5f-81ba-4199-bf6d-677b95c2d392', 'volume_name': 'volume-836c0d5f-81ba-4199-bf6d-677b95c2d392', 'volume_size': 1, 'image_id': 'b0d30a51-43d4-45d0-96b7-7b50520d0fdb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b0d30a51-43d4-45d0-96b7-7b50520d0fdb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0cab23db5e10c984cfeefe70fc4555eb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '38ccdae86a6345a9a357bf220f61717d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6419117ed989970dcf7636200b129a69e729ee2ed65a4ac7532cea1b252e2faeeae992ebee0dcccae726caeaf2e7daa1a1545d0f5b934486909d475ec3b0a294', 'id': 'b0d30a51-43d4-45d0-96b7-7b50520d0fdb', 'created_at': datetime.datetime(2026, 11, 4, 11, 22, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 22, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b0d30a51-43d4-45d0-96b7-7b50520d0fdb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cc059287b90>}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:22:47 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20e3a5eb-f760-4b0b-a9b1-e2e81fbea6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:22:47 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20e3a5eb-f760-4b0b-a9b1-e2e81fbea6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:22:47 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (514d92bf-597a-45d5-bc19-6aa4776850d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:22:47 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Volume 836c0d5f-81ba-4199-bf6d-677b95c2d392: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-836c0d5f-81ba-4199-bf6d-677b95c2d392', 'volume_size': 1, 'image_id': 'b0d30a51-43d4-45d0-96b7-7b50520d0fdb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b0d30a51-43d4-45d0-96b7-7b50520d0fdb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0cab23db5e10c984cfeefe70fc4555eb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '38ccdae86a6345a9a357bf220f61717d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6419117ed989970dcf7636200b129a69e729ee2ed65a4ac7532cea1b252e2faeeae992ebee0dcccae726caeaf2e7daa1a1545d0f5b934486909d475ec3b0a294', 'id': 'b0d30a51-43d4-45d0-96b7-7b50520d0fdb', 'created_at': datetime.datetime(2026, 11, 4, 11, 22, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 22, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b0d30a51-43d4-45d0-96b7-7b50520d0fdb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cc059287b90>}
Nov 04 12:22:47 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Trying to clone 836c0d5f-81ba-4199-bf6d-677b95c2d392 from image b0d30a51-43d4-45d0-96b7-7b50520d0fdb at location (None, [{'url': 'file:///opt/stack/data/glance/images/b0d30a51-43d4-45d0-96b7-7b50520d0fdb', 'metadata': {}}]). {{(pid=87169) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 04 12:22:47 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b0d30a51-43d4-45d0-96b7-7b50520d0fdb_shgmccgmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87169) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 04 12:22:47 devstack cinder-volume[87169]: INFO cinder.image.image_utils [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Image download 0.00 MB at 0.00 MB/s
Nov 04 12:22:47 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e03c8c7-7368-447c-a365-3f8036af6838]: (4, 'raw') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:22:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d30a51-43d4-45d0-96b7-7b50520d0fdb_shgmccgmdevstack@QuobyteHD {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:48 devstack sudo[102559]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d30a51-43d4-45d0-96b7-7b50520d0fdb_shgmccgmdevstack@QuobyteHD
Nov 04 12:22:48 devstack sudo[102559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:48 devstack sudo[102559]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d30a51-43d4-45d0-96b7-7b50520d0fdb_shgmccgmdevstack@QuobyteHD" returned: 0 in 0.399s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d30a51-43d4-45d0-96b7-7b50520d0fdb_shgmccgmdevstack@QuobyteHD {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:48 devstack sudo[102563]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d30a51-43d4-45d0-96b7-7b50520d0fdb_shgmccgmdevstack@QuobyteHD
Nov 04 12:22:48 devstack sudo[102563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:48 devstack sudo[102563]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d30a51-43d4-45d0-96b7-7b50520d0fdb_shgmccgmdevstack@QuobyteHD" returned: 1 in 0.379s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d30a51-43d4-45d0-96b7-7b50520d0fdb_shgmccgmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 12:22:48 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Temporary image b0d30a51-43d4-45d0-96b7-7b50520d0fdb is fetched for user 559d19172c634f1dadaab8f27b89ab4d. {{(pid=87169) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 04 12:22:48 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c29908-1697-4acc-bab9-d5dd32a5761d]: (4, 'raw') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:22:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d30a51-43d4-45d0-96b7-7b50520d0fdb_shgmccgmdevstack@QuobyteHD {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:48 devstack sudo[102568]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d30a51-43d4-45d0-96b7-7b50520d0fdb_shgmccgmdevstack@QuobyteHD
Nov 04 12:22:48 devstack sudo[102568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:49 devstack sudo[102568]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d30a51-43d4-45d0-96b7-7b50520d0fdb_shgmccgmdevstack@QuobyteHD" returned: 0 in 0.375s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d30a51-43d4-45d0-96b7-7b50520d0fdb_shgmccgmdevstack@QuobyteHD {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:49 devstack sudo[102572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d30a51-43d4-45d0-96b7-7b50520d0fdb_shgmccgmdevstack@QuobyteHD
Nov 04 12:22:49 devstack sudo[102572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:49 devstack sudo[102572]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d30a51-43d4-45d0-96b7-7b50520d0fdb_shgmccgmdevstack@QuobyteHD" returned: 1 in 0.374s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d30a51-43d4-45d0-96b7-7b50520d0fdb_shgmccgmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 12:22:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:22:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:22:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:22:47Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=836c0d5f-81ba-4199-bf6d-677b95c2d392,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38ccdae86a6345a9a357bf220f61717d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:22:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:22:47Z,use_quota=True,user_id='559d19172c634f1dadaab8f27b89ab4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c35dfff9-4ed6-488e-bfae-e754c0392621),volume_type_id=c35dfff9-4ed6-488e-bfae-e754c0392621)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:22:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Creating volume 836c0d5f-81ba-4199-bf6d-677b95c2d392 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:22:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:22:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:22:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:22:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:22:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:22:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:22:49 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:22:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-836c0d5f-81ba-4199-bf6d-677b95c2d392 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:49 devstack sudo[102577]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-836c0d5f-81ba-4199-bf6d-677b95c2d392 1073741824
Nov 04 12:22:49 devstack sudo[102577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:49 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:22:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:22:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:22:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:22:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:22:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:22:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:49 devstack sudo[102581]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:22:49 devstack sudo[102581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:50 devstack sudo[102581]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.357s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:50 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:22:50 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager._thread_info {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:22:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread count: 28 {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 12:22:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread info: [<_MainThread(MainThread, started 137165867425920)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137165754678912)>, <Thread(Thread-3 (stat_writer), started daemon 137165754130752)>, <Thread(Rabbit-heartbeat, started daemon 137165752997504)>, <Thread(Thread-5 (_runner), started daemon 137165753227712)>, <Thread(Thread-7 (_runner), started daemon 137165751273856)>, <Thread(fd_logger, started daemon 137165755322048)>, <Thread(privsep_reader, started daemon 137165748896704)>, <Thread(tpool_thread_0, started daemon 137165742520000)>, <Thread(tpool_thread_1, started daemon 137165734127296)>, <Thread(tpool_thread_2, started daemon 137165725734592)>, <Thread(tpool_thread_3, started daemon 137165717341888)>, <Thread(tpool_thread_4, started daemon 137165708949184)>, <Thread(tpool_thread_5, started daemon 137165700556480)>, <Thread(tpool_thread_6, started daemon 137165692163776)>, <Thread(tpool_thread_7, started daemon 137165683771072)>, <Thread(tpool_thread_8, started daemon 137165675378368)>, <Thread(tpool_thread_9, started daemon 137165666985664)>, <Thread(tpool_thread_10, started daemon 137165658592960)>, <Thread(tpool_thread_11, started daemon 137165650183872)>, <Thread(tpool_thread_12, started daemon 137165641774784)>, <Thread(tpool_thread_13, started daemon 137165633365696)>, <Thread(tpool_thread_14, started daemon 137165624956608)>, <Thread(tpool_thread_15, started daemon 137165616547520)>, <Thread(tpool_thread_16, started daemon 137165608138432)>, <Thread(tpool_thread_17, started daemon 137165599729344)>, <Thread(tpool_thread_18, started daemon 137165591320256)>, <Thread(tpool_thread_19, started daemon 137165582911168)>] {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 12:22:50 devstack sudo[102577]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-836c0d5f-81ba-4199-bf6d-677b95c2d392 1073741824" returned: 0 in 0.687s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-836c0d5f-81ba-4199-bf6d-677b95c2d392 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:50 devstack sudo[102586]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-836c0d5f-81ba-4199-bf6d-677b95c2d392
Nov 04 12:22:50 devstack sudo[102586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:50 devstack sudo[102586]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-836c0d5f-81ba-4199-bf6d-677b95c2d392" returned: 0 in 0.331s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:50 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:22:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:22:50 devstack cinder-volume[87169]: DEBUG cinder.volume.volume_utils [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Attempting download of b0d30a51-43d4-45d0-96b7-7b50520d0fdb ((None, [{'url': 'file:///opt/stack/data/glance/images/b0d30a51-43d4-45d0-96b7-7b50520d0fdb', 'metadata': {}}])) to volume 836c0d5f-81ba-4199-bf6d-677b95c2d392. {{(pid=87169) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 04 12:22:50 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[494f2e75-a6aa-4d0d-af66-1121b9346b45]: (4, 'raw') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:22:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b0d30a51-43d4-45d0-96b7-7b50520d0fdb_go3288ho {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:50 devstack sudo[102589]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b0d30a51-43d4-45d0-96b7-7b50520d0fdb_go3288ho
Nov 04 12:22:50 devstack sudo[102589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:51 devstack sudo[102589]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b0d30a51-43d4-45d0-96b7-7b50520d0fdb_go3288ho" returned: 0 in 0.333s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0d30a51-43d4-45d0-96b7-7b50520d0fdb_go3288ho {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:51 devstack sudo[102593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0d30a51-43d4-45d0-96b7-7b50520d0fdb_go3288ho
Nov 04 12:22:51 devstack sudo[102593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:51 devstack sudo[102593]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0d30a51-43d4-45d0-96b7-7b50520d0fdb_go3288ho" returned: 1 in 0.413s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b0d30a51-43d4-45d0-96b7-7b50520d0fdb_go3288ho' failed. Not Retrying. {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 12:22:51 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[66efbf6d-5bc7-4b15-8ef6-50a5cf36ab94]: (4, 'raw') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:22:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d30a51-43d4-45d0-96b7-7b50520d0fdb_shgmccgmdevstack@QuobyteHD {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:51 devstack sudo[102598]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d30a51-43d4-45d0-96b7-7b50520d0fdb_shgmccgmdevstack@QuobyteHD
Nov 04 12:22:51 devstack sudo[102598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:51 devstack sudo[102598]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d30a51-43d4-45d0-96b7-7b50520d0fdb_shgmccgmdevstack@QuobyteHD" returned: 0 in 0.367s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d30a51-43d4-45d0-96b7-7b50520d0fdb_shgmccgmdevstack@QuobyteHD {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:51 devstack sudo[102602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d30a51-43d4-45d0-96b7-7b50520d0fdb_shgmccgmdevstack@QuobyteHD
Nov 04 12:22:51 devstack sudo[102602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:52 devstack sudo[102602]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d30a51-43d4-45d0-96b7-7b50520d0fdb_shgmccgmdevstack@QuobyteHD" returned: 1 in 0.398s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b0d30a51-43d4-45d0-96b7-7b50520d0fdb_shgmccgmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 12:22:52 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] b0d30a51-43d4-45d0-96b7-7b50520d0fdb was raw, converting to qcow2 {{(pid=87169) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 04 12:22:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b0d30a51-43d4-45d0-96b7-7b50520d0fdb_shgmccgmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-836c0d5f-81ba-4199-bf6d-677b95c2d392 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:52 devstack sudo[102607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b0d30a51-43d4-45d0-96b7-7b50520d0fdb_shgmccgmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-836c0d5f-81ba-4199-bf6d-677b95c2d392
Nov 04 12:22:52 devstack sudo[102607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:52 devstack sudo[102607]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b0d30a51-43d4-45d0-96b7-7b50520d0fdb_shgmccgmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-836c0d5f-81ba-4199-bf6d-677b95c2d392" returned: 0 in 0.661s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:52 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b0d30a51-43d4-45d0-96b7-7b50520d0fdb_shgmccgmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-836c0d5f-81ba-4199-bf6d-677b95c2d392 {{(pid=87169) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 12:22:52 devstack cinder-volume[87169]: INFO cinder.image.image_utils [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Converted 0.00 MB image at 0.00 MB/s
Nov 04 12:22:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-836c0d5f-81ba-4199-bf6d-677b95c2d392 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:52 devstack sudo[102613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-836c0d5f-81ba-4199-bf6d-677b95c2d392 1G
Nov 04 12:22:52 devstack sudo[102613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:53 devstack sudo[102613]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-836c0d5f-81ba-4199-bf6d-677b95c2d392 1G" returned: 0 in 0.416s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:53 devstack cinder-volume[87169]: DEBUG cinder.volume.volume_utils [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Downloaded image b0d30a51-43d4-45d0-96b7-7b50520d0fdb ((None, [{'url': 'file:///opt/stack/data/glance/images/b0d30a51-43d4-45d0-96b7-7b50520d0fdb', 'metadata': {}}])) to volume 836c0d5f-81ba-4199-bf6d-677b95c2d392 successfully. {{(pid=87169) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 04 12:22:53 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Temporary image b0d30a51-43d4-45d0-96b7-7b50520d0fdb for user 559d19172c634f1dadaab8f27b89ab4d is deleted. {{(pid=87169) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 04 12:22:53 devstack cinder-volume[87169]: DEBUG cinder.volume.volume_utils [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Marking volume 836c0d5f-81ba-4199-bf6d-677b95c2d392 as bootable. {{(pid=87169) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 04 12:22:53 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Copying metadata from image b0d30a51-43d4-45d0-96b7-7b50520d0fdb to 836c0d5f-81ba-4199-bf6d-677b95c2d392. {{(pid=87169) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 04 12:22:53 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Creating volume glance metadata for volume 836c0d5f-81ba-4199-bf6d-677b95c2d392 backed by image b0d30a51-43d4-45d0-96b7-7b50520d0fdb with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b0d30a51-43d4-45d0-96b7-7b50520d0fdb', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '0cab23db5e10c984cfeefe70fc4555eb', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87169) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 04 12:22:53 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (514d92bf-597a-45d5-bc19-6aa4776850d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-836c0d5f-81ba-4199-bf6d-677b95c2d392', 'volume_size': 1, 'image_id': 'b0d30a51-43d4-45d0-96b7-7b50520d0fdb', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b0d30a51-43d4-45d0-96b7-7b50520d0fdb', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0cab23db5e10c984cfeefe70fc4555eb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '38ccdae86a6345a9a357bf220f61717d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6419117ed989970dcf7636200b129a69e729ee2ed65a4ac7532cea1b252e2faeeae992ebee0dcccae726caeaf2e7daa1a1545d0f5b934486909d475ec3b0a294', 'id': 'b0d30a51-43d4-45d0-96b7-7b50520d0fdb', 'created_at': datetime.datetime(2026, 11, 4, 11, 22, 45, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 22, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b0d30a51-43d4-45d0-96b7-7b50520d0fdb/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cc059287b90>}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:22:53 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b894c33-e3a8-4156-9c69-6b58b7375959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:22:53 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Volume volume-836c0d5f-81ba-4199-bf6d-677b95c2d392 (836c0d5f-81ba-4199-bf6d-677b95c2d392): created successfully
Nov 04 12:22:53 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b894c33-e3a8-4156-9c69-6b58b7375959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:22:53 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Flow 'volume_create_manager' (f9ce2996-11a3-469a-9004-3e2580c21790) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:22:53 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-77f9dbf2-9a93-4d48-9af5-bc8bfc1b9c75 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Created volume successfully.
Nov 04 12:22:53 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1b10784b-fd38-49e7-911e-fbb0540449e5 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Acquiring lock "cinder-836c0d5f-81ba-4199-bf6d-677b95c2d392-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:22:53 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1b10784b-fd38-49e7-911e-fbb0540449e5 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Lock "cinder-836c0d5f-81ba-4199-bf6d-677b95c2d392-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:22:53 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1b10784b-fd38-49e7-911e-fbb0540449e5 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Acquiring lock "cinder-quobyte-836c0d5f-81ba-4199-bf6d-677b95c2d392" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:22:53 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1b10784b-fd38-49e7-911e-fbb0540449e5 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Lock "cinder-quobyte-836c0d5f-81ba-4199-bf6d-677b95c2d392" acquired by "delete_volume" :: waited 0.019s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:22:53 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f594e11-402b-486b-82b8-7ce8de76205e]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:22:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1b10784b-fd38-49e7-911e-fbb0540449e5 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-836c0d5f-81ba-4199-bf6d-677b95c2d392 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:54 devstack sudo[102619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-836c0d5f-81ba-4199-bf6d-677b95c2d392
Nov 04 12:22:54 devstack sudo[102619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:54 devstack sudo[102619]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1b10784b-fd38-49e7-911e-fbb0540449e5 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-836c0d5f-81ba-4199-bf6d-677b95c2d392" returned: 0 in 0.560s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1b10784b-fd38-49e7-911e-fbb0540449e5 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-836c0d5f-81ba-4199-bf6d-677b95c2d392 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:54 devstack sudo[102624]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-836c0d5f-81ba-4199-bf6d-677b95c2d392
Nov 04 12:22:54 devstack sudo[102624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:54 devstack sudo[102624]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1b10784b-fd38-49e7-911e-fbb0540449e5 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-836c0d5f-81ba-4199-bf6d-677b95c2d392" returned: 0 in 0.318s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:54 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1b10784b-fd38-49e7-911e-fbb0540449e5 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Lock "cinder-quobyte-836c0d5f-81ba-4199-bf6d-677b95c2d392" released by "delete_volume" :: held 0.950s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:22:54 devstack cinder-volume[87169]: WARNING cinder.quota [None req-1b10784b-fd38-49e7-911e-fbb0540449e5 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Nov 04 12:22:54 devstack cinder-volume[87169]: WARNING cinder.quota [None req-1b10784b-fd38-49e7-911e-fbb0540449e5 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota.
Nov 04 12:22:55 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-1b10784b-fd38-49e7-911e-fbb0540449e5 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Created reservations ['a8a152ab-1409-41b4-963d-a706e2e2a5da', 'd229a478-c835-4a04-afb3-d44cb7c28010', '93a51d69-4533-4a6f-97fc-a0719d080fed', '1cbed455-f329-4bd9-aa9e-51779d438c85'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:22:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1b10784b-fd38-49e7-911e-fbb0540449e5 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:22:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1b10784b-fd38-49e7-911e-fbb0540449e5 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:22:55 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1b10784b-fd38-49e7-911e-fbb0540449e5 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:22:55 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1b10784b-fd38-49e7-911e-fbb0540449e5 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:22:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1b10784b-fd38-49e7-911e-fbb0540449e5 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:22:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1b10784b-fd38-49e7-911e-fbb0540449e5 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:55 devstack sudo[102627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:22:55 devstack sudo[102627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:55 devstack sudo[102627]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1b10784b-fd38-49e7-911e-fbb0540449e5 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.342s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:55 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-1b10784b-fd38-49e7-911e-fbb0540449e5 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:22:55 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-1b10784b-fd38-49e7-911e-fbb0540449e5 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Deleted volume successfully.
Nov 04 12:22:55 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1b10784b-fd38-49e7-911e-fbb0540449e5 tempest-VolumeAndVolumeTypeFromImageTest-2066289828 None] Lock "cinder-836c0d5f-81ba-4199-bf6d-677b95c2d392-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:22:57 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-10bfd70c-b505-4a44-9dbd-4da66249a1ce tempest-TestInstancesWithCinderVolumes-486601865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:22:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-10bfd70c-b505-4a44-9dbd-4da66249a1ce tempest-TestInstancesWithCinderVolumes-486601865 None] Flow 'volume_create_manager' (816ab760-ad40-4cd0-8b4c-65b9ed9fca3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:22:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-10bfd70c-b505-4a44-9dbd-4da66249a1ce tempest-TestInstancesWithCinderVolumes-486601865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (792ece6f-4b5b-4a8c-a5c5-dbdbf4c155da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:22:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-10bfd70c-b505-4a44-9dbd-4da66249a1ce tempest-TestInstancesWithCinderVolumes-486601865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (792ece6f-4b5b-4a8c-a5c5-dbdbf4c155da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1949290562',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=972aad9f-d5b2-49a8-b5cf-a4dc524a7e9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f933a599abd8488ebd417eacd17511e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:22:57Z,use_quota=True,user_id='194ae925fde24b9d865b2ec398ce0891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9767b4f9-7089-4621-84b9-4d6009cfd765),volume_type_id=9767b4f9-7089-4621-84b9-4d6009cfd765)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:22:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-10bfd70c-b505-4a44-9dbd-4da66249a1ce tempest-TestInstancesWithCinderVolumes-486601865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e89a5378-9cda-48c5-9c9d-d01e2bb68d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:22:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-10bfd70c-b505-4a44-9dbd-4da66249a1ce tempest-TestInstancesWithCinderVolumes-486601865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e89a5378-9cda-48c5-9c9d-d01e2bb68d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:22:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-10bfd70c-b505-4a44-9dbd-4da66249a1ce tempest-TestInstancesWithCinderVolumes-486601865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5004f272-76ad-4b20-8dc8-0fa2b567da10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:22:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-10bfd70c-b505-4a44-9dbd-4da66249a1ce tempest-TestInstancesWithCinderVolumes-486601865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5004f272-76ad-4b20-8dc8-0fa2b567da10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '972aad9f-d5b2-49a8-b5cf-a4dc524a7e9f', 'volume_name': 'volume-972aad9f-d5b2-49a8-b5cf-a4dc524a7e9f', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:22:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-10bfd70c-b505-4a44-9dbd-4da66249a1ce tempest-TestInstancesWithCinderVolumes-486601865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f7b916a-013f-4e87-b89f-f8502aa317c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:22:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-10bfd70c-b505-4a44-9dbd-4da66249a1ce tempest-TestInstancesWithCinderVolumes-486601865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f7b916a-013f-4e87-b89f-f8502aa317c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:22:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-10bfd70c-b505-4a44-9dbd-4da66249a1ce tempest-TestInstancesWithCinderVolumes-486601865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6022e992-0601-43b6-9a3f-a7569e7b738e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:22:57 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-10bfd70c-b505-4a44-9dbd-4da66249a1ce tempest-TestInstancesWithCinderVolumes-486601865 None] Volume 972aad9f-d5b2-49a8-b5cf-a4dc524a7e9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-972aad9f-d5b2-49a8-b5cf-a4dc524a7e9f', 'volume_size': 1}
Nov 04 12:22:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-10bfd70c-b505-4a44-9dbd-4da66249a1ce tempest-TestInstancesWithCinderVolumes-486601865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:22:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-10bfd70c-b505-4a44-9dbd-4da66249a1ce tempest-TestInstancesWithCinderVolumes-486601865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:22:57 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-10bfd70c-b505-4a44-9dbd-4da66249a1ce tempest-TestInstancesWithCinderVolumes-486601865 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1949290562',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=972aad9f-d5b2-49a8-b5cf-a4dc524a7e9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f933a599abd8488ebd417eacd17511e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:22:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:22:57Z,use_quota=True,user_id='194ae925fde24b9d865b2ec398ce0891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9767b4f9-7089-4621-84b9-4d6009cfd765),volume_type_id=9767b4f9-7089-4621-84b9-4d6009cfd765)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:22:57 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-10bfd70c-b505-4a44-9dbd-4da66249a1ce tempest-TestInstancesWithCinderVolumes-486601865 None] Creating volume 972aad9f-d5b2-49a8-b5cf-a4dc524a7e9f {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:22:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-10bfd70c-b505-4a44-9dbd-4da66249a1ce tempest-TestInstancesWithCinderVolumes-486601865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:22:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-10bfd70c-b505-4a44-9dbd-4da66249a1ce tempest-TestInstancesWithCinderVolumes-486601865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:22:57 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-10bfd70c-b505-4a44-9dbd-4da66249a1ce tempest-TestInstancesWithCinderVolumes-486601865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:22:57 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-10bfd70c-b505-4a44-9dbd-4da66249a1ce tempest-TestInstancesWithCinderVolumes-486601865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:22:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-10bfd70c-b505-4a44-9dbd-4da66249a1ce tempest-TestInstancesWithCinderVolumes-486601865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:22:57 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-10bfd70c-b505-4a44-9dbd-4da66249a1ce tempest-TestInstancesWithCinderVolumes-486601865 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:22:57 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-10bfd70c-b505-4a44-9dbd-4da66249a1ce tempest-TestInstancesWithCinderVolumes-486601865 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:22:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-10bfd70c-b505-4a44-9dbd-4da66249a1ce tempest-TestInstancesWithCinderVolumes-486601865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-972aad9f-d5b2-49a8-b5cf-a4dc524a7e9f 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:57 devstack sudo[102634]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-972aad9f-d5b2-49a8-b5cf-a4dc524a7e9f 1073741824
Nov 04 12:22:57 devstack sudo[102634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:58 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f379097-5174-4f10-a7c8-e30d23663a11 tempest-TestInstancesWithCinderVolumes-486601865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:22:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2f379097-5174-4f10-a7c8-e30d23663a11 tempest-TestInstancesWithCinderVolumes-486601865 None] Flow 'volume_create_manager' (1c3f51ab-c5c4-4e9f-8f54-c1c88685ea4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:22:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2f379097-5174-4f10-a7c8-e30d23663a11 tempest-TestInstancesWithCinderVolumes-486601865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b63dad8-71e3-483b-8ffb-a1c5b7f7c0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:22:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2f379097-5174-4f10-a7c8-e30d23663a11 tempest-TestInstancesWithCinderVolumes-486601865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b63dad8-71e3-483b-8ffb-a1c5b7f7c0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1942561247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=185851ea-a65c-4960-a8be-36b48c4bd4ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f933a599abd8488ebd417eacd17511e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:22:58Z,use_quota=True,user_id='194ae925fde24b9d865b2ec398ce0891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce142ff-9200-4fb3-a23e-2b061b696fe9),volume_type_id=4ce142ff-9200-4fb3-a23e-2b061b696fe9)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:22:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2f379097-5174-4f10-a7c8-e30d23663a11 tempest-TestInstancesWithCinderVolumes-486601865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8730e32f-4145-4425-8333-2c07b5e47fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:22:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2f379097-5174-4f10-a7c8-e30d23663a11 tempest-TestInstancesWithCinderVolumes-486601865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8730e32f-4145-4425-8333-2c07b5e47fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:22:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2f379097-5174-4f10-a7c8-e30d23663a11 tempest-TestInstancesWithCinderVolumes-486601865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57e33e45-6a31-4116-8ddf-6bf8550cbd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:22:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2f379097-5174-4f10-a7c8-e30d23663a11 tempest-TestInstancesWithCinderVolumes-486601865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57e33e45-6a31-4116-8ddf-6bf8550cbd38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '185851ea-a65c-4960-a8be-36b48c4bd4ea', 'volume_name': 'volume-185851ea-a65c-4960-a8be-36b48c4bd4ea', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:22:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2f379097-5174-4f10-a7c8-e30d23663a11 tempest-TestInstancesWithCinderVolumes-486601865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c2919b4-067f-4788-b05f-7bf533c780d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:22:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2f379097-5174-4f10-a7c8-e30d23663a11 tempest-TestInstancesWithCinderVolumes-486601865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c2919b4-067f-4788-b05f-7bf533c780d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:22:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2f379097-5174-4f10-a7c8-e30d23663a11 tempest-TestInstancesWithCinderVolumes-486601865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c377ac0-037c-43d7-90d2-2b077f3a4c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:22:58 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-2f379097-5174-4f10-a7c8-e30d23663a11 tempest-TestInstancesWithCinderVolumes-486601865 None] Volume 185851ea-a65c-4960-a8be-36b48c4bd4ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-185851ea-a65c-4960-a8be-36b48c4bd4ea', 'volume_size': 1}
Nov 04 12:22:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2f379097-5174-4f10-a7c8-e30d23663a11 tempest-TestInstancesWithCinderVolumes-486601865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:22:58 devstack sudo[102634]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-10bfd70c-b505-4a44-9dbd-4da66249a1ce tempest-TestInstancesWithCinderVolumes-486601865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-972aad9f-d5b2-49a8-b5cf-a4dc524a7e9f 1073741824" returned: 0 in 0.699s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-10bfd70c-b505-4a44-9dbd-4da66249a1ce tempest-TestInstancesWithCinderVolumes-486601865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-972aad9f-d5b2-49a8-b5cf-a4dc524a7e9f {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:58 devstack sudo[102640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-972aad9f-d5b2-49a8-b5cf-a4dc524a7e9f
Nov 04 12:22:58 devstack sudo[102640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:58 devstack sudo[102640]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-10bfd70c-b505-4a44-9dbd-4da66249a1ce tempest-TestInstancesWithCinderVolumes-486601865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-972aad9f-d5b2-49a8-b5cf-a4dc524a7e9f" returned: 0 in 0.385s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:58 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-10bfd70c-b505-4a44-9dbd-4da66249a1ce tempest-TestInstancesWithCinderVolumes-486601865 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:22:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-10bfd70c-b505-4a44-9dbd-4da66249a1ce tempest-TestInstancesWithCinderVolumes-486601865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.143s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:22:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2f379097-5174-4f10-a7c8-e30d23663a11 tempest-TestInstancesWithCinderVolumes-486601865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.489s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:22:58 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-2f379097-5174-4f10-a7c8-e30d23663a11 tempest-TestInstancesWithCinderVolumes-486601865 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1942561247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=185851ea-a65c-4960-a8be-36b48c4bd4ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f933a599abd8488ebd417eacd17511e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:22:58Z,use_quota=True,user_id='194ae925fde24b9d865b2ec398ce0891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4ce142ff-9200-4fb3-a23e-2b061b696fe9),volume_type_id=4ce142ff-9200-4fb3-a23e-2b061b696fe9)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:22:58 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-2f379097-5174-4f10-a7c8-e30d23663a11 tempest-TestInstancesWithCinderVolumes-486601865 None] Creating volume 185851ea-a65c-4960-a8be-36b48c4bd4ea {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:22:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2f379097-5174-4f10-a7c8-e30d23663a11 tempest-TestInstancesWithCinderVolumes-486601865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:22:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2f379097-5174-4f10-a7c8-e30d23663a11 tempest-TestInstancesWithCinderVolumes-486601865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:22:58 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-2f379097-5174-4f10-a7c8-e30d23663a11 tempest-TestInstancesWithCinderVolumes-486601865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:22:58 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-2f379097-5174-4f10-a7c8-e30d23663a11 tempest-TestInstancesWithCinderVolumes-486601865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:22:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2f379097-5174-4f10-a7c8-e30d23663a11 tempest-TestInstancesWithCinderVolumes-486601865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:22:58 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-2f379097-5174-4f10-a7c8-e30d23663a11 tempest-TestInstancesWithCinderVolumes-486601865 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:22:58 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-2f379097-5174-4f10-a7c8-e30d23663a11 tempest-TestInstancesWithCinderVolumes-486601865 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:22:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2f379097-5174-4f10-a7c8-e30d23663a11 tempest-TestInstancesWithCinderVolumes-486601865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-185851ea-a65c-4960-a8be-36b48c4bd4ea 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-10bfd70c-b505-4a44-9dbd-4da66249a1ce tempest-TestInstancesWithCinderVolumes-486601865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6022e992-0601-43b6-9a3f-a7569e7b738e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-972aad9f-d5b2-49a8-b5cf-a4dc524a7e9f', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:22:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-10bfd70c-b505-4a44-9dbd-4da66249a1ce tempest-TestInstancesWithCinderVolumes-486601865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d03e44a-a78a-44e6-ab98-095ccf417af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:22:58 devstack sudo[102643]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-185851ea-a65c-4960-a8be-36b48c4bd4ea 1073741824
Nov 04 12:22:58 devstack sudo[102643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:58 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-10bfd70c-b505-4a44-9dbd-4da66249a1ce tempest-TestInstancesWithCinderVolumes-486601865 None] Volume volume-972aad9f-d5b2-49a8-b5cf-a4dc524a7e9f (972aad9f-d5b2-49a8-b5cf-a4dc524a7e9f): created successfully
Nov 04 12:22:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-10bfd70c-b505-4a44-9dbd-4da66249a1ce tempest-TestInstancesWithCinderVolumes-486601865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d03e44a-a78a-44e6-ab98-095ccf417af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:22:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-10bfd70c-b505-4a44-9dbd-4da66249a1ce tempest-TestInstancesWithCinderVolumes-486601865 None] Flow 'volume_create_manager' (816ab760-ad40-4cd0-8b4c-65b9ed9fca3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:22:58 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-10bfd70c-b505-4a44-9dbd-4da66249a1ce tempest-TestInstancesWithCinderVolumes-486601865 None] Created volume successfully.
Nov 04 12:22:59 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:22:59 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Flow 'volume_create_manager' (8bd21ef8-fab0-4a3d-9ec9-810b549cac73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:22:59 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (907bc303-29ba-441b-9773-6b7ba6a310e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:22:59 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (907bc303-29ba-441b-9773-6b7ba6a310e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1875601722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2f091b0-c147-400d-95c3-37959961171a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f933a599abd8488ebd417eacd17511e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:22:59Z,use_quota=True,user_id='194ae925fde24b9d865b2ec398ce0891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721d21ce-0964-450d-8275-66249e6ca9fd),volume_type_id=721d21ce-0964-450d-8275-66249e6ca9fd)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:22:59 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c1793b8-6dee-4761-88b4-df2edc3dd8ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:22:59 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c1793b8-6dee-4761-88b4-df2edc3dd8ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:22:59 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3348927e-1f1d-474b-ae0a-aee3d1cf6599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:22:59 devstack cinder-volume[87169]: DEBUG cinder.image.glance [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Creating Keystone auth plugin from conf {{(pid=87169) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 04 12:22:59 devstack sudo[102643]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2f379097-5174-4f10-a7c8-e30d23663a11 tempest-TestInstancesWithCinderVolumes-486601865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-185851ea-a65c-4960-a8be-36b48c4bd4ea 1073741824" returned: 0 in 0.677s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2f379097-5174-4f10-a7c8-e30d23663a11 tempest-TestInstancesWithCinderVolumes-486601865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-185851ea-a65c-4960-a8be-36b48c4bd4ea {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:22:59 devstack sudo[102649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-185851ea-a65c-4960-a8be-36b48c4bd4ea
Nov 04 12:22:59 devstack sudo[102649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:22:59 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3348927e-1f1d-474b-ae0a-aee3d1cf6599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a2f091b0-c147-400d-95c3-37959961171a', 'volume_name': 'volume-a2f091b0-c147-400d-95c3-37959961171a', 'volume_size': 1, 'image_id': '9a830b12-21e6-4363-af24-7175af66a541', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9a830b12-21e6-4363-af24-7175af66a541', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--966385713', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f933a599abd8488ebd417eacd17511e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9a830b12-21e6-4363-af24-7175af66a541', 'created_at': datetime.datetime(2026, 11, 4, 11, 22, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 22, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9a830b12-21e6-4363-af24-7175af66a541/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cc059536720>}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:22:59 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a43b8fd-33ca-4e63-9a00-e91f96c7ee6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:22:59 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a43b8fd-33ca-4e63-9a00-e91f96c7ee6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:22:59 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0257ab4-d53e-4035-a8dd-09c12ebd1120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:22:59 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Volume a2f091b0-c147-400d-95c3-37959961171a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a2f091b0-c147-400d-95c3-37959961171a', 'volume_size': 1, 'image_id': '9a830b12-21e6-4363-af24-7175af66a541', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9a830b12-21e6-4363-af24-7175af66a541', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--966385713', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f933a599abd8488ebd417eacd17511e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9a830b12-21e6-4363-af24-7175af66a541', 'created_at': datetime.datetime(2026, 11, 4, 11, 22, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 22, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9a830b12-21e6-4363-af24-7175af66a541/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cc059536720>}
Nov 04 12:22:59 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Trying to clone a2f091b0-c147-400d-95c3-37959961171a from image 9a830b12-21e6-4363-af24-7175af66a541 at location (None, [{'url': 'file:///opt/stack/data/glance/images/9a830b12-21e6-4363-af24-7175af66a541', 'metadata': {}}]). {{(pid=87169) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 04 12:22:59 devstack sudo[102649]: pam_unix(sudo:session): session closed for user root
Nov 04 12:22:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2f379097-5174-4f10-a7c8-e30d23663a11 tempest-TestInstancesWithCinderVolumes-486601865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-185851ea-a65c-4960-a8be-36b48c4bd4ea" returned: 0 in 0.398s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:22:59 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-2f379097-5174-4f10-a7c8-e30d23663a11 tempest-TestInstancesWithCinderVolumes-486601865 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:22:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2f379097-5174-4f10-a7c8-e30d23663a11 tempest-TestInstancesWithCinderVolumes-486601865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.153s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:22:59 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2f379097-5174-4f10-a7c8-e30d23663a11 tempest-TestInstancesWithCinderVolumes-486601865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c377ac0-037c-43d7-90d2-2b077f3a4c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-185851ea-a65c-4960-a8be-36b48c4bd4ea', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:23:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2f379097-5174-4f10-a7c8-e30d23663a11 tempest-TestInstancesWithCinderVolumes-486601865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32dec09e-0766-4722-afd1-607995d76f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:23:00 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-2f379097-5174-4f10-a7c8-e30d23663a11 tempest-TestInstancesWithCinderVolumes-486601865 None] Volume volume-185851ea-a65c-4960-a8be-36b48c4bd4ea (185851ea-a65c-4960-a8be-36b48c4bd4ea): created successfully
Nov 04 12:23:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2f379097-5174-4f10-a7c8-e30d23663a11 tempest-TestInstancesWithCinderVolumes-486601865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32dec09e-0766-4722-afd1-607995d76f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:23:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2f379097-5174-4f10-a7c8-e30d23663a11 tempest-TestInstancesWithCinderVolumes-486601865 None] Flow 'volume_create_manager' (1c3f51ab-c5c4-4e9f-8f54-c1c88685ea4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:23:00 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-2f379097-5174-4f10-a7c8-e30d23663a11 tempest-TestInstancesWithCinderVolumes-486601865 None] Created volume successfully.
Nov 04 12:23:03 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-8962f4ca-1764-4173-bdbc-a41b5fff46fa tempest-ProjectReaderTests-1954870305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:23:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8962f4ca-1764-4173-bdbc-a41b5fff46fa tempest-ProjectReaderTests-1954870305 None] Flow 'volume_create_manager' (8066a5d1-4c7c-4af9-85b5-8cf212146a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:23:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8962f4ca-1764-4173-bdbc-a41b5fff46fa tempest-ProjectReaderTests-1954870305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c8d39c8-2fde-45be-acb3-811d76a60bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:23:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8962f4ca-1764-4173-bdbc-a41b5fff46fa tempest-ProjectReaderTests-1954870305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c8d39c8-2fde-45be-acb3-811d76a60bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1944914196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=680a5910-08e5-474d-8ceb-6371f3231fa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb91a58188424400925f0d4fcab76123',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:23:03Z,use_quota=True,user_id='d0f2ba3f67894b48b22e9cd5f082808c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:23:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8962f4ca-1764-4173-bdbc-a41b5fff46fa tempest-ProjectReaderTests-1954870305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9363f494-a8de-4e49-b558-d51d566c022d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:23:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8962f4ca-1764-4173-bdbc-a41b5fff46fa tempest-ProjectReaderTests-1954870305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9363f494-a8de-4e49-b558-d51d566c022d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:23:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8962f4ca-1764-4173-bdbc-a41b5fff46fa tempest-ProjectReaderTests-1954870305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cade1dae-4c96-4b41-97dc-3271e6a36638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:23:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8962f4ca-1764-4173-bdbc-a41b5fff46fa tempest-ProjectReaderTests-1954870305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cade1dae-4c96-4b41-97dc-3271e6a36638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '680a5910-08e5-474d-8ceb-6371f3231fa4', 'volume_name': 'volume-680a5910-08e5-474d-8ceb-6371f3231fa4', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:23:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8962f4ca-1764-4173-bdbc-a41b5fff46fa tempest-ProjectReaderTests-1954870305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e528364e-3c53-4bf3-98dc-5154eec4507f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:23:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8962f4ca-1764-4173-bdbc-a41b5fff46fa tempest-ProjectReaderTests-1954870305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e528364e-3c53-4bf3-98dc-5154eec4507f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:23:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8962f4ca-1764-4173-bdbc-a41b5fff46fa tempest-ProjectReaderTests-1954870305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6812b54a-dabb-4141-80db-d81d3be7860c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:23:03 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-8962f4ca-1764-4173-bdbc-a41b5fff46fa tempest-ProjectReaderTests-1954870305 None] Volume 680a5910-08e5-474d-8ceb-6371f3231fa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-680a5910-08e5-474d-8ceb-6371f3231fa4', 'volume_size': 1}
Nov 04 12:23:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8962f4ca-1764-4173-bdbc-a41b5fff46fa tempest-ProjectReaderTests-1954870305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:23:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8962f4ca-1764-4173-bdbc-a41b5fff46fa tempest-ProjectReaderTests-1954870305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:23:03 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-8962f4ca-1764-4173-bdbc-a41b5fff46fa tempest-ProjectReaderTests-1954870305 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:23:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1944914196',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=680a5910-08e5-474d-8ceb-6371f3231fa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb91a58188424400925f0d4fcab76123',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:23:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:23:03Z,use_quota=True,user_id='d0f2ba3f67894b48b22e9cd5f082808c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:23:03 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-8962f4ca-1764-4173-bdbc-a41b5fff46fa tempest-ProjectReaderTests-1954870305 None] Creating volume 680a5910-08e5-474d-8ceb-6371f3231fa4 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:23:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8962f4ca-1764-4173-bdbc-a41b5fff46fa tempest-ProjectReaderTests-1954870305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:23:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8962f4ca-1764-4173-bdbc-a41b5fff46fa tempest-ProjectReaderTests-1954870305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:23:03 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-8962f4ca-1764-4173-bdbc-a41b5fff46fa tempest-ProjectReaderTests-1954870305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:23:03 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-8962f4ca-1764-4173-bdbc-a41b5fff46fa tempest-ProjectReaderTests-1954870305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:23:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8962f4ca-1764-4173-bdbc-a41b5fff46fa tempest-ProjectReaderTests-1954870305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:23:03 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-8962f4ca-1764-4173-bdbc-a41b5fff46fa tempest-ProjectReaderTests-1954870305 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:23:03 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-8962f4ca-1764-4173-bdbc-a41b5fff46fa tempest-ProjectReaderTests-1954870305 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:23:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8962f4ca-1764-4173-bdbc-a41b5fff46fa tempest-ProjectReaderTests-1954870305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-680a5910-08e5-474d-8ceb-6371f3231fa4 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:23:03 devstack sudo[102653]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-680a5910-08e5-474d-8ceb-6371f3231fa4 1073741824
Nov 04 12:23:03 devstack sudo[102653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:23:04 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9a830b12-21e6-4363-af24-7175af66a541_6oqkqbzzdevstack@QuobyteHD, size 20.69 MB, duration 4.26 sec {{(pid=87169) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 04 12:23:04 devstack cinder-volume[87169]: INFO cinder.image.image_utils [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Image download 20.69 MB at 4.85 MB/s
Nov 04 12:23:04 devstack sudo[102653]: pam_unix(sudo:session): session closed for user root
Nov 04 12:23:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8962f4ca-1764-4173-bdbc-a41b5fff46fa tempest-ProjectReaderTests-1954870305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-680a5910-08e5-474d-8ceb-6371f3231fa4 1073741824" returned: 0 in 0.702s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:23:04 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[28250c56-8d43-4551-9bcd-d9df370c7e1c]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:23:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a830b12-21e6-4363-af24-7175af66a541_6oqkqbzzdevstack@QuobyteHD {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:23:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8962f4ca-1764-4173-bdbc-a41b5fff46fa tempest-ProjectReaderTests-1954870305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-680a5910-08e5-474d-8ceb-6371f3231fa4 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:23:04 devstack sudo[102663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-680a5910-08e5-474d-8ceb-6371f3231fa4
Nov 04 12:23:04 devstack sudo[102663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:23:04 devstack sudo[102662]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a830b12-21e6-4363-af24-7175af66a541_6oqkqbzzdevstack@QuobyteHD
Nov 04 12:23:04 devstack sudo[102662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:23:04 devstack sudo[102662]: pam_unix(sudo:session): session closed for user root
Nov 04 12:23:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a830b12-21e6-4363-af24-7175af66a541_6oqkqbzzdevstack@QuobyteHD" returned: 0 in 0.442s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:23:04 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Temporary image 9a830b12-21e6-4363-af24-7175af66a541 is fetched for user 194ae925fde24b9d865b2ec398ce0891. {{(pid=87169) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 04 12:23:04 devstack sudo[102663]: pam_unix(sudo:session): session closed for user root
Nov 04 12:23:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8962f4ca-1764-4173-bdbc-a41b5fff46fa tempest-ProjectReaderTests-1954870305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-680a5910-08e5-474d-8ceb-6371f3231fa4" returned: 0 in 0.454s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:23:04 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-8962f4ca-1764-4173-bdbc-a41b5fff46fa tempest-ProjectReaderTests-1954870305 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:23:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8962f4ca-1764-4173-bdbc-a41b5fff46fa tempest-ProjectReaderTests-1954870305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.279s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:23:04 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8962f4ca-1764-4173-bdbc-a41b5fff46fa tempest-ProjectReaderTests-1954870305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6812b54a-dabb-4141-80db-d81d3be7860c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-680a5910-08e5-474d-8ceb-6371f3231fa4', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:23:04 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8962f4ca-1764-4173-bdbc-a41b5fff46fa tempest-ProjectReaderTests-1954870305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b649523c-93c7-4152-90d0-3766f2a82055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:23:04 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-8962f4ca-1764-4173-bdbc-a41b5fff46fa tempest-ProjectReaderTests-1954870305 None] Volume volume-680a5910-08e5-474d-8ceb-6371f3231fa4 (680a5910-08e5-474d-8ceb-6371f3231fa4): created successfully
Nov 04 12:23:04 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8962f4ca-1764-4173-bdbc-a41b5fff46fa tempest-ProjectReaderTests-1954870305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b649523c-93c7-4152-90d0-3766f2a82055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:23:04 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8962f4ca-1764-4173-bdbc-a41b5fff46fa tempest-ProjectReaderTests-1954870305 None] Flow 'volume_create_manager' (8066a5d1-4c7c-4af9-85b5-8cf212146a16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:23:04 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18611d1-afc4-432f-8a29-c18a5a5ec872]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:23:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a830b12-21e6-4363-af24-7175af66a541_6oqkqbzzdevstack@QuobyteHD {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:23:04 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-8962f4ca-1764-4173-bdbc-a41b5fff46fa tempest-ProjectReaderTests-1954870305 None] Created volume successfully.
Nov 04 12:23:04 devstack sudo[102670]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a830b12-21e6-4363-af24-7175af66a541_6oqkqbzzdevstack@QuobyteHD
Nov 04 12:23:04 devstack sudo[102670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:23:05 devstack sudo[102670]: pam_unix(sudo:session): session closed for user root
Nov 04 12:23:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a830b12-21e6-4363-af24-7175af66a541_6oqkqbzzdevstack@QuobyteHD" returned: 0 in 0.394s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:23:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:23:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:23:05 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:22:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1875601722',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2f091b0-c147-400d-95c3-37959961171a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f933a599abd8488ebd417eacd17511e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:22:59Z,use_quota=True,user_id='194ae925fde24b9d865b2ec398ce0891',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(721d21ce-0964-450d-8275-66249e6ca9fd),volume_type_id=721d21ce-0964-450d-8275-66249e6ca9fd)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:23:05 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Creating volume a2f091b0-c147-400d-95c3-37959961171a {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:23:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:23:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:23:05 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:23:05 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:23:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:23:05 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:23:05 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:23:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a2f091b0-c147-400d-95c3-37959961171a 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:23:05 devstack sudo[102675]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a2f091b0-c147-400d-95c3-37959961171a 1073741824
Nov 04 12:23:05 devstack sudo[102675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:23:05 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3884f8a6-f043-4718-8622-ee1b276bb066 tempest-ProjectReaderTests-1954870305 None] Acquiring lock "cinder-680a5910-08e5-474d-8ceb-6371f3231fa4-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:23:05 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3884f8a6-f043-4718-8622-ee1b276bb066 tempest-ProjectReaderTests-1954870305 None] Lock "cinder-680a5910-08e5-474d-8ceb-6371f3231fa4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:23:05 devstack sudo[102675]: pam_unix(sudo:session): session closed for user root
Nov 04 12:23:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a2f091b0-c147-400d-95c3-37959961171a 1073741824" returned: 0 in 0.568s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:23:05 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3884f8a6-f043-4718-8622-ee1b276bb066 tempest-ProjectReaderTests-1954870305 None] Acquiring lock "cinder-quobyte-680a5910-08e5-474d-8ceb-6371f3231fa4" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:23:05 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3884f8a6-f043-4718-8622-ee1b276bb066 tempest-ProjectReaderTests-1954870305 None] Lock "cinder-quobyte-680a5910-08e5-474d-8ceb-6371f3231fa4" acquired by "delete_volume" :: waited 0.032s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:23:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a2f091b0-c147-400d-95c3-37959961171a {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:23:05 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e00b9a6-b2ab-48be-b505-4813ccfaa4da]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:23:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3884f8a6-f043-4718-8622-ee1b276bb066 tempest-ProjectReaderTests-1954870305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-680a5910-08e5-474d-8ceb-6371f3231fa4 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:23:05 devstack sudo[102681]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a2f091b0-c147-400d-95c3-37959961171a
Nov 04 12:23:05 devstack sudo[102681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:23:06 devstack sudo[102682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-680a5910-08e5-474d-8ceb-6371f3231fa4
Nov 04 12:23:06 devstack sudo[102682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:23:06 devstack sudo[102681]: pam_unix(sudo:session): session closed for user root
Nov 04 12:23:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a2f091b0-c147-400d-95c3-37959961171a" returned: 0 in 0.300s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:23:06 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:23:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:23:06 devstack cinder-volume[87169]: DEBUG cinder.volume.volume_utils [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Attempting download of 9a830b12-21e6-4363-af24-7175af66a541 ((None, [{'url': 'file:///opt/stack/data/glance/images/9a830b12-21e6-4363-af24-7175af66a541', 'metadata': {}}])) to volume a2f091b0-c147-400d-95c3-37959961171a. {{(pid=87169) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 04 12:23:06 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe9cda8-90e8-42d8-8d79-56d715755fa7]: (4, 'raw') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:23:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9a830b12-21e6-4363-af24-7175af66a541_xrx2rtxd {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:23:06 devstack sudo[102682]: pam_unix(sudo:session): session closed for user root
Nov 04 12:23:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3884f8a6-f043-4718-8622-ee1b276bb066 tempest-ProjectReaderTests-1954870305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-680a5910-08e5-474d-8ceb-6371f3231fa4" returned: 0 in 0.484s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:23:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3884f8a6-f043-4718-8622-ee1b276bb066 tempest-ProjectReaderTests-1954870305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-680a5910-08e5-474d-8ceb-6371f3231fa4 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:23:06 devstack sudo[102690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-680a5910-08e5-474d-8ceb-6371f3231fa4
Nov 04 12:23:06 devstack sudo[102690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:23:06 devstack sudo[102688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9a830b12-21e6-4363-af24-7175af66a541_xrx2rtxd
Nov 04 12:23:06 devstack sudo[102688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:23:06 devstack sudo[102690]: pam_unix(sudo:session): session closed for user root
Nov 04 12:23:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3884f8a6-f043-4718-8622-ee1b276bb066 tempest-ProjectReaderTests-1954870305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-680a5910-08e5-474d-8ceb-6371f3231fa4" returned: 0 in 0.312s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:23:06 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3884f8a6-f043-4718-8622-ee1b276bb066 tempest-ProjectReaderTests-1954870305 None] Lock "cinder-quobyte-680a5910-08e5-474d-8ceb-6371f3231fa4" released by "delete_volume" :: held 0.888s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:23:06 devstack sudo[102688]: pam_unix(sudo:session): session closed for user root
Nov 04 12:23:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9a830b12-21e6-4363-af24-7175af66a541_xrx2rtxd" returned: 0 in 0.485s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:23:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a830b12-21e6-4363-af24-7175af66a541_xrx2rtxd {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:23:06 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-3884f8a6-f043-4718-8622-ee1b276bb066 tempest-ProjectReaderTests-1954870305 None] Created reservations ['8291c6b0-fe7d-4abf-a874-a2d4fa878250', '009a1cc0-8ef3-4843-a999-de7e26327aa1', 'c4706a31-1b31-4cdc-baff-a871e5af7f0f', 'baea2465-7f99-463b-b7ed-b5677cc2645c'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:23:06 devstack sudo[102696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a830b12-21e6-4363-af24-7175af66a541_xrx2rtxd
Nov 04 12:23:06 devstack sudo[102696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:23:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3884f8a6-f043-4718-8622-ee1b276bb066 tempest-ProjectReaderTests-1954870305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:23:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3884f8a6-f043-4718-8622-ee1b276bb066 tempest-ProjectReaderTests-1954870305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:23:07 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3884f8a6-f043-4718-8622-ee1b276bb066 tempest-ProjectReaderTests-1954870305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:23:07 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3884f8a6-f043-4718-8622-ee1b276bb066 tempest-ProjectReaderTests-1954870305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:23:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3884f8a6-f043-4718-8622-ee1b276bb066 tempest-ProjectReaderTests-1954870305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:23:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3884f8a6-f043-4718-8622-ee1b276bb066 tempest-ProjectReaderTests-1954870305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:23:07 devstack sudo[102698]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:23:07 devstack sudo[102698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:23:07 devstack sudo[102696]: pam_unix(sudo:session): session closed for user root
Nov 04 12:23:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a830b12-21e6-4363-af24-7175af66a541_xrx2rtxd" returned: 1 in 0.505s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:23:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9a830b12-21e6-4363-af24-7175af66a541_xrx2rtxd' failed. Not Retrying. {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 12:23:07 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bef375b-0838-4283-8307-b3a7a8999553]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:23:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a830b12-21e6-4363-af24-7175af66a541_6oqkqbzzdevstack@QuobyteHD {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:23:07 devstack sudo[102698]: pam_unix(sudo:session): session closed for user root
Nov 04 12:23:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3884f8a6-f043-4718-8622-ee1b276bb066 tempest-ProjectReaderTests-1954870305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.304s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:23:07 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-3884f8a6-f043-4718-8622-ee1b276bb066 tempest-ProjectReaderTests-1954870305 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:23:07 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-3884f8a6-f043-4718-8622-ee1b276bb066 tempest-ProjectReaderTests-1954870305 None] Deleted volume successfully.
Nov 04 12:23:07 devstack sudo[102702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a830b12-21e6-4363-af24-7175af66a541_6oqkqbzzdevstack@QuobyteHD
Nov 04 12:23:07 devstack sudo[102702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:23:07 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3884f8a6-f043-4718-8622-ee1b276bb066 tempest-ProjectReaderTests-1954870305 None] Lock "cinder-680a5910-08e5-474d-8ceb-6371f3231fa4-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:23:07 devstack sudo[102702]: pam_unix(sudo:session): session closed for user root
Nov 04 12:23:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_9a830b12-21e6-4363-af24-7175af66a541_6oqkqbzzdevstack@QuobyteHD" returned: 0 in 0.382s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:23:07 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] 9a830b12-21e6-4363-af24-7175af66a541 was qcow2, converting to qcow2 {{(pid=87169) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 04 12:23:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9a830b12-21e6-4363-af24-7175af66a541_6oqkqbzzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a2f091b0-c147-400d-95c3-37959961171a {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:23:07 devstack sudo[102708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9a830b12-21e6-4363-af24-7175af66a541_6oqkqbzzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a2f091b0-c147-400d-95c3-37959961171a
Nov 04 12:23:07 devstack sudo[102708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:23:08 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc3bd324-e823-4df6-8225-e8691a9b94f6 tempest-TestServerVolumeAttachmentScenario-279157639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:23:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bc3bd324-e823-4df6-8225-e8691a9b94f6 tempest-TestServerVolumeAttachmentScenario-279157639 None] Flow 'volume_create_manager' (56844591-67af-4a1d-9e21-0641c832a5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:23:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bc3bd324-e823-4df6-8225-e8691a9b94f6 tempest-TestServerVolumeAttachmentScenario-279157639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5062e2cd-f422-44c0-bc5d-cc2f7fcba682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:23:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bc3bd324-e823-4df6-8225-e8691a9b94f6 tempest-TestServerVolumeAttachmentScenario-279157639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5062e2cd-f422-44c0-bc5d-cc2f7fcba682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1744475889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1534476b-4053-43db-84a4-45547eb43aa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98dff01e98fd423a9cfcb3a9184e0bc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:23:08Z,use_quota=True,user_id='38ee4b403aba47b6a089c37bf5018201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:23:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bc3bd324-e823-4df6-8225-e8691a9b94f6 tempest-TestServerVolumeAttachmentScenario-279157639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4795e0ff-f5c9-44aa-b564-048c8bff0279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:23:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bc3bd324-e823-4df6-8225-e8691a9b94f6 tempest-TestServerVolumeAttachmentScenario-279157639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4795e0ff-f5c9-44aa-b564-048c8bff0279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:23:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bc3bd324-e823-4df6-8225-e8691a9b94f6 tempest-TestServerVolumeAttachmentScenario-279157639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eb38182-eb37-42ca-b5de-fc5e8d4320c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:23:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bc3bd324-e823-4df6-8225-e8691a9b94f6 tempest-TestServerVolumeAttachmentScenario-279157639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3eb38182-eb37-42ca-b5de-fc5e8d4320c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1534476b-4053-43db-84a4-45547eb43aa2', 'volume_name': 'volume-1534476b-4053-43db-84a4-45547eb43aa2', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:23:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bc3bd324-e823-4df6-8225-e8691a9b94f6 tempest-TestServerVolumeAttachmentScenario-279157639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b67223a-4d4e-4f57-93c2-0151ffc16a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:23:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bc3bd324-e823-4df6-8225-e8691a9b94f6 tempest-TestServerVolumeAttachmentScenario-279157639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b67223a-4d4e-4f57-93c2-0151ffc16a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:23:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bc3bd324-e823-4df6-8225-e8691a9b94f6 tempest-TestServerVolumeAttachmentScenario-279157639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (239d578f-3e2d-4536-9985-c71d3e6169dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:23:08 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-bc3bd324-e823-4df6-8225-e8691a9b94f6 tempest-TestServerVolumeAttachmentScenario-279157639 None] Volume 1534476b-4053-43db-84a4-45547eb43aa2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1534476b-4053-43db-84a4-45547eb43aa2', 'volume_size': 1}
Nov 04 12:23:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-bc3bd324-e823-4df6-8225-e8691a9b94f6 tempest-TestServerVolumeAttachmentScenario-279157639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:23:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-bc3bd324-e823-4df6-8225-e8691a9b94f6 tempest-TestServerVolumeAttachmentScenario-279157639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:23:08 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-bc3bd324-e823-4df6-8225-e8691a9b94f6 tempest-TestServerVolumeAttachmentScenario-279157639 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1744475889',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1534476b-4053-43db-84a4-45547eb43aa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98dff01e98fd423a9cfcb3a9184e0bc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:23:08Z,use_quota=True,user_id='38ee4b403aba47b6a089c37bf5018201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:23:08 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-bc3bd324-e823-4df6-8225-e8691a9b94f6 tempest-TestServerVolumeAttachmentScenario-279157639 None] Creating volume 1534476b-4053-43db-84a4-45547eb43aa2 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:23:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-bc3bd324-e823-4df6-8225-e8691a9b94f6 tempest-TestServerVolumeAttachmentScenario-279157639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:23:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-bc3bd324-e823-4df6-8225-e8691a9b94f6 tempest-TestServerVolumeAttachmentScenario-279157639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:23:08 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-bc3bd324-e823-4df6-8225-e8691a9b94f6 tempest-TestServerVolumeAttachmentScenario-279157639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:23:08 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-bc3bd324-e823-4df6-8225-e8691a9b94f6 tempest-TestServerVolumeAttachmentScenario-279157639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:23:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-bc3bd324-e823-4df6-8225-e8691a9b94f6 tempest-TestServerVolumeAttachmentScenario-279157639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:23:08 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-bc3bd324-e823-4df6-8225-e8691a9b94f6 tempest-TestServerVolumeAttachmentScenario-279157639 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:23:08 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-bc3bd324-e823-4df6-8225-e8691a9b94f6 tempest-TestServerVolumeAttachmentScenario-279157639 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:23:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bc3bd324-e823-4df6-8225-e8691a9b94f6 tempest-TestServerVolumeAttachmentScenario-279157639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1534476b-4053-43db-84a4-45547eb43aa2 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:23:08 devstack sudo[102724]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1534476b-4053-43db-84a4-45547eb43aa2 1073741824
Nov 04 12:23:08 devstack sudo[102724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:23:08 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac59fa93-ce20-44aa-a481-106f1e59cfcb tempest-TestServerVolumeAttachmentScenario-279157639 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:23:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ac59fa93-ce20-44aa-a481-106f1e59cfcb tempest-TestServerVolumeAttachmentScenario-279157639 None] Flow 'volume_create_manager' (03c5eebb-13bd-44cd-897b-6540d6757ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:23:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ac59fa93-ce20-44aa-a481-106f1e59cfcb tempest-TestServerVolumeAttachmentScenario-279157639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad5ac7d2-cb20-45a7-babf-4f6ebdcae8fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:23:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ac59fa93-ce20-44aa-a481-106f1e59cfcb tempest-TestServerVolumeAttachmentScenario-279157639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad5ac7d2-cb20-45a7-babf-4f6ebdcae8fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1677817359',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=386aa83d-f491-4843-8fef-efcf59e8acec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98dff01e98fd423a9cfcb3a9184e0bc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:23:08Z,use_quota=True,user_id='38ee4b403aba47b6a089c37bf5018201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:23:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ac59fa93-ce20-44aa-a481-106f1e59cfcb tempest-TestServerVolumeAttachmentScenario-279157639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2e765a7-2b76-49eb-89c3-7ff0fdb816d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:23:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ac59fa93-ce20-44aa-a481-106f1e59cfcb tempest-TestServerVolumeAttachmentScenario-279157639 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2e765a7-2b76-49eb-89c3-7ff0fdb816d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:23:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ac59fa93-ce20-44aa-a481-106f1e59cfcb tempest-TestServerVolumeAttachmentScenario-279157639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f16c048-73db-45e0-8ef4-ea3da321fb5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:23:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ac59fa93-ce20-44aa-a481-106f1e59cfcb tempest-TestServerVolumeAttachmentScenario-279157639 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f16c048-73db-45e0-8ef4-ea3da321fb5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '386aa83d-f491-4843-8fef-efcf59e8acec', 'volume_name': 'volume-386aa83d-f491-4843-8fef-efcf59e8acec', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:23:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ac59fa93-ce20-44aa-a481-106f1e59cfcb tempest-TestServerVolumeAttachmentScenario-279157639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb4ffbee-9158-47db-a198-79d17644dbe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:23:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ac59fa93-ce20-44aa-a481-106f1e59cfcb tempest-TestServerVolumeAttachmentScenario-279157639 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb4ffbee-9158-47db-a198-79d17644dbe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:23:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ac59fa93-ce20-44aa-a481-106f1e59cfcb tempest-TestServerVolumeAttachmentScenario-279157639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f7274cb-d2a3-40b5-a476-0698df9159e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:23:08 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-ac59fa93-ce20-44aa-a481-106f1e59cfcb tempest-TestServerVolumeAttachmentScenario-279157639 None] Volume 386aa83d-f491-4843-8fef-efcf59e8acec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-386aa83d-f491-4843-8fef-efcf59e8acec', 'volume_size': 1}
Nov 04 12:23:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ac59fa93-ce20-44aa-a481-106f1e59cfcb tempest-TestServerVolumeAttachmentScenario-279157639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:23:08 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3a396e7-8858-4ef6-ac76-5f42d7b6d654 tempest-ProjectReaderTests-1954870305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:23:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f3a396e7-8858-4ef6-ac76-5f42d7b6d654 tempest-ProjectReaderTests-1954870305 None] Flow 'volume_create_manager' (1949a0c6-a6fa-4dcb-a318-e3cb64d33c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:23:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f3a396e7-8858-4ef6-ac76-5f42d7b6d654 tempest-ProjectReaderTests-1954870305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5329fa5b-64ad-47e8-9c95-91c6a108f854) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:23:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f3a396e7-8858-4ef6-ac76-5f42d7b6d654 tempest-ProjectReaderTests-1954870305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5329fa5b-64ad-47e8-9c95-91c6a108f854) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1900194441',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=141f2529-162b-4d55-b36d-04b798be94e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb91a58188424400925f0d4fcab76123',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:23:09Z,use_quota=True,user_id='d0f2ba3f67894b48b22e9cd5f082808c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:23:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f3a396e7-8858-4ef6-ac76-5f42d7b6d654 tempest-ProjectReaderTests-1954870305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cfa3e50-64f3-4ab3-971b-9d79393ffcf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:23:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f3a396e7-8858-4ef6-ac76-5f42d7b6d654 tempest-ProjectReaderTests-1954870305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cfa3e50-64f3-4ab3-971b-9d79393ffcf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:23:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f3a396e7-8858-4ef6-ac76-5f42d7b6d654 tempest-ProjectReaderTests-1954870305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63dd4f05-1262-457f-920f-e87b3d151ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:23:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f3a396e7-8858-4ef6-ac76-5f42d7b6d654 tempest-ProjectReaderTests-1954870305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63dd4f05-1262-457f-920f-e87b3d151ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '141f2529-162b-4d55-b36d-04b798be94e6', 'volume_name': 'volume-141f2529-162b-4d55-b36d-04b798be94e6', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:23:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f3a396e7-8858-4ef6-ac76-5f42d7b6d654 tempest-ProjectReaderTests-1954870305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80941326-739a-44d7-8a64-e129e84f7a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:23:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f3a396e7-8858-4ef6-ac76-5f42d7b6d654 tempest-ProjectReaderTests-1954870305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80941326-739a-44d7-8a64-e129e84f7a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:23:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f3a396e7-8858-4ef6-ac76-5f42d7b6d654 tempest-ProjectReaderTests-1954870305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b999c39-fcd4-41f9-b668-db650707577b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:23:08 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-f3a396e7-8858-4ef6-ac76-5f42d7b6d654 tempest-ProjectReaderTests-1954870305 None] Volume 141f2529-162b-4d55-b36d-04b798be94e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-141f2529-162b-4d55-b36d-04b798be94e6', 'volume_size': 1}
Nov 04 12:23:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f3a396e7-8858-4ef6-ac76-5f42d7b6d654 tempest-ProjectReaderTests-1954870305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:23:09 devstack sudo[102724]: pam_unix(sudo:session): session closed for user root
Nov 04 12:23:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bc3bd324-e823-4df6-8225-e8691a9b94f6 tempest-TestServerVolumeAttachmentScenario-279157639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1534476b-4053-43db-84a4-45547eb43aa2 1073741824" returned: 0 in 0.813s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:23:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bc3bd324-e823-4df6-8225-e8691a9b94f6 tempest-TestServerVolumeAttachmentScenario-279157639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1534476b-4053-43db-84a4-45547eb43aa2 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:23:09 devstack sudo[102730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1534476b-4053-43db-84a4-45547eb43aa2
Nov 04 12:23:09 devstack sudo[102730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:23:09 devstack sudo[102730]: pam_unix(sudo:session): session closed for user root
Nov 04 12:23:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bc3bd324-e823-4df6-8225-e8691a9b94f6 tempest-TestServerVolumeAttachmentScenario-279157639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1534476b-4053-43db-84a4-45547eb43aa2" returned: 0 in 0.334s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:23:09 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-bc3bd324-e823-4df6-8225-e8691a9b94f6 tempest-TestServerVolumeAttachmentScenario-279157639 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:23:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-bc3bd324-e823-4df6-8225-e8691a9b94f6 tempest-TestServerVolumeAttachmentScenario-279157639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:23:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ac59fa93-ce20-44aa-a481-106f1e59cfcb tempest-TestServerVolumeAttachmentScenario-279157639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.773s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:23:09 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ac59fa93-ce20-44aa-a481-106f1e59cfcb tempest-TestServerVolumeAttachmentScenario-279157639 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1677817359',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=386aa83d-f491-4843-8fef-efcf59e8acec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98dff01e98fd423a9cfcb3a9184e0bc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:23:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:23:08Z,use_quota=True,user_id='38ee4b403aba47b6a089c37bf5018201',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:23:09 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-ac59fa93-ce20-44aa-a481-106f1e59cfcb tempest-TestServerVolumeAttachmentScenario-279157639 None] Creating volume 386aa83d-f491-4843-8fef-efcf59e8acec {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:23:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ac59fa93-ce20-44aa-a481-106f1e59cfcb tempest-TestServerVolumeAttachmentScenario-279157639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:23:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ac59fa93-ce20-44aa-a481-106f1e59cfcb tempest-TestServerVolumeAttachmentScenario-279157639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:23:09 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ac59fa93-ce20-44aa-a481-106f1e59cfcb tempest-TestServerVolumeAttachmentScenario-279157639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:23:09 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ac59fa93-ce20-44aa-a481-106f1e59cfcb tempest-TestServerVolumeAttachmentScenario-279157639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:23:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ac59fa93-ce20-44aa-a481-106f1e59cfcb tempest-TestServerVolumeAttachmentScenario-279157639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:23:09 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ac59fa93-ce20-44aa-a481-106f1e59cfcb tempest-TestServerVolumeAttachmentScenario-279157639 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:23:09 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-ac59fa93-ce20-44aa-a481-106f1e59cfcb tempest-TestServerVolumeAttachmentScenario-279157639 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:23:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ac59fa93-ce20-44aa-a481-106f1e59cfcb tempest-TestServerVolumeAttachmentScenario-279157639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-386aa83d-f491-4843-8fef-efcf59e8acec 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:23:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bc3bd324-e823-4df6-8225-e8691a9b94f6 tempest-TestServerVolumeAttachmentScenario-279157639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (239d578f-3e2d-4536-9985-c71d3e6169dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1534476b-4053-43db-84a4-45547eb43aa2', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:23:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bc3bd324-e823-4df6-8225-e8691a9b94f6 tempest-TestServerVolumeAttachmentScenario-279157639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d69707d5-16c6-4726-bd9e-959fe760c0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:23:09 devstack sudo[102733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-386aa83d-f491-4843-8fef-efcf59e8acec 1073741824
Nov 04 12:23:09 devstack sudo[102733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:23:09 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-bc3bd324-e823-4df6-8225-e8691a9b94f6 tempest-TestServerVolumeAttachmentScenario-279157639 None] Volume volume-1534476b-4053-43db-84a4-45547eb43aa2 (1534476b-4053-43db-84a4-45547eb43aa2): created successfully
Nov 04 12:23:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bc3bd324-e823-4df6-8225-e8691a9b94f6 tempest-TestServerVolumeAttachmentScenario-279157639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d69707d5-16c6-4726-bd9e-959fe760c0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:23:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bc3bd324-e823-4df6-8225-e8691a9b94f6 tempest-TestServerVolumeAttachmentScenario-279157639 None] Flow 'volume_create_manager' (56844591-67af-4a1d-9e21-0641c832a5be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:23:09 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-bc3bd324-e823-4df6-8225-e8691a9b94f6 tempest-TestServerVolumeAttachmentScenario-279157639 None] Created volume successfully.
Nov 04 12:23:10 devstack sudo[102733]: pam_unix(sudo:session): session closed for user root
Nov 04 12:23:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ac59fa93-ce20-44aa-a481-106f1e59cfcb tempest-TestServerVolumeAttachmentScenario-279157639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-386aa83d-f491-4843-8fef-efcf59e8acec 1073741824" returned: 0 in 0.614s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:23:10 devstack sudo[102708]: pam_unix(sudo:session): session closed for user root
Nov 04 12:23:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_9a830b12-21e6-4363-af24-7175af66a541_6oqkqbzzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a2f091b0-c147-400d-95c3-37959961171a" returned: 0 in 2.347s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:23:10 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9a830b12-21e6-4363-af24-7175af66a541_6oqkqbzzdevstack@QuobyteHD, size 112.00 MB, duration 2.35 sec, destination /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a2f091b0-c147-400d-95c3-37959961171a {{(pid=87169) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 12:23:10 devstack cinder-volume[87169]: INFO cinder.image.image_utils [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Converted 112.00 MB image at 47.69 MB/s
Nov 04 12:23:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a2f091b0-c147-400d-95c3-37959961171a 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:23:10 devstack sudo[102739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a2f091b0-c147-400d-95c3-37959961171a 1G
Nov 04 12:23:10 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:23:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ac59fa93-ce20-44aa-a481-106f1e59cfcb tempest-TestServerVolumeAttachmentScenario-279157639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-386aa83d-f491-4843-8fef-efcf59e8acec {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:23:10 devstack sudo[102741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-386aa83d-f491-4843-8fef-efcf59e8acec
Nov 04 12:23:10 devstack sudo[102741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:23:10 devstack sudo[102741]: pam_unix(sudo:session): session closed for user root
Nov 04 12:23:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ac59fa93-ce20-44aa-a481-106f1e59cfcb tempest-TestServerVolumeAttachmentScenario-279157639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-386aa83d-f491-4843-8fef-efcf59e8acec" returned: 0 in 0.253s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:23:10 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ac59fa93-ce20-44aa-a481-106f1e59cfcb tempest-TestServerVolumeAttachmentScenario-279157639 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:23:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ac59fa93-ce20-44aa-a481-106f1e59cfcb tempest-TestServerVolumeAttachmentScenario-279157639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:23:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f3a396e7-8858-4ef6-ac76-5f42d7b6d654 tempest-ProjectReaderTests-1954870305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.348s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:23:10 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f3a396e7-8858-4ef6-ac76-5f42d7b6d654 tempest-ProjectReaderTests-1954870305 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:23:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1900194441',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=141f2529-162b-4d55-b36d-04b798be94e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb91a58188424400925f0d4fcab76123',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:23:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:23:09Z,use_quota=True,user_id='d0f2ba3f67894b48b22e9cd5f082808c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:23:10 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-f3a396e7-8858-4ef6-ac76-5f42d7b6d654 tempest-ProjectReaderTests-1954870305 None] Creating volume 141f2529-162b-4d55-b36d-04b798be94e6 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:23:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f3a396e7-8858-4ef6-ac76-5f42d7b6d654 tempest-ProjectReaderTests-1954870305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:23:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f3a396e7-8858-4ef6-ac76-5f42d7b6d654 tempest-ProjectReaderTests-1954870305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:23:10 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f3a396e7-8858-4ef6-ac76-5f42d7b6d654 tempest-ProjectReaderTests-1954870305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:23:10 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f3a396e7-8858-4ef6-ac76-5f42d7b6d654 tempest-ProjectReaderTests-1954870305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:23:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f3a396e7-8858-4ef6-ac76-5f42d7b6d654 tempest-ProjectReaderTests-1954870305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:23:10 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f3a396e7-8858-4ef6-ac76-5f42d7b6d654 tempest-ProjectReaderTests-1954870305 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:23:10 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-f3a396e7-8858-4ef6-ac76-5f42d7b6d654 tempest-ProjectReaderTests-1954870305 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:23:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f3a396e7-8858-4ef6-ac76-5f42d7b6d654 tempest-ProjectReaderTests-1954870305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-141f2529-162b-4d55-b36d-04b798be94e6 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:23:10 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ac59fa93-ce20-44aa-a481-106f1e59cfcb tempest-TestServerVolumeAttachmentScenario-279157639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f7274cb-d2a3-40b5-a476-0698df9159e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-386aa83d-f491-4843-8fef-efcf59e8acec', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:23:10 devstack sudo[102747]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-141f2529-162b-4d55-b36d-04b798be94e6 1073741824
Nov 04 12:23:10 devstack sudo[102747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:23:10 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ac59fa93-ce20-44aa-a481-106f1e59cfcb tempest-TestServerVolumeAttachmentScenario-279157639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a19a727d-3db1-4ffb-9ba2-3ee3172c5204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:23:10 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root
Nov 04 12:23:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a2f091b0-c147-400d-95c3-37959961171a 1G" returned: 0 in 0.351s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:23:10 devstack cinder-volume[87169]: DEBUG cinder.volume.volume_utils [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Downloaded image 9a830b12-21e6-4363-af24-7175af66a541 ((None, [{'url': 'file:///opt/stack/data/glance/images/9a830b12-21e6-4363-af24-7175af66a541', 'metadata': {}}])) to volume a2f091b0-c147-400d-95c3-37959961171a successfully. {{(pid=87169) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 04 12:23:10 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Temporary image 9a830b12-21e6-4363-af24-7175af66a541 for user 194ae925fde24b9d865b2ec398ce0891 is deleted. {{(pid=87169) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 04 12:23:10 devstack cinder-volume[87169]: DEBUG cinder.volume.volume_utils [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Marking volume a2f091b0-c147-400d-95c3-37959961171a as bootable. {{(pid=87169) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 04 12:23:10 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-ac59fa93-ce20-44aa-a481-106f1e59cfcb tempest-TestServerVolumeAttachmentScenario-279157639 None] Volume volume-386aa83d-f491-4843-8fef-efcf59e8acec (386aa83d-f491-4843-8fef-efcf59e8acec): created successfully
Nov 04 12:23:10 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ac59fa93-ce20-44aa-a481-106f1e59cfcb tempest-TestServerVolumeAttachmentScenario-279157639 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a19a727d-3db1-4ffb-9ba2-3ee3172c5204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:23:10 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ac59fa93-ce20-44aa-a481-106f1e59cfcb tempest-TestServerVolumeAttachmentScenario-279157639 None] Flow 'volume_create_manager' (03c5eebb-13bd-44cd-897b-6540d6757ead) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:23:10 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Copying metadata from image 9a830b12-21e6-4363-af24-7175af66a541 to a2f091b0-c147-400d-95c3-37959961171a. {{(pid=87169) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 04 12:23:10 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Creating volume glance metadata for volume a2f091b0-c147-400d-95c3-37959961171a backed by image 9a830b12-21e6-4363-af24-7175af66a541 with: {'image_id': '9a830b12-21e6-4363-af24-7175af66a541', 'image_name': 'tempest-scenario-img--966385713', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87169) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 04 12:23:10 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-ac59fa93-ce20-44aa-a481-106f1e59cfcb tempest-TestServerVolumeAttachmentScenario-279157639 None] Created volume successfully.
Nov 04 12:23:10 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0257ab4-d53e-4035-a8dd-09c12ebd1120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2f091b0-c147-400d-95c3-37959961171a', 'volume_size': 1, 'image_id': '9a830b12-21e6-4363-af24-7175af66a541', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9a830b12-21e6-4363-af24-7175af66a541', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--966385713', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f933a599abd8488ebd417eacd17511e9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '9a830b12-21e6-4363-af24-7175af66a541', 'created_at': datetime.datetime(2026, 11, 4, 11, 22, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 22, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9a830b12-21e6-4363-af24-7175af66a541/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cc059536720>}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:23:10 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6c8a76d-a157-4df4-ac16-de48ff0764fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:23:10 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Volume volume-a2f091b0-c147-400d-95c3-37959961171a (a2f091b0-c147-400d-95c3-37959961171a): created successfully
Nov 04 12:23:10 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6c8a76d-a157-4df4-ac16-de48ff0764fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:23:10 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Flow 'volume_create_manager' (8bd21ef8-fab0-4a3d-9ec9-810b549cac73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:23:10 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-360b3099-5e50-431f-9ddd-14cc6d6d86d1 tempest-TestInstancesWithCinderVolumes-486601865 None] Created volume successfully.
Nov 04 12:23:10 devstack sudo[102747]: pam_unix(sudo:session): session closed for user root
Nov 04 12:23:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f3a396e7-8858-4ef6-ac76-5f42d7b6d654 tempest-ProjectReaderTests-1954870305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-141f2529-162b-4d55-b36d-04b798be94e6 1073741824" returned: 0 in 0.521s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:23:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f3a396e7-8858-4ef6-ac76-5f42d7b6d654 tempest-ProjectReaderTests-1954870305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-141f2529-162b-4d55-b36d-04b798be94e6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:23:10 devstack sudo[102752]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-141f2529-162b-4d55-b36d-04b798be94e6
Nov 04 12:23:10 devstack sudo[102752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:23:11 devstack sudo[102752]: pam_unix(sudo:session): session closed for user root
Nov 04 12:23:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f3a396e7-8858-4ef6-ac76-5f42d7b6d654 tempest-ProjectReaderTests-1954870305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-141f2529-162b-4d55-b36d-04b798be94e6" returned: 0 in 0.262s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:23:11 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f3a396e7-8858-4ef6-ac76-5f42d7b6d654 tempest-ProjectReaderTests-1954870305 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:23:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f3a396e7-8858-4ef6-ac76-5f42d7b6d654 tempest-ProjectReaderTests-1954870305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:23:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f3a396e7-8858-4ef6-ac76-5f42d7b6d654 tempest-ProjectReaderTests-1954870305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b999c39-fcd4-41f9-b668-db650707577b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-141f2529-162b-4d55-b36d-04b798be94e6', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:23:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f3a396e7-8858-4ef6-ac76-5f42d7b6d654 tempest-ProjectReaderTests-1954870305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00f6dda5-2ae0-47ed-a008-d88f486907a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:23:11 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-f3a396e7-8858-4ef6-ac76-5f42d7b6d654 tempest-ProjectReaderTests-1954870305 None] Volume volume-141f2529-162b-4d55-b36d-04b798be94e6 (141f2529-162b-4d55-b36d-04b798be94e6): created successfully
Nov 04 12:23:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f3a396e7-8858-4ef6-ac76-5f42d7b6d654 tempest-ProjectReaderTests-1954870305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00f6dda5-2ae0-47ed-a008-d88f486907a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:23:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-f3a396e7-8858-4ef6-ac76-5f42d7b6d654 tempest-ProjectReaderTests-1954870305 None] Flow 'volume_create_manager' (1949a0c6-a6fa-4dcb-a318-e3cb64d33c0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:23:11 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-f3a396e7-8858-4ef6-ac76-5f42d7b6d654 tempest-ProjectReaderTests-1954870305 None] Created volume successfully.
Nov 04 12:23:12 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d2ec6fbb-145c-4f34-a165-5a65e1b00223 tempest-ProjectReaderTests-1954870305 None] Acquiring lock "cinder-141f2529-162b-4d55-b36d-04b798be94e6-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:23:12 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d2ec6fbb-145c-4f34-a165-5a65e1b00223 tempest-ProjectReaderTests-1954870305 None] Lock "cinder-141f2529-162b-4d55-b36d-04b798be94e6-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:23:12 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d2ec6fbb-145c-4f34-a165-5a65e1b00223 tempest-ProjectReaderTests-1954870305 None] Acquiring lock "cinder-quobyte-141f2529-162b-4d55-b36d-04b798be94e6" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:23:12 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d2ec6fbb-145c-4f34-a165-5a65e1b00223 tempest-ProjectReaderTests-1954870305 None] Lock "cinder-quobyte-141f2529-162b-4d55-b36d-04b798be94e6" acquired by "delete_volume" :: waited 0.018s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:23:12 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0b9675-95f1-47a4-83c0-550a303e8d15]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:23:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d2ec6fbb-145c-4f34-a165-5a65e1b00223 tempest-ProjectReaderTests-1954870305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-141f2529-162b-4d55-b36d-04b798be94e6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:23:12 devstack sudo[102763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-141f2529-162b-4d55-b36d-04b798be94e6
Nov 04 12:23:12 devstack sudo[102763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:23:12 devstack sudo[102763]: pam_unix(sudo:session): session closed for user root
Nov 04 12:23:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d2ec6fbb-145c-4f34-a165-5a65e1b00223 tempest-ProjectReaderTests-1954870305 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-141f2529-162b-4d55-b36d-04b798be94e6" returned: 0 in 0.486s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:23:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d2ec6fbb-145c-4f34-a165-5a65e1b00223 tempest-ProjectReaderTests-1954870305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-141f2529-162b-4d55-b36d-04b798be94e6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:23:12 devstack sudo[102768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-141f2529-162b-4d55-b36d-04b798be94e6
Nov 04 12:23:12 devstack sudo[102768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:23:13 devstack sudo[102768]: pam_unix(sudo:session): session closed for user root
Nov 04 12:23:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d2ec6fbb-145c-4f34-a165-5a65e1b00223 tempest-ProjectReaderTests-1954870305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-141f2529-162b-4d55-b36d-04b798be94e6" returned: 0 in 0.340s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:23:13 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d2ec6fbb-145c-4f34-a165-5a65e1b00223 tempest-ProjectReaderTests-1954870305 None] Lock "cinder-quobyte-141f2529-162b-4d55-b36d-04b798be94e6" released by "delete_volume" :: held 0.898s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:23:13 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-d2ec6fbb-145c-4f34-a165-5a65e1b00223 tempest-ProjectReaderTests-1954870305 None] Created reservations ['5e9c127b-2944-4d45-96d6-76032dab4353', '3c8d22ff-fba9-4c61-bb84-4861bdf50486', 'a6804249-00a9-4a85-9ed4-86213d7023dd', 'fc5c1873-7bf1-47eb-bd3d-3ed234233356'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:23:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d2ec6fbb-145c-4f34-a165-5a65e1b00223 tempest-ProjectReaderTests-1954870305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:23:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d2ec6fbb-145c-4f34-a165-5a65e1b00223 tempest-ProjectReaderTests-1954870305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:23:13 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d2ec6fbb-145c-4f34-a165-5a65e1b00223 tempest-ProjectReaderTests-1954870305 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:23:13 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d2ec6fbb-145c-4f34-a165-5a65e1b00223 tempest-ProjectReaderTests-1954870305 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:23:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d2ec6fbb-145c-4f34-a165-5a65e1b00223 tempest-ProjectReaderTests-1954870305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:23:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d2ec6fbb-145c-4f34-a165-5a65e1b00223 tempest-ProjectReaderTests-1954870305 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:23:13 devstack sudo[102775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:23:13 devstack sudo[102775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:23:13 devstack sudo[102775]: pam_unix(sudo:session): session closed for user root
Nov 04 12:23:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d2ec6fbb-145c-4f34-a165-5a65e1b00223 tempest-ProjectReaderTests-1954870305 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.500s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:23:13 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-d2ec6fbb-145c-4f34-a165-5a65e1b00223 tempest-ProjectReaderTests-1954870305 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:23:13 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-d2ec6fbb-145c-4f34-a165-5a65e1b00223 tempest-ProjectReaderTests-1954870305 None] Deleted volume successfully.
Nov 04 12:23:13 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d2ec6fbb-145c-4f34-a165-5a65e1b00223 tempest-ProjectReaderTests-1954870305 None] Lock "cinder-141f2529-162b-4d55-b36d-04b798be94e6-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:23:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-4ed9f40b-0150-4c9f-88b3-a9cbd3227148 req-8e7d36f8-a41b-44b0-ac65-cd8ed1ebc343 tempest-TestInstancesWithCinderVolumes-486601865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:23:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-4ed9f40b-0150-4c9f-88b3-a9cbd3227148 req-8e7d36f8-a41b-44b0-ac65-cd8ed1ebc343 tempest-TestInstancesWithCinderVolumes-486601865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:23:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-4ed9f40b-0150-4c9f-88b3-a9cbd3227148 req-8e7d36f8-a41b-44b0-ac65-cd8ed1ebc343 tempest-TestInstancesWithCinderVolumes-486601865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:23:14 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-4ed9f40b-0150-4c9f-88b3-a9cbd3227148 req-8e7d36f8-a41b-44b0-ac65-cd8ed1ebc343 tempest-TestInstancesWithCinderVolumes-486601865 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79', 'name': 'volume-a2f091b0-c147-400d-95c3-37959961171a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd57951ad-5e28-42ec-85b6-166782879543', 'enforce_multipath': True} {{(pid=87169) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 04 12:23:14 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-4ed9f40b-0150-4c9f-88b3-a9cbd3227148 req-8e7d36f8-a41b-44b0-ac65-cd8ed1ebc343 tempest-TestInstancesWithCinderVolumes-486601865 None] attachment_update completed successfully.
Nov 04 12:23:24 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:UPDATE=50,cinder:SELECT=46,cinder:INSERT=19,cinder:DELETE=7 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:23:24 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=52,cinder:INSERT=20,cinder:UPDATE=55,cinder:DELETE=4 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:23:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-39941e06-d1c3-4e80-8162-8dfd20527c1a req-906b7c62-8fa9-46da-a32f-03334a1866b1 tempest-TestServerVolumeAttachmentScenario-279157639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:23:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-39941e06-d1c3-4e80-8162-8dfd20527c1a req-906b7c62-8fa9-46da-a32f-03334a1866b1 tempest-TestServerVolumeAttachmentScenario-279157639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:23:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-39941e06-d1c3-4e80-8162-8dfd20527c1a req-906b7c62-8fa9-46da-a32f-03334a1866b1 tempest-TestServerVolumeAttachmentScenario-279157639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:23:46 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-39941e06-d1c3-4e80-8162-8dfd20527c1a req-906b7c62-8fa9-46da-a32f-03334a1866b1 tempest-TestServerVolumeAttachmentScenario-279157639 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79', 'name': 'volume-1534476b-4053-43db-84a4-45547eb43aa2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '41a5361f-438a-4f80-a88a-6fbcdd1a491a', 'enforce_multipath': True} {{(pid=87169) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 04 12:23:46 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-39941e06-d1c3-4e80-8162-8dfd20527c1a req-906b7c62-8fa9-46da-a32f-03334a1866b1 tempest-TestServerVolumeAttachmentScenario-279157639 None] attachment_update completed successfully.
Nov 04 12:23:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-936efa9f-f9d6-4967-9dc9-ee02097fc413 req-d91652e2-21fb-4464-8190-c15ba2030607 tempest-TestInstancesWithCinderVolumes-486601865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:23:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-936efa9f-f9d6-4967-9dc9-ee02097fc413 req-d91652e2-21fb-4464-8190-c15ba2030607 tempest-TestInstancesWithCinderVolumes-486601865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:23:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-936efa9f-f9d6-4967-9dc9-ee02097fc413 req-d91652e2-21fb-4464-8190-c15ba2030607 tempest-TestInstancesWithCinderVolumes-486601865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:23:49 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-936efa9f-f9d6-4967-9dc9-ee02097fc413 req-d91652e2-21fb-4464-8190-c15ba2030607 tempest-TestInstancesWithCinderVolumes-486601865 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79', 'name': 'volume-972aad9f-d5b2-49a8-b5cf-a4dc524a7e9f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b57836fd-12a1-44f1-a73d-137132142f64', 'enforce_multipath': True} {{(pid=87169) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 04 12:23:49 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-936efa9f-f9d6-4967-9dc9-ee02097fc413 req-d91652e2-21fb-4464-8190-c15ba2030607 tempest-TestInstancesWithCinderVolumes-486601865 None] attachment_update completed successfully.
Nov 04 12:23:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-67f2ee6c-4e2c-4f2b-8c86-449e1e16010f req-75e61bcd-5785-4d00-b899-1678e5088272 tempest-TestServerVolumeAttachmentScenario-279157639 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:23:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-67f2ee6c-4e2c-4f2b-8c86-449e1e16010f req-75e61bcd-5785-4d00-b899-1678e5088272 tempest-TestServerVolumeAttachmentScenario-279157639 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:23:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-67f2ee6c-4e2c-4f2b-8c86-449e1e16010f req-75e61bcd-5785-4d00-b899-1678e5088272 tempest-TestServerVolumeAttachmentScenario-279157639 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:23:49 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-67f2ee6c-4e2c-4f2b-8c86-449e1e16010f req-75e61bcd-5785-4d00-b899-1678e5088272 tempest-TestServerVolumeAttachmentScenario-279157639 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79', 'name': 'volume-386aa83d-f491-4843-8fef-efcf59e8acec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '726cbd28-1920-47fa-968c-e4f2a81ae023', 'enforce_multipath': True} {{(pid=87169) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 04 12:23:49 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-67f2ee6c-4e2c-4f2b-8c86-449e1e16010f req-75e61bcd-5785-4d00-b899-1678e5088272 tempest-TestServerVolumeAttachmentScenario-279157639 None] attachment_update completed successfully.
Nov 04 12:23:49 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:23:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:23:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:23:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:23:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:23:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:23:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:23:49 devstack sudo[103493]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:23:49 devstack sudo[103493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:23:50 devstack sudo[103493]: pam_unix(sudo:session): session closed for user root
Nov 04 12:23:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.311s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:23:50 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:23:50 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager._thread_info {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:23:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread count: 28 {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 12:23:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread info: [<_MainThread(MainThread, started 137165867425920)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137165754678912)>, <Thread(Thread-3 (stat_writer), started daemon 137165754130752)>, <Thread(Rabbit-heartbeat, started daemon 137165752997504)>, <Thread(Thread-5 (_runner), started daemon 137165753227712)>, <Thread(Thread-7 (_runner), started daemon 137165751273856)>, <Thread(fd_logger, started daemon 137165755322048)>, <Thread(privsep_reader, started daemon 137165748896704)>, <Thread(tpool_thread_0, started daemon 137165742520000)>, <Thread(tpool_thread_1, started daemon 137165734127296)>, <Thread(tpool_thread_2, started daemon 137165725734592)>, <Thread(tpool_thread_3, started daemon 137165717341888)>, <Thread(tpool_thread_4, started daemon 137165708949184)>, <Thread(tpool_thread_5, started daemon 137165700556480)>, <Thread(tpool_thread_6, started daemon 137165692163776)>, <Thread(tpool_thread_7, started daemon 137165683771072)>, <Thread(tpool_thread_8, started daemon 137165675378368)>, <Thread(tpool_thread_9, started daemon 137165666985664)>, <Thread(tpool_thread_10, started daemon 137165658592960)>, <Thread(tpool_thread_11, started daemon 137165650183872)>, <Thread(tpool_thread_12, started daemon 137165641774784)>, <Thread(tpool_thread_13, started daemon 137165633365696)>, <Thread(tpool_thread_14, started daemon 137165624956608)>, <Thread(tpool_thread_15, started daemon 137165616547520)>, <Thread(tpool_thread_16, started daemon 137165608138432)>, <Thread(tpool_thread_17, started daemon 137165599729344)>, <Thread(tpool_thread_18, started daemon 137165591320256)>, <Thread(tpool_thread_19, started daemon 137165582911168)>] {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 12:23:51 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-c6e9d691-aa4c-4b40-9303-73e9af42b899 req-47c6d527-8ee1-4f18-bbf0-e4860a174a4b tempest-TestServerVolumeAttachmentScenario-279157639 None] Terminate volume connection completed successfully.
Nov 04 12:23:51 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-c6e9d691-aa4c-4b40-9303-73e9af42b899 req-47c6d527-8ee1-4f18-bbf0-e4860a174a4b tempest-TestServerVolumeAttachmentScenario-279157639 None] Deleting attachment 726cbd28-1920-47fa-968c-e4f2a81ae023. {{(pid=87169) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 12:23:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-514de0fe-d7ee-4501-ac31-0d0886d5dcd8 req-7607fd66-697c-487a-80e5-c08b3ae2e198 tempest-TestInstancesWithCinderVolumes-486601865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:23:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-514de0fe-d7ee-4501-ac31-0d0886d5dcd8 req-7607fd66-697c-487a-80e5-c08b3ae2e198 tempest-TestInstancesWithCinderVolumes-486601865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:23:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-514de0fe-d7ee-4501-ac31-0d0886d5dcd8 req-7607fd66-697c-487a-80e5-c08b3ae2e198 tempest-TestInstancesWithCinderVolumes-486601865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:23:51 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-514de0fe-d7ee-4501-ac31-0d0886d5dcd8 req-7607fd66-697c-487a-80e5-c08b3ae2e198 tempest-TestInstancesWithCinderVolumes-486601865 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79', 'name': 'volume-185851ea-a65c-4960-a8be-36b48c4bd4ea', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c4bbf134-239a-4825-899c-e0a7273241af', 'enforce_multipath': True} {{(pid=87169) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 04 12:23:51 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-514de0fe-d7ee-4501-ac31-0d0886d5dcd8 req-7607fd66-697c-487a-80e5-c08b3ae2e198 tempest-TestInstancesWithCinderVolumes-486601865 None] attachment_update completed successfully.
Nov 04 12:23:52 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-9f32df00-ed6e-48d0-8732-b31f24826d41 req-95278514-ac70-4a61-bb74-f0f17861ad02 tempest-TestServerVolumeAttachmentScenario-279157639 None] Terminate volume connection completed successfully.
Nov 04 12:23:52 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-9f32df00-ed6e-48d0-8732-b31f24826d41 req-95278514-ac70-4a61-bb74-f0f17861ad02 tempest-TestServerVolumeAttachmentScenario-279157639 None] Deleting attachment 41a5361f-438a-4f80-a88a-6fbcdd1a491a. {{(pid=87169) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 12:23:56 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-c12f3351-a176-4a90-87a4-b57c76e7f7ae req-b9e681bc-3eaa-41f6-961e-21c49f9d9aab tempest-TestInstancesWithCinderVolumes-486601865 None] Terminate volume connection completed successfully.
Nov 04 12:23:56 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-c12f3351-a176-4a90-87a4-b57c76e7f7ae req-b9e681bc-3eaa-41f6-961e-21c49f9d9aab tempest-TestInstancesWithCinderVolumes-486601865 None] Deleting attachment b57836fd-12a1-44f1-a73d-137132142f64. {{(pid=87169) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 12:23:57 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-4f9a877d-7a99-46a1-afb6-1b47ab77cf68 tempest-TestInstancesWithCinderVolumes-486601865 None] Acquiring lock "cinder-972aad9f-d5b2-49a8-b5cf-a4dc524a7e9f-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:23:57 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-4f9a877d-7a99-46a1-afb6-1b47ab77cf68 tempest-TestInstancesWithCinderVolumes-486601865 None] Lock "cinder-972aad9f-d5b2-49a8-b5cf-a4dc524a7e9f-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:23:57 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-4f9a877d-7a99-46a1-afb6-1b47ab77cf68 tempest-TestInstancesWithCinderVolumes-486601865 None] Acquiring lock "cinder-quobyte-972aad9f-d5b2-49a8-b5cf-a4dc524a7e9f" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:23:57 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-4f9a877d-7a99-46a1-afb6-1b47ab77cf68 tempest-TestInstancesWithCinderVolumes-486601865 None] Lock "cinder-quobyte-972aad9f-d5b2-49a8-b5cf-a4dc524a7e9f" acquired by "delete_volume" :: waited 0.016s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:23:57 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[87e57fa9-dbed-45c1-b5e5-1913ac991e34]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:23:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4f9a877d-7a99-46a1-afb6-1b47ab77cf68 tempest-TestInstancesWithCinderVolumes-486601865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-972aad9f-d5b2-49a8-b5cf-a4dc524a7e9f {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:23:57 devstack sudo[103585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-972aad9f-d5b2-49a8-b5cf-a4dc524a7e9f
Nov 04 12:23:57 devstack sudo[103585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:23:57 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d780c05b-c24a-4a19-bde9-3d830b372fa7 tempest-TestServerVolumeAttachmentScenario-279157639 None] Acquiring lock "cinder-386aa83d-f491-4843-8fef-efcf59e8acec-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:23:57 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d780c05b-c24a-4a19-bde9-3d830b372fa7 tempest-TestServerVolumeAttachmentScenario-279157639 None] Lock "cinder-386aa83d-f491-4843-8fef-efcf59e8acec-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:23:57 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d780c05b-c24a-4a19-bde9-3d830b372fa7 tempest-TestServerVolumeAttachmentScenario-279157639 None] Acquiring lock "cinder-quobyte-386aa83d-f491-4843-8fef-efcf59e8acec" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:23:57 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d780c05b-c24a-4a19-bde9-3d830b372fa7 tempest-TestServerVolumeAttachmentScenario-279157639 None] Lock "cinder-quobyte-386aa83d-f491-4843-8fef-efcf59e8acec" acquired by "delete_volume" :: waited 0.024s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:23:57 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d44a92-09e8-47f5-b5e8-5629b1fd847b]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:23:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d780c05b-c24a-4a19-bde9-3d830b372fa7 tempest-TestServerVolumeAttachmentScenario-279157639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-386aa83d-f491-4843-8fef-efcf59e8acec {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:23:57 devstack sudo[103585]: pam_unix(sudo:session): session closed for user root
Nov 04 12:23:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4f9a877d-7a99-46a1-afb6-1b47ab77cf68 tempest-TestInstancesWithCinderVolumes-486601865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-972aad9f-d5b2-49a8-b5cf-a4dc524a7e9f" returned: 0 in 0.453s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:23:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4f9a877d-7a99-46a1-afb6-1b47ab77cf68 tempest-TestInstancesWithCinderVolumes-486601865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-972aad9f-d5b2-49a8-b5cf-a4dc524a7e9f {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:23:57 devstack sudo[103594]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-972aad9f-d5b2-49a8-b5cf-a4dc524a7e9f
Nov 04 12:23:57 devstack sudo[103594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:23:57 devstack sudo[103593]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-386aa83d-f491-4843-8fef-efcf59e8acec
Nov 04 12:23:57 devstack sudo[103593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:23:57 devstack sudo[103594]: pam_unix(sudo:session): session closed for user root
Nov 04 12:23:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4f9a877d-7a99-46a1-afb6-1b47ab77cf68 tempest-TestInstancesWithCinderVolumes-486601865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-972aad9f-d5b2-49a8-b5cf-a4dc524a7e9f" returned: 0 in 0.280s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:23:57 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-4f9a877d-7a99-46a1-afb6-1b47ab77cf68 tempest-TestInstancesWithCinderVolumes-486601865 None] Lock "cinder-quobyte-972aad9f-d5b2-49a8-b5cf-a4dc524a7e9f" released by "delete_volume" :: held 0.784s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:23:57 devstack cinder-volume[87169]: WARNING cinder.quota [None req-4f9a877d-7a99-46a1-afb6-1b47ab77cf68 tempest-TestInstancesWithCinderVolumes-486601865 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1354725641-851759791 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1354725641-851759791, it is now deprecated. Please use the default quota class for default quota.
Nov 04 12:23:57 devstack cinder-volume[87169]: WARNING cinder.quota [None req-4f9a877d-7a99-46a1-afb6-1b47ab77cf68 tempest-TestInstancesWithCinderVolumes-486601865 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1354725641-851759791 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1354725641-851759791, it is now deprecated. Please use the default quota class for default quota.
Nov 04 12:23:57 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-4f9a877d-7a99-46a1-afb6-1b47ab77cf68 tempest-TestInstancesWithCinderVolumes-486601865 None] Created reservations ['20539f9f-d4df-4360-9e6f-abad1ba4a778', '9a41ac52-8541-4c68-b629-8754ab60a6a8', '8e330060-cdae-47c9-8e46-4e8cb7a9114b', 'caf82e45-710e-495f-9fe1-178f28af760b'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:23:58 devstack sudo[103593]: pam_unix(sudo:session): session closed for user root
Nov 04 12:23:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d780c05b-c24a-4a19-bde9-3d830b372fa7 tempest-TestServerVolumeAttachmentScenario-279157639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-386aa83d-f491-4843-8fef-efcf59e8acec" returned: 0 in 0.449s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:23:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d780c05b-c24a-4a19-bde9-3d830b372fa7 tempest-TestServerVolumeAttachmentScenario-279157639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-386aa83d-f491-4843-8fef-efcf59e8acec {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:23:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-4f9a877d-7a99-46a1-afb6-1b47ab77cf68 tempest-TestInstancesWithCinderVolumes-486601865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:23:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-4f9a877d-7a99-46a1-afb6-1b47ab77cf68 tempest-TestInstancesWithCinderVolumes-486601865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:23:58 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-4f9a877d-7a99-46a1-afb6-1b47ab77cf68 tempest-TestInstancesWithCinderVolumes-486601865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:23:58 devstack sudo[103601]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-386aa83d-f491-4843-8fef-efcf59e8acec
Nov 04 12:23:58 devstack sudo[103601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:23:58 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-4f9a877d-7a99-46a1-afb6-1b47ab77cf68 tempest-TestInstancesWithCinderVolumes-486601865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:23:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-4f9a877d-7a99-46a1-afb6-1b47ab77cf68 tempest-TestInstancesWithCinderVolumes-486601865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:23:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4f9a877d-7a99-46a1-afb6-1b47ab77cf68 tempest-TestInstancesWithCinderVolumes-486601865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:23:58 devstack sudo[103603]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:23:58 devstack sudo[103603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:23:58 devstack sudo[103601]: pam_unix(sudo:session): session closed for user root
Nov 04 12:23:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d780c05b-c24a-4a19-bde9-3d830b372fa7 tempest-TestServerVolumeAttachmentScenario-279157639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-386aa83d-f491-4843-8fef-efcf59e8acec" returned: 0 in 0.272s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:23:58 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d780c05b-c24a-4a19-bde9-3d830b372fa7 tempest-TestServerVolumeAttachmentScenario-279157639 None] Lock "cinder-quobyte-386aa83d-f491-4843-8fef-efcf59e8acec" released by "delete_volume" :: held 0.771s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:23:58 devstack sudo[103603]: pam_unix(sudo:session): session closed for user root
Nov 04 12:23:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4f9a877d-7a99-46a1-afb6-1b47ab77cf68 tempest-TestInstancesWithCinderVolumes-486601865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.282s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:23:58 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-4f9a877d-7a99-46a1-afb6-1b47ab77cf68 tempest-TestInstancesWithCinderVolumes-486601865 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:23:58 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-4f9a877d-7a99-46a1-afb6-1b47ab77cf68 tempest-TestInstancesWithCinderVolumes-486601865 None] Deleted volume successfully.
Nov 04 12:23:58 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-d780c05b-c24a-4a19-bde9-3d830b372fa7 tempest-TestServerVolumeAttachmentScenario-279157639 None] Created reservations ['157e5cb6-6349-4dfe-8936-7f662faab14a', '08cc9df7-73ee-447b-bbea-c2a965b1efb4', 'b3b7f7d4-b25e-4f00-b5d3-79d29362e302', 'd2c8ff31-3eee-4cb0-94ce-02b2f4df7b79'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:23:58 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-4f9a877d-7a99-46a1-afb6-1b47ab77cf68 tempest-TestInstancesWithCinderVolumes-486601865 None] Lock "cinder-972aad9f-d5b2-49a8-b5cf-a4dc524a7e9f-delete_volume" released by "delete_volume" :: held 1.327s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:23:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d780c05b-c24a-4a19-bde9-3d830b372fa7 tempest-TestServerVolumeAttachmentScenario-279157639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:23:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d780c05b-c24a-4a19-bde9-3d830b372fa7 tempest-TestServerVolumeAttachmentScenario-279157639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:23:58 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d780c05b-c24a-4a19-bde9-3d830b372fa7 tempest-TestServerVolumeAttachmentScenario-279157639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:23:58 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d780c05b-c24a-4a19-bde9-3d830b372fa7 tempest-TestServerVolumeAttachmentScenario-279157639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:23:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d780c05b-c24a-4a19-bde9-3d830b372fa7 tempest-TestServerVolumeAttachmentScenario-279157639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:23:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d780c05b-c24a-4a19-bde9-3d830b372fa7 tempest-TestServerVolumeAttachmentScenario-279157639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:23:58 devstack sudo[103607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:23:58 devstack sudo[103607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:23:58 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c55c51ee-cdcf-40f1-b95d-7723ead3800d tempest-TestServerVolumeAttachmentScenario-279157639 None] Acquiring lock "cinder-1534476b-4053-43db-84a4-45547eb43aa2-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:23:58 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c55c51ee-cdcf-40f1-b95d-7723ead3800d tempest-TestServerVolumeAttachmentScenario-279157639 None] Lock "cinder-1534476b-4053-43db-84a4-45547eb43aa2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:23:58 devstack sudo[103607]: pam_unix(sudo:session): session closed for user root
Nov 04 12:23:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d780c05b-c24a-4a19-bde9-3d830b372fa7 tempest-TestServerVolumeAttachmentScenario-279157639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.280s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:23:58 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-d780c05b-c24a-4a19-bde9-3d830b372fa7 tempest-TestServerVolumeAttachmentScenario-279157639 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:23:58 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-d780c05b-c24a-4a19-bde9-3d830b372fa7 tempest-TestServerVolumeAttachmentScenario-279157639 None] Deleted volume successfully.
Nov 04 12:23:58 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c55c51ee-cdcf-40f1-b95d-7723ead3800d tempest-TestServerVolumeAttachmentScenario-279157639 None] Acquiring lock "cinder-quobyte-1534476b-4053-43db-84a4-45547eb43aa2" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:23:58 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c55c51ee-cdcf-40f1-b95d-7723ead3800d tempest-TestServerVolumeAttachmentScenario-279157639 None] Lock "cinder-quobyte-1534476b-4053-43db-84a4-45547eb43aa2" acquired by "delete_volume" :: waited 0.021s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:23:58 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d780c05b-c24a-4a19-bde9-3d830b372fa7 tempest-TestServerVolumeAttachmentScenario-279157639 None] Lock "cinder-386aa83d-f491-4843-8fef-efcf59e8acec-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:23:58 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c57fbcc-ed9e-4d07-ac8c-433b6458f235]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:23:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c55c51ee-cdcf-40f1-b95d-7723ead3800d tempest-TestServerVolumeAttachmentScenario-279157639 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1534476b-4053-43db-84a4-45547eb43aa2 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:23:58 devstack sudo[103610]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1534476b-4053-43db-84a4-45547eb43aa2
Nov 04 12:23:58 devstack sudo[103610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:23:59 devstack sudo[103610]: pam_unix(sudo:session): session closed for user root
Nov 04 12:23:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c55c51ee-cdcf-40f1-b95d-7723ead3800d tempest-TestServerVolumeAttachmentScenario-279157639 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1534476b-4053-43db-84a4-45547eb43aa2" returned: 0 in 0.398s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:23:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c55c51ee-cdcf-40f1-b95d-7723ead3800d tempest-TestServerVolumeAttachmentScenario-279157639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1534476b-4053-43db-84a4-45547eb43aa2 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:23:59 devstack sudo[103617]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1534476b-4053-43db-84a4-45547eb43aa2
Nov 04 12:23:59 devstack sudo[103617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:23:59 devstack sudo[103617]: pam_unix(sudo:session): session closed for user root
Nov 04 12:23:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c55c51ee-cdcf-40f1-b95d-7723ead3800d tempest-TestServerVolumeAttachmentScenario-279157639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1534476b-4053-43db-84a4-45547eb43aa2" returned: 0 in 0.245s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:23:59 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c55c51ee-cdcf-40f1-b95d-7723ead3800d tempest-TestServerVolumeAttachmentScenario-279157639 None] Lock "cinder-quobyte-1534476b-4053-43db-84a4-45547eb43aa2" released by "delete_volume" :: held 0.696s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:23:59 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-c55c51ee-cdcf-40f1-b95d-7723ead3800d tempest-TestServerVolumeAttachmentScenario-279157639 None] Created reservations ['8d788e9d-fd0b-45af-a77c-42609bf37418', 'b2a167ea-5689-498d-b6c3-0f376be1d750', '881e7d66-c8ff-4038-9764-a2e2b8c93a42', '1a7d9e54-c538-4136-b462-89be258aae56'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:23:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c55c51ee-cdcf-40f1-b95d-7723ead3800d tempest-TestServerVolumeAttachmentScenario-279157639 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:23:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c55c51ee-cdcf-40f1-b95d-7723ead3800d tempest-TestServerVolumeAttachmentScenario-279157639 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:23:59 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c55c51ee-cdcf-40f1-b95d-7723ead3800d tempest-TestServerVolumeAttachmentScenario-279157639 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:23:59 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c55c51ee-cdcf-40f1-b95d-7723ead3800d tempest-TestServerVolumeAttachmentScenario-279157639 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:23:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c55c51ee-cdcf-40f1-b95d-7723ead3800d tempest-TestServerVolumeAttachmentScenario-279157639 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:23:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c55c51ee-cdcf-40f1-b95d-7723ead3800d tempest-TestServerVolumeAttachmentScenario-279157639 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:23:59 devstack sudo[103627]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:23:59 devstack sudo[103627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:23:59 devstack sudo[103627]: pam_unix(sudo:session): session closed for user root
Nov 04 12:23:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c55c51ee-cdcf-40f1-b95d-7723ead3800d tempest-TestServerVolumeAttachmentScenario-279157639 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.261s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:23:59 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-c55c51ee-cdcf-40f1-b95d-7723ead3800d tempest-TestServerVolumeAttachmentScenario-279157639 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:23:59 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-c55c51ee-cdcf-40f1-b95d-7723ead3800d tempest-TestServerVolumeAttachmentScenario-279157639 None] Deleted volume successfully.
Nov 04 12:23:59 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c55c51ee-cdcf-40f1-b95d-7723ead3800d tempest-TestServerVolumeAttachmentScenario-279157639 None] Lock "cinder-1534476b-4053-43db-84a4-45547eb43aa2-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:24:01 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-77eda593-6e1c-44be-ac87-fd415c2ab1e4 req-fbbfc559-6748-4540-b8cd-ef40d7945ee8 tempest-TestInstancesWithCinderVolumes-486601865 None] Terminate volume connection completed successfully.
Nov 04 12:24:01 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-77eda593-6e1c-44be-ac87-fd415c2ab1e4 req-fbbfc559-6748-4540-b8cd-ef40d7945ee8 tempest-TestInstancesWithCinderVolumes-486601865 None] Deleting attachment c4bbf134-239a-4825-899c-e0a7273241af. {{(pid=87169) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 12:24:01 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-210ef240-e247-4537-b6d5-29a15443ba0a tempest-TestInstancesWithCinderVolumes-486601865 None] Acquiring lock "cinder-185851ea-a65c-4960-a8be-36b48c4bd4ea-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:24:01 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-210ef240-e247-4537-b6d5-29a15443ba0a tempest-TestInstancesWithCinderVolumes-486601865 None] Lock "cinder-185851ea-a65c-4960-a8be-36b48c4bd4ea-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:24:01 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-210ef240-e247-4537-b6d5-29a15443ba0a tempest-TestInstancesWithCinderVolumes-486601865 None] Acquiring lock "cinder-quobyte-185851ea-a65c-4960-a8be-36b48c4bd4ea" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:24:01 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-210ef240-e247-4537-b6d5-29a15443ba0a tempest-TestInstancesWithCinderVolumes-486601865 None] Lock "cinder-quobyte-185851ea-a65c-4960-a8be-36b48c4bd4ea" acquired by "delete_volume" :: waited 0.015s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:24:01 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe18a109-cafb-453b-8e7b-7a7ba6805765]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:24:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-210ef240-e247-4537-b6d5-29a15443ba0a tempest-TestInstancesWithCinderVolumes-486601865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-185851ea-a65c-4960-a8be-36b48c4bd4ea {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:24:02 devstack sudo[103646]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-185851ea-a65c-4960-a8be-36b48c4bd4ea
Nov 04 12:24:02 devstack sudo[103646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:24:02 devstack sudo[103646]: pam_unix(sudo:session): session closed for user root
Nov 04 12:24:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-210ef240-e247-4537-b6d5-29a15443ba0a tempest-TestInstancesWithCinderVolumes-486601865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-185851ea-a65c-4960-a8be-36b48c4bd4ea" returned: 0 in 0.439s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:24:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-210ef240-e247-4537-b6d5-29a15443ba0a tempest-TestInstancesWithCinderVolumes-486601865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-185851ea-a65c-4960-a8be-36b48c4bd4ea {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:24:02 devstack sudo[103651]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-185851ea-a65c-4960-a8be-36b48c4bd4ea
Nov 04 12:24:02 devstack sudo[103651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:24:02 devstack sudo[103651]: pam_unix(sudo:session): session closed for user root
Nov 04 12:24:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-210ef240-e247-4537-b6d5-29a15443ba0a tempest-TestInstancesWithCinderVolumes-486601865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-185851ea-a65c-4960-a8be-36b48c4bd4ea" returned: 0 in 0.262s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:24:02 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-210ef240-e247-4537-b6d5-29a15443ba0a tempest-TestInstancesWithCinderVolumes-486601865 None] Lock "cinder-quobyte-185851ea-a65c-4960-a8be-36b48c4bd4ea" released by "delete_volume" :: held 0.758s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:24:02 devstack cinder-volume[87169]: WARNING cinder.quota [None req-210ef240-e247-4537-b6d5-29a15443ba0a tempest-TestInstancesWithCinderVolumes-486601865 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1686479946-1567606379 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1686479946-1567606379, it is now deprecated. Please use the default quota class for default quota.
Nov 04 12:24:02 devstack cinder-volume[87169]: WARNING cinder.quota [None req-210ef240-e247-4537-b6d5-29a15443ba0a tempest-TestInstancesWithCinderVolumes-486601865 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1686479946-1567606379 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1686479946-1567606379, it is now deprecated. Please use the default quota class for default quota.
Nov 04 12:24:02 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-210ef240-e247-4537-b6d5-29a15443ba0a tempest-TestInstancesWithCinderVolumes-486601865 None] Created reservations ['176b20fe-776b-4036-b6d8-a74ded048fb8', '8bc69f02-c93c-4dcf-8a5e-d331cf684788', '244c98c0-5246-4a41-a062-a35704722e5f', '82a85987-056f-4068-8256-e1a782cc3698'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:24:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-210ef240-e247-4537-b6d5-29a15443ba0a tempest-TestInstancesWithCinderVolumes-486601865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:24:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-210ef240-e247-4537-b6d5-29a15443ba0a tempest-TestInstancesWithCinderVolumes-486601865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:24:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-210ef240-e247-4537-b6d5-29a15443ba0a tempest-TestInstancesWithCinderVolumes-486601865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:24:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-210ef240-e247-4537-b6d5-29a15443ba0a tempest-TestInstancesWithCinderVolumes-486601865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:24:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-210ef240-e247-4537-b6d5-29a15443ba0a tempest-TestInstancesWithCinderVolumes-486601865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:24:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-210ef240-e247-4537-b6d5-29a15443ba0a tempest-TestInstancesWithCinderVolumes-486601865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:24:02 devstack sudo[103654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:24:02 devstack sudo[103654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:24:03 devstack sudo[103654]: pam_unix(sudo:session): session closed for user root
Nov 04 12:24:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-210ef240-e247-4537-b6d5-29a15443ba0a tempest-TestInstancesWithCinderVolumes-486601865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.284s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:24:03 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-210ef240-e247-4537-b6d5-29a15443ba0a tempest-TestInstancesWithCinderVolumes-486601865 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:24:03 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-210ef240-e247-4537-b6d5-29a15443ba0a tempest-TestInstancesWithCinderVolumes-486601865 None] Deleted volume successfully.
Nov 04 12:24:03 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-210ef240-e247-4537-b6d5-29a15443ba0a tempest-TestInstancesWithCinderVolumes-486601865 None] Lock "cinder-185851ea-a65c-4960-a8be-36b48c4bd4ea-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:24:06 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-a3f559ae-f778-4c89-97ef-c271c4e2376b req-88ee9911-0fbd-4133-a1d5-32f2bdae156a tempest-TestInstancesWithCinderVolumes-486601865 None] Terminate volume connection completed successfully.
Nov 04 12:24:06 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-a3f559ae-f778-4c89-97ef-c271c4e2376b req-88ee9911-0fbd-4133-a1d5-32f2bdae156a tempest-TestInstancesWithCinderVolumes-486601865 None] Deleting attachment d57951ad-5e28-42ec-85b6-166782879543. {{(pid=87169) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 12:24:07 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-7a3192ca-6403-4272-8a46-16ffd8b23c25 tempest-TestInstancesWithCinderVolumes-486601865 None] Acquiring lock "cinder-a2f091b0-c147-400d-95c3-37959961171a-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:24:07 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-7a3192ca-6403-4272-8a46-16ffd8b23c25 tempest-TestInstancesWithCinderVolumes-486601865 None] Lock "cinder-a2f091b0-c147-400d-95c3-37959961171a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:24:07 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-7a3192ca-6403-4272-8a46-16ffd8b23c25 tempest-TestInstancesWithCinderVolumes-486601865 None] Acquiring lock "cinder-quobyte-a2f091b0-c147-400d-95c3-37959961171a" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:24:07 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-7a3192ca-6403-4272-8a46-16ffd8b23c25 tempest-TestInstancesWithCinderVolumes-486601865 None] Lock "cinder-quobyte-a2f091b0-c147-400d-95c3-37959961171a" acquired by "delete_volume" :: waited 0.016s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:24:08 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ad61e2-1b48-4b21-b999-92111d606556]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:24:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7a3192ca-6403-4272-8a46-16ffd8b23c25 tempest-TestInstancesWithCinderVolumes-486601865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a2f091b0-c147-400d-95c3-37959961171a {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:24:08 devstack sudo[103688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a2f091b0-c147-400d-95c3-37959961171a
Nov 04 12:24:08 devstack sudo[103688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:24:08 devstack sudo[103688]: pam_unix(sudo:session): session closed for user root
Nov 04 12:24:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7a3192ca-6403-4272-8a46-16ffd8b23c25 tempest-TestInstancesWithCinderVolumes-486601865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a2f091b0-c147-400d-95c3-37959961171a" returned: 0 in 0.366s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:24:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7a3192ca-6403-4272-8a46-16ffd8b23c25 tempest-TestInstancesWithCinderVolumes-486601865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a2f091b0-c147-400d-95c3-37959961171a {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:24:08 devstack sudo[103693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a2f091b0-c147-400d-95c3-37959961171a
Nov 04 12:24:08 devstack sudo[103693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:24:08 devstack sudo[103693]: pam_unix(sudo:session): session closed for user root
Nov 04 12:24:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7a3192ca-6403-4272-8a46-16ffd8b23c25 tempest-TestInstancesWithCinderVolumes-486601865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a2f091b0-c147-400d-95c3-37959961171a" returned: 0 in 0.298s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:24:08 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-7a3192ca-6403-4272-8a46-16ffd8b23c25 tempest-TestInstancesWithCinderVolumes-486601865 None] Lock "cinder-quobyte-a2f091b0-c147-400d-95c3-37959961171a" released by "delete_volume" :: held 0.708s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:24:08 devstack cinder-volume[87169]: WARNING cinder.quota [None req-7a3192ca-6403-4272-8a46-16ffd8b23c25 tempest-TestInstancesWithCinderVolumes-486601865 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1736720883-1866052239 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1736720883-1866052239, it is now deprecated. Please use the default quota class for default quota.
Nov 04 12:24:08 devstack cinder-volume[87169]: WARNING cinder.quota [None req-7a3192ca-6403-4272-8a46-16ffd8b23c25 tempest-TestInstancesWithCinderVolumes-486601865 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1736720883-1866052239 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1736720883-1866052239, it is now deprecated. Please use the default quota class for default quota.
Nov 04 12:24:08 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-7a3192ca-6403-4272-8a46-16ffd8b23c25 tempest-TestInstancesWithCinderVolumes-486601865 None] Created reservations ['76011ac9-e715-4059-b8f2-ab6029820be2', 'a47fa750-ce6b-4bad-832f-ec193b3ab62c', '2fd63d24-1411-4109-805d-a56d622e5f9f', '9897192a-44a9-4fe1-8a19-82aa401b10db'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:24:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7a3192ca-6403-4272-8a46-16ffd8b23c25 tempest-TestInstancesWithCinderVolumes-486601865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:24:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7a3192ca-6403-4272-8a46-16ffd8b23c25 tempest-TestInstancesWithCinderVolumes-486601865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:24:08 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-7a3192ca-6403-4272-8a46-16ffd8b23c25 tempest-TestInstancesWithCinderVolumes-486601865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:24:08 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-7a3192ca-6403-4272-8a46-16ffd8b23c25 tempest-TestInstancesWithCinderVolumes-486601865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:24:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7a3192ca-6403-4272-8a46-16ffd8b23c25 tempest-TestInstancesWithCinderVolumes-486601865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:24:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7a3192ca-6403-4272-8a46-16ffd8b23c25 tempest-TestInstancesWithCinderVolumes-486601865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:24:08 devstack sudo[103696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:24:08 devstack sudo[103696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:24:09 devstack sudo[103696]: pam_unix(sudo:session): session closed for user root
Nov 04 12:24:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7a3192ca-6403-4272-8a46-16ffd8b23c25 tempest-TestInstancesWithCinderVolumes-486601865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.251s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:24:09 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-7a3192ca-6403-4272-8a46-16ffd8b23c25 tempest-TestInstancesWithCinderVolumes-486601865 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:24:09 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-7a3192ca-6403-4272-8a46-16ffd8b23c25 tempest-TestInstancesWithCinderVolumes-486601865 None] Deleted volume successfully.
Nov 04 12:24:09 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-7a3192ca-6403-4272-8a46-16ffd8b23c25 tempest-TestInstancesWithCinderVolumes-486601865 None] Lock "cinder-a2f091b0-c147-400d-95c3-37959961171a-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:24:18 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=57,cinder:UPDATE=49,cinder:INSERT=12,cinder:DELETE=2 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:24:19 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=56,cinder:UPDATE=44,cinder:INSERT=8,cinder:DELETE=3 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:24:30 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e5efdc3-cede-4a7c-91a8-2122c8cc4e03 tempest-TestImageHashVerification-2024699076 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:24:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7e5efdc3-cede-4a7c-91a8-2122c8cc4e03 tempest-TestImageHashVerification-2024699076 None] Flow 'volume_create_manager' (9973cbc2-653b-4267-a6b1-27a0ba5fe90c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:24:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7e5efdc3-cede-4a7c-91a8-2122c8cc4e03 tempest-TestImageHashVerification-2024699076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1b7378d-2380-4aba-ac63-54e1da145541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:24:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7e5efdc3-cede-4a7c-91a8-2122c8cc4e03 tempest-TestImageHashVerification-2024699076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1b7378d-2380-4aba-ac63-54e1da145541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-6514078',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2b2849e-9e7c-4047-ad98-89b392b67b87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2d400a4bab844a080cb4c9f647beedb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:24:31Z,use_quota=True,user_id='61d91dc9172e4e3d9cc1c966ba980816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:24:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7e5efdc3-cede-4a7c-91a8-2122c8cc4e03 tempest-TestImageHashVerification-2024699076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a4df0c1-fce2-4f99-8b83-ed733208ebc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:24:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7e5efdc3-cede-4a7c-91a8-2122c8cc4e03 tempest-TestImageHashVerification-2024699076 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a4df0c1-fce2-4f99-8b83-ed733208ebc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:24:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7e5efdc3-cede-4a7c-91a8-2122c8cc4e03 tempest-TestImageHashVerification-2024699076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e04f6eb-7976-4080-98e3-053e445ec955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:24:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7e5efdc3-cede-4a7c-91a8-2122c8cc4e03 tempest-TestImageHashVerification-2024699076 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e04f6eb-7976-4080-98e3-053e445ec955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2b2849e-9e7c-4047-ad98-89b392b67b87', 'volume_name': 'volume-e2b2849e-9e7c-4047-ad98-89b392b67b87', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:24:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7e5efdc3-cede-4a7c-91a8-2122c8cc4e03 tempest-TestImageHashVerification-2024699076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e588c41-42db-4730-9e31-afc00d7a71e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:24:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7e5efdc3-cede-4a7c-91a8-2122c8cc4e03 tempest-TestImageHashVerification-2024699076 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e588c41-42db-4730-9e31-afc00d7a71e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:24:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7e5efdc3-cede-4a7c-91a8-2122c8cc4e03 tempest-TestImageHashVerification-2024699076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33e5a323-5aba-460d-9448-ec28ef413839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:24:30 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-7e5efdc3-cede-4a7c-91a8-2122c8cc4e03 tempest-TestImageHashVerification-2024699076 None] Volume e2b2849e-9e7c-4047-ad98-89b392b67b87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2b2849e-9e7c-4047-ad98-89b392b67b87', 'volume_size': 1}
Nov 04 12:24:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7e5efdc3-cede-4a7c-91a8-2122c8cc4e03 tempest-TestImageHashVerification-2024699076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:24:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7e5efdc3-cede-4a7c-91a8-2122c8cc4e03 tempest-TestImageHashVerification-2024699076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:24:30 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-7e5efdc3-cede-4a7c-91a8-2122c8cc4e03 tempest-TestImageHashVerification-2024699076 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-6514078',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2b2849e-9e7c-4047-ad98-89b392b67b87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2d400a4bab844a080cb4c9f647beedb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:24:31Z,use_quota=True,user_id='61d91dc9172e4e3d9cc1c966ba980816',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:24:30 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-7e5efdc3-cede-4a7c-91a8-2122c8cc4e03 tempest-TestImageHashVerification-2024699076 None] Creating volume e2b2849e-9e7c-4047-ad98-89b392b67b87 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:24:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7e5efdc3-cede-4a7c-91a8-2122c8cc4e03 tempest-TestImageHashVerification-2024699076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:24:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7e5efdc3-cede-4a7c-91a8-2122c8cc4e03 tempest-TestImageHashVerification-2024699076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:24:30 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-7e5efdc3-cede-4a7c-91a8-2122c8cc4e03 tempest-TestImageHashVerification-2024699076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:24:30 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-7e5efdc3-cede-4a7c-91a8-2122c8cc4e03 tempest-TestImageHashVerification-2024699076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:24:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7e5efdc3-cede-4a7c-91a8-2122c8cc4e03 tempest-TestImageHashVerification-2024699076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:24:30 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-7e5efdc3-cede-4a7c-91a8-2122c8cc4e03 tempest-TestImageHashVerification-2024699076 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:24:30 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-7e5efdc3-cede-4a7c-91a8-2122c8cc4e03 tempest-TestImageHashVerification-2024699076 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:24:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7e5efdc3-cede-4a7c-91a8-2122c8cc4e03 tempest-TestImageHashVerification-2024699076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e2b2849e-9e7c-4047-ad98-89b392b67b87 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:24:30 devstack sudo[103707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e2b2849e-9e7c-4047-ad98-89b392b67b87 1073741824
Nov 04 12:24:30 devstack sudo[103707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:24:31 devstack sudo[103707]: pam_unix(sudo:session): session closed for user root
Nov 04 12:24:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7e5efdc3-cede-4a7c-91a8-2122c8cc4e03 tempest-TestImageHashVerification-2024699076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e2b2849e-9e7c-4047-ad98-89b392b67b87 1073741824" returned: 0 in 0.479s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:24:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7e5efdc3-cede-4a7c-91a8-2122c8cc4e03 tempest-TestImageHashVerification-2024699076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e2b2849e-9e7c-4047-ad98-89b392b67b87 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:24:31 devstack sudo[103714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e2b2849e-9e7c-4047-ad98-89b392b67b87
Nov 04 12:24:31 devstack sudo[103714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:24:31 devstack sudo[103714]: pam_unix(sudo:session): session closed for user root
Nov 04 12:24:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7e5efdc3-cede-4a7c-91a8-2122c8cc4e03 tempest-TestImageHashVerification-2024699076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e2b2849e-9e7c-4047-ad98-89b392b67b87" returned: 0 in 0.270s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:24:31 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-7e5efdc3-cede-4a7c-91a8-2122c8cc4e03 tempest-TestImageHashVerification-2024699076 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:24:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7e5efdc3-cede-4a7c-91a8-2122c8cc4e03 tempest-TestImageHashVerification-2024699076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:24:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7e5efdc3-cede-4a7c-91a8-2122c8cc4e03 tempest-TestImageHashVerification-2024699076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33e5a323-5aba-460d-9448-ec28ef413839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2b2849e-9e7c-4047-ad98-89b392b67b87', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:24:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7e5efdc3-cede-4a7c-91a8-2122c8cc4e03 tempest-TestImageHashVerification-2024699076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cd7e895-e294-46bf-a83f-664f0580dcb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:24:31 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-7e5efdc3-cede-4a7c-91a8-2122c8cc4e03 tempest-TestImageHashVerification-2024699076 None] Volume volume-e2b2849e-9e7c-4047-ad98-89b392b67b87 (e2b2849e-9e7c-4047-ad98-89b392b67b87): created successfully
Nov 04 12:24:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7e5efdc3-cede-4a7c-91a8-2122c8cc4e03 tempest-TestImageHashVerification-2024699076 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6cd7e895-e294-46bf-a83f-664f0580dcb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:24:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7e5efdc3-cede-4a7c-91a8-2122c8cc4e03 tempest-TestImageHashVerification-2024699076 None] Flow 'volume_create_manager' (9973cbc2-653b-4267-a6b1-27a0ba5fe90c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:24:31 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-7e5efdc3-cede-4a7c-91a8-2122c8cc4e03 tempest-TestImageHashVerification-2024699076 None] Created volume successfully.
Nov 04 12:24:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-88bc8357-defe-472f-a115-e7befd29b23d tempest-TestImageHashVerification-2024699076 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:24:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-88bc8357-defe-472f-a115-e7befd29b23d tempest-TestImageHashVerification-2024699076 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:24:33 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e892730-aae8-4ace-a9b4-06425ea4bc58]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:24:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-88bc8357-defe-472f-a115-e7befd29b23d tempest-TestImageHashVerification-2024699076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e2b2849e-9e7c-4047-ad98-89b392b67b87 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:24:34 devstack sudo[103723]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e2b2849e-9e7c-4047-ad98-89b392b67b87
Nov 04 12:24:34 devstack sudo[103723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:24:34 devstack sudo[103723]: pam_unix(sudo:session): session closed for user root
Nov 04 12:24:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-88bc8357-defe-472f-a115-e7befd29b23d tempest-TestImageHashVerification-2024699076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e2b2849e-9e7c-4047-ad98-89b392b67b87" returned: 0 in 0.451s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:24:34 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[c698f056-76f9-4f69-94a8-b4df15b7280c]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:24:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-88bc8357-defe-472f-a115-e7befd29b23d tempest-TestImageHashVerification-2024699076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e2b2849e-9e7c-4047-ad98-89b392b67b87 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:24:34 devstack sudo[103729]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e2b2849e-9e7c-4047-ad98-89b392b67b87
Nov 04 12:24:34 devstack sudo[103729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:24:34 devstack sudo[103729]: pam_unix(sudo:session): session closed for user root
Nov 04 12:24:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-88bc8357-defe-472f-a115-e7befd29b23d tempest-TestImageHashVerification-2024699076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e2b2849e-9e7c-4047-ad98-89b392b67b87" returned: 0 in 0.438s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:24:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-88bc8357-defe-472f-a115-e7befd29b23d tempest-TestImageHashVerification-2024699076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e2b2849e-9e7c-4047-ad98-89b392b67b87 /opt/stack/data/cinder/conversion/e2b2849e-9e7c-4047-ad98-89b392b67b87.temp_image.2ba3ac0c-2504-47a9-bc46-2625e7aa1f6eze7pzvjl.img {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:24:34 devstack sudo[103735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e2b2849e-9e7c-4047-ad98-89b392b67b87 /opt/stack/data/cinder/conversion/e2b2849e-9e7c-4047-ad98-89b392b67b87.temp_image.2ba3ac0c-2504-47a9-bc46-2625e7aa1f6eze7pzvjl.img
Nov 04 12:24:34 devstack sudo[103735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:24:41 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:24:42 devstack sudo[103735]: pam_unix(sudo:session): session closed for user root
Nov 04 12:24:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-88bc8357-defe-472f-a115-e7befd29b23d tempest-TestImageHashVerification-2024699076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e2b2849e-9e7c-4047-ad98-89b392b67b87 /opt/stack/data/cinder/conversion/e2b2849e-9e7c-4047-ad98-89b392b67b87.temp_image.2ba3ac0c-2504-47a9-bc46-2625e7aa1f6eze7pzvjl.img" returned: 0 in 7.475s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:24:42 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d2eb31-6234-4dfd-860c-4c90b166f40d]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:24:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-88bc8357-defe-472f-a115-e7befd29b23d tempest-TestImageHashVerification-2024699076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e2b2849e-9e7c-4047-ad98-89b392b67b87 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:24:42 devstack sudo[103785]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e2b2849e-9e7c-4047-ad98-89b392b67b87
Nov 04 12:24:42 devstack sudo[103785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:24:42 devstack sudo[103785]: pam_unix(sudo:session): session closed for user root
Nov 04 12:24:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-88bc8357-defe-472f-a115-e7befd29b23d tempest-TestImageHashVerification-2024699076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e2b2849e-9e7c-4047-ad98-89b392b67b87" returned: 0 in 0.529s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:24:42 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-88bc8357-defe-472f-a115-e7befd29b23d tempest-TestImageHashVerification-2024699076 None] Image conversion details: src /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e2b2849e-9e7c-4047-ad98-89b392b67b87, size 1024.00 MB, duration 7.48 sec, destination /opt/stack/data/cinder/conversion/e2b2849e-9e7c-4047-ad98-89b392b67b87.temp_image.2ba3ac0c-2504-47a9-bc46-2625e7aa1f6eze7pzvjl.img {{(pid=87169) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 12:24:42 devstack cinder-volume[87169]: INFO cinder.image.image_utils [None req-88bc8357-defe-472f-a115-e7befd29b23d tempest-TestImageHashVerification-2024699076 None] Converted 1024.00 MB image at 136.95 MB/s
Nov 04 12:24:42 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-88bc8357-defe-472f-a115-e7befd29b23d tempest-TestImageHashVerification-2024699076 None] 2ba3ac0c-2504-47a9-bc46-2625e7aa1f6e was raw, no need to convert to raw {{(pid=87169) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}}
Nov 04 12:24:43 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:UPDATE=4,cinder:SELECT=3 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:24:49 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:24:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:24:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:24:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:24:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:24:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:24:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:24:49 devstack sudo[103790]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:24:49 devstack sudo[103790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:24:50 devstack sudo[103790]: pam_unix(sudo:session): session closed for user root
Nov 04 12:24:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.308s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:24:50 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:24:50 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager._thread_info {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:24:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread count: 28 {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 12:24:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread info: [<_MainThread(MainThread, started 137165867425920)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137165754678912)>, <Thread(Thread-3 (stat_writer), started daemon 137165754130752)>, <Thread(Rabbit-heartbeat, started daemon 137165752997504)>, <Thread(Thread-5 (_runner), started daemon 137165753227712)>, <Thread(Thread-7 (_runner), started daemon 137165751273856)>, <Thread(fd_logger, started daemon 137165755322048)>, <Thread(privsep_reader, started daemon 137165748896704)>, <Thread(tpool_thread_0, started daemon 137165742520000)>, <Thread(tpool_thread_1, started daemon 137165734127296)>, <Thread(tpool_thread_2, started daemon 137165725734592)>, <Thread(tpool_thread_3, started daemon 137165717341888)>, <Thread(tpool_thread_4, started daemon 137165708949184)>, <Thread(tpool_thread_5, started daemon 137165700556480)>, <Thread(tpool_thread_6, started daemon 137165692163776)>, <Thread(tpool_thread_7, started daemon 137165683771072)>, <Thread(tpool_thread_8, started daemon 137165675378368)>, <Thread(tpool_thread_9, started daemon 137165666985664)>, <Thread(tpool_thread_10, started daemon 137165658592960)>, <Thread(tpool_thread_11, started daemon 137165650183872)>, <Thread(tpool_thread_12, started daemon 137165641774784)>, <Thread(tpool_thread_13, started daemon 137165633365696)>, <Thread(tpool_thread_14, started daemon 137165624956608)>, <Thread(tpool_thread_15, started daemon 137165616547520)>, <Thread(tpool_thread_16, started daemon 137165608138432)>, <Thread(tpool_thread_17, started daemon 137165599729344)>, <Thread(tpool_thread_18, started daemon 137165591320256)>, <Thread(tpool_thread_19, started daemon 137165582911168)>] {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 12:24:52 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=2 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:25:03 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed88dbce-045f-40f6-a874-e04d4ddea48f tempest-TestMinimumBasicScenario-1715384600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:25:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ed88dbce-045f-40f6-a874-e04d4ddea48f tempest-TestMinimumBasicScenario-1715384600 None] Flow 'volume_create_manager' (6c512c79-e907-4047-aebc-452752c69e0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:25:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ed88dbce-045f-40f6-a874-e04d4ddea48f tempest-TestMinimumBasicScenario-1715384600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f040e13a-c7fe-4252-9380-1de9609ca607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:25:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ed88dbce-045f-40f6-a874-e04d4ddea48f tempest-TestMinimumBasicScenario-1715384600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f040e13a-c7fe-4252-9380-1de9609ca607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2143456455',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00696832-16c1-4b00-8599-944665f489c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='356ce5c5565b41719dbbf1577c008b94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:25:03Z,use_quota=True,user_id='97a823a526084cb1a281228b6ce7f48d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:25:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ed88dbce-045f-40f6-a874-e04d4ddea48f tempest-TestMinimumBasicScenario-1715384600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dfccc54-7b98-413e-9dae-c4860d75a16e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:25:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ed88dbce-045f-40f6-a874-e04d4ddea48f tempest-TestMinimumBasicScenario-1715384600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5dfccc54-7b98-413e-9dae-c4860d75a16e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:25:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ed88dbce-045f-40f6-a874-e04d4ddea48f tempest-TestMinimumBasicScenario-1715384600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec94a855-15ae-49bd-9c48-6cf8988df8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:25:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ed88dbce-045f-40f6-a874-e04d4ddea48f tempest-TestMinimumBasicScenario-1715384600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec94a855-15ae-49bd-9c48-6cf8988df8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00696832-16c1-4b00-8599-944665f489c7', 'volume_name': 'volume-00696832-16c1-4b00-8599-944665f489c7', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:25:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ed88dbce-045f-40f6-a874-e04d4ddea48f tempest-TestMinimumBasicScenario-1715384600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54005d0c-6d14-46c2-8f04-786488188e8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:25:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ed88dbce-045f-40f6-a874-e04d4ddea48f tempest-TestMinimumBasicScenario-1715384600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54005d0c-6d14-46c2-8f04-786488188e8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:25:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ed88dbce-045f-40f6-a874-e04d4ddea48f tempest-TestMinimumBasicScenario-1715384600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7dab2fc-e124-4d57-a06d-65da3e239132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:25:03 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-ed88dbce-045f-40f6-a874-e04d4ddea48f tempest-TestMinimumBasicScenario-1715384600 None] Volume 00696832-16c1-4b00-8599-944665f489c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00696832-16c1-4b00-8599-944665f489c7', 'volume_size': 1}
Nov 04 12:25:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ed88dbce-045f-40f6-a874-e04d4ddea48f tempest-TestMinimumBasicScenario-1715384600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:25:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-88bc8357-defe-472f-a115-e7befd29b23d tempest-TestImageHashVerification-2024699076 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.240s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:25:05 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-88bc8357-defe-472f-a115-e7befd29b23d tempest-TestImageHashVerification-2024699076 None] Uploaded volume to glance image-id: 2ba3ac0c-2504-47a9-bc46-2625e7aa1f6e. {{(pid=87169) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}}
Nov 04 12:25:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ed88dbce-045f-40f6-a874-e04d4ddea48f tempest-TestMinimumBasicScenario-1715384600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.460s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:25:05 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ed88dbce-045f-40f6-a874-e04d4ddea48f tempest-TestMinimumBasicScenario-1715384600 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2143456455',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00696832-16c1-4b00-8599-944665f489c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='356ce5c5565b41719dbbf1577c008b94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:25:03Z,use_quota=True,user_id='97a823a526084cb1a281228b6ce7f48d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:25:05 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-ed88dbce-045f-40f6-a874-e04d4ddea48f tempest-TestMinimumBasicScenario-1715384600 None] Creating volume 00696832-16c1-4b00-8599-944665f489c7 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:25:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ed88dbce-045f-40f6-a874-e04d4ddea48f tempest-TestMinimumBasicScenario-1715384600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:25:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ed88dbce-045f-40f6-a874-e04d4ddea48f tempest-TestMinimumBasicScenario-1715384600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:25:05 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ed88dbce-045f-40f6-a874-e04d4ddea48f tempest-TestMinimumBasicScenario-1715384600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:25:05 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ed88dbce-045f-40f6-a874-e04d4ddea48f tempest-TestMinimumBasicScenario-1715384600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:25:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ed88dbce-045f-40f6-a874-e04d4ddea48f tempest-TestMinimumBasicScenario-1715384600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:25:05 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ed88dbce-045f-40f6-a874-e04d4ddea48f tempest-TestMinimumBasicScenario-1715384600 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:25:05 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-ed88dbce-045f-40f6-a874-e04d4ddea48f tempest-TestMinimumBasicScenario-1715384600 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:25:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ed88dbce-045f-40f6-a874-e04d4ddea48f tempest-TestMinimumBasicScenario-1715384600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-00696832-16c1-4b00-8599-944665f489c7 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:25:05 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-88bc8357-defe-472f-a115-e7befd29b23d tempest-TestImageHashVerification-2024699076 None] Copy volume to image completed successfully.
Nov 04 12:25:05 devstack sudo[103909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-00696832-16c1-4b00-8599-944665f489c7 1073741824
Nov 04 12:25:05 devstack sudo[103909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:25:05 devstack sudo[103909]: pam_unix(sudo:session): session closed for user root
Nov 04 12:25:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ed88dbce-045f-40f6-a874-e04d4ddea48f tempest-TestMinimumBasicScenario-1715384600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-00696832-16c1-4b00-8599-944665f489c7 1073741824" returned: 0 in 0.530s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:25:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ed88dbce-045f-40f6-a874-e04d4ddea48f tempest-TestMinimumBasicScenario-1715384600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-00696832-16c1-4b00-8599-944665f489c7 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:25:05 devstack sudo[103915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-00696832-16c1-4b00-8599-944665f489c7
Nov 04 12:25:05 devstack sudo[103915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:25:05 devstack sudo[103915]: pam_unix(sudo:session): session closed for user root
Nov 04 12:25:05 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1d9d1435-0992-4886-baef-acdb5589159c tempest-TestImageHashVerification-2024699076 None] Acquiring lock "cinder-e2b2849e-9e7c-4047-ad98-89b392b67b87-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:25:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ed88dbce-045f-40f6-a874-e04d4ddea48f tempest-TestMinimumBasicScenario-1715384600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-00696832-16c1-4b00-8599-944665f489c7" returned: 0 in 0.279s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:25:05 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ed88dbce-045f-40f6-a874-e04d4ddea48f tempest-TestMinimumBasicScenario-1715384600 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:25:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ed88dbce-045f-40f6-a874-e04d4ddea48f tempest-TestMinimumBasicScenario-1715384600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:25:05 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1d9d1435-0992-4886-baef-acdb5589159c tempest-TestImageHashVerification-2024699076 None] Lock "cinder-e2b2849e-9e7c-4047-ad98-89b392b67b87-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:25:05 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ed88dbce-045f-40f6-a874-e04d4ddea48f tempest-TestMinimumBasicScenario-1715384600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7dab2fc-e124-4d57-a06d-65da3e239132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00696832-16c1-4b00-8599-944665f489c7', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:25:05 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ed88dbce-045f-40f6-a874-e04d4ddea48f tempest-TestMinimumBasicScenario-1715384600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fd4d7dc-4e33-41e3-9998-ade08e0feae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:25:06 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-ed88dbce-045f-40f6-a874-e04d4ddea48f tempest-TestMinimumBasicScenario-1715384600 None] Volume volume-00696832-16c1-4b00-8599-944665f489c7 (00696832-16c1-4b00-8599-944665f489c7): created successfully
Nov 04 12:25:06 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ed88dbce-045f-40f6-a874-e04d4ddea48f tempest-TestMinimumBasicScenario-1715384600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fd4d7dc-4e33-41e3-9998-ade08e0feae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:25:06 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-ed88dbce-045f-40f6-a874-e04d4ddea48f tempest-TestMinimumBasicScenario-1715384600 None] Flow 'volume_create_manager' (6c512c79-e907-4047-aebc-452752c69e0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:25:06 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-ed88dbce-045f-40f6-a874-e04d4ddea48f tempest-TestMinimumBasicScenario-1715384600 None] Created volume successfully.
Nov 04 12:25:06 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1d9d1435-0992-4886-baef-acdb5589159c tempest-TestImageHashVerification-2024699076 None] Acquiring lock "cinder-quobyte-e2b2849e-9e7c-4047-ad98-89b392b67b87" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:25:06 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1d9d1435-0992-4886-baef-acdb5589159c tempest-TestImageHashVerification-2024699076 None] Lock "cinder-quobyte-e2b2849e-9e7c-4047-ad98-89b392b67b87" acquired by "delete_volume" :: waited 0.022s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:25:06 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fd6085-e6a2-4e23-95f4-5fc8b798b011]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:25:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1d9d1435-0992-4886-baef-acdb5589159c tempest-TestImageHashVerification-2024699076 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e2b2849e-9e7c-4047-ad98-89b392b67b87 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:25:06 devstack sudo[103918]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e2b2849e-9e7c-4047-ad98-89b392b67b87
Nov 04 12:25:06 devstack sudo[103918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:25:06 devstack sudo[103918]: pam_unix(sudo:session): session closed for user root
Nov 04 12:25:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1d9d1435-0992-4886-baef-acdb5589159c tempest-TestImageHashVerification-2024699076 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e2b2849e-9e7c-4047-ad98-89b392b67b87" returned: 0 in 0.369s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:25:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1d9d1435-0992-4886-baef-acdb5589159c tempest-TestImageHashVerification-2024699076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e2b2849e-9e7c-4047-ad98-89b392b67b87 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:25:06 devstack sudo[103923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e2b2849e-9e7c-4047-ad98-89b392b67b87
Nov 04 12:25:06 devstack sudo[103923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:25:06 devstack sudo[103923]: pam_unix(sudo:session): session closed for user root
Nov 04 12:25:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1d9d1435-0992-4886-baef-acdb5589159c tempest-TestImageHashVerification-2024699076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e2b2849e-9e7c-4047-ad98-89b392b67b87" returned: 0 in 0.358s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:25:06 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1d9d1435-0992-4886-baef-acdb5589159c tempest-TestImageHashVerification-2024699076 None] Lock "cinder-quobyte-e2b2849e-9e7c-4047-ad98-89b392b67b87" released by "delete_volume" :: held 0.775s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:25:06 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-1d9d1435-0992-4886-baef-acdb5589159c tempest-TestImageHashVerification-2024699076 None] Created reservations ['3467d43c-73cc-45a4-8f05-0b94e4229043', 'b9f40c6a-483a-40a9-a4b6-f0ea4aba0f18', '5249b75a-8af6-486e-abd3-0fb3e8bf2921', 'f1a65a77-5ad5-4370-8d3e-f8cd04a091e3'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:25:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1d9d1435-0992-4886-baef-acdb5589159c tempest-TestImageHashVerification-2024699076 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:25:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1d9d1435-0992-4886-baef-acdb5589159c tempest-TestImageHashVerification-2024699076 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:25:07 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1d9d1435-0992-4886-baef-acdb5589159c tempest-TestImageHashVerification-2024699076 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:25:07 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1d9d1435-0992-4886-baef-acdb5589159c tempest-TestImageHashVerification-2024699076 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:25:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1d9d1435-0992-4886-baef-acdb5589159c tempest-TestImageHashVerification-2024699076 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:25:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1d9d1435-0992-4886-baef-acdb5589159c tempest-TestImageHashVerification-2024699076 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:25:07 devstack sudo[104058]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:25:07 devstack sudo[104058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:25:07 devstack sudo[104058]: pam_unix(sudo:session): session closed for user root
Nov 04 12:25:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1d9d1435-0992-4886-baef-acdb5589159c tempest-TestImageHashVerification-2024699076 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.558s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:25:07 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-1d9d1435-0992-4886-baef-acdb5589159c tempest-TestImageHashVerification-2024699076 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:25:07 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-1d9d1435-0992-4886-baef-acdb5589159c tempest-TestImageHashVerification-2024699076 None] Deleted volume successfully.
Nov 04 12:25:07 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1d9d1435-0992-4886-baef-acdb5589159c tempest-TestImageHashVerification-2024699076 None] Lock "cinder-e2b2849e-9e7c-4047-ad98-89b392b67b87-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:25:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-d86e16a0-1ec4-4995-aa24-fa67529e41bc req-2677e503-7e92-4e7c-ba9b-617fa9cbc8ba tempest-TestMinimumBasicScenario-1715384600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:25:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-d86e16a0-1ec4-4995-aa24-fa67529e41bc req-2677e503-7e92-4e7c-ba9b-617fa9cbc8ba tempest-TestMinimumBasicScenario-1715384600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:25:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-d86e16a0-1ec4-4995-aa24-fa67529e41bc req-2677e503-7e92-4e7c-ba9b-617fa9cbc8ba tempest-TestMinimumBasicScenario-1715384600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:25:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-d86e16a0-1ec4-4995-aa24-fa67529e41bc req-2677e503-7e92-4e7c-ba9b-617fa9cbc8ba tempest-TestMinimumBasicScenario-1715384600 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79', 'name': 'volume-00696832-16c1-4b00-8599-944665f489c7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b49a0a2b-529e-493d-bea0-5848707e9df6', 'enforce_multipath': True} {{(pid=87169) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 04 12:25:08 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-d86e16a0-1ec4-4995-aa24-fa67529e41bc req-2677e503-7e92-4e7c-ba9b-617fa9cbc8ba tempest-TestMinimumBasicScenario-1715384600 None] attachment_update completed successfully.
Nov 04 12:25:18 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:UPDATE=12,cinder:INSERT=4,cinder:SELECT=11,cinder:DELETE=1 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:25:18 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=17,cinder:UPDATE=14,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:25:20 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-1160cfe8-ed85-41cb-b7cf-3b827d5b128c tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:25:20 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1160cfe8-ed85-41cb-b7cf-3b827d5b128c tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Flow 'volume_create_manager' (6124357f-4c4d-48a3-8f10-cf413ddb1366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:25:20 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1160cfe8-ed85-41cb-b7cf-3b827d5b128c tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff48d264-2f2e-40a7-85a2-2939b5a13006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:25:20 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1160cfe8-ed85-41cb-b7cf-3b827d5b128c tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff48d264-2f2e-40a7-85a2-2939b5a13006) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-361530810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b55f227e-699e-45ce-8451-1576a5927e36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e0ceeff93d44589ac5abdb40d498439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:25:20Z,use_quota=True,user_id='b990764611694edebf3d153fc391c74f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:25:20 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1160cfe8-ed85-41cb-b7cf-3b827d5b128c tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb281579-8db3-4944-883a-7d46ff749b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:25:20 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1160cfe8-ed85-41cb-b7cf-3b827d5b128c tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb281579-8db3-4944-883a-7d46ff749b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:25:20 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1160cfe8-ed85-41cb-b7cf-3b827d5b128c tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba16a078-cb21-4576-9a71-27569d04c4d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:25:20 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1160cfe8-ed85-41cb-b7cf-3b827d5b128c tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba16a078-cb21-4576-9a71-27569d04c4d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b55f227e-699e-45ce-8451-1576a5927e36', 'volume_name': 'volume-b55f227e-699e-45ce-8451-1576a5927e36', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:25:20 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1160cfe8-ed85-41cb-b7cf-3b827d5b128c tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46f26229-e420-4fbc-95cf-bd67844ba687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:25:20 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1160cfe8-ed85-41cb-b7cf-3b827d5b128c tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46f26229-e420-4fbc-95cf-bd67844ba687) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:25:20 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1160cfe8-ed85-41cb-b7cf-3b827d5b128c tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e75f75e4-6b04-4679-8243-9ebd143fd2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:25:20 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-1160cfe8-ed85-41cb-b7cf-3b827d5b128c tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Volume b55f227e-699e-45ce-8451-1576a5927e36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b55f227e-699e-45ce-8451-1576a5927e36', 'volume_size': 1}
Nov 04 12:25:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1160cfe8-ed85-41cb-b7cf-3b827d5b128c tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:25:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1160cfe8-ed85-41cb-b7cf-3b827d5b128c tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:25:20 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1160cfe8-ed85-41cb-b7cf-3b827d5b128c tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:25:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-361530810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b55f227e-699e-45ce-8451-1576a5927e36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e0ceeff93d44589ac5abdb40d498439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:25:20Z,use_quota=True,user_id='b990764611694edebf3d153fc391c74f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:25:20 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-1160cfe8-ed85-41cb-b7cf-3b827d5b128c tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Creating volume b55f227e-699e-45ce-8451-1576a5927e36 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:25:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1160cfe8-ed85-41cb-b7cf-3b827d5b128c tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:25:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1160cfe8-ed85-41cb-b7cf-3b827d5b128c tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:25:20 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1160cfe8-ed85-41cb-b7cf-3b827d5b128c tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:25:20 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1160cfe8-ed85-41cb-b7cf-3b827d5b128c tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:25:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1160cfe8-ed85-41cb-b7cf-3b827d5b128c tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:25:20 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1160cfe8-ed85-41cb-b7cf-3b827d5b128c tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:25:20 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-1160cfe8-ed85-41cb-b7cf-3b827d5b128c tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:25:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1160cfe8-ed85-41cb-b7cf-3b827d5b128c tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-b55f227e-699e-45ce-8451-1576a5927e36 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:25:20 devstack sudo[104726]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-b55f227e-699e-45ce-8451-1576a5927e36 1073741824
Nov 04 12:25:20 devstack sudo[104726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:25:20 devstack sudo[104726]: pam_unix(sudo:session): session closed for user root
Nov 04 12:25:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1160cfe8-ed85-41cb-b7cf-3b827d5b128c tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-b55f227e-699e-45ce-8451-1576a5927e36 1073741824" returned: 0 in 0.465s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:25:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1160cfe8-ed85-41cb-b7cf-3b827d5b128c tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-b55f227e-699e-45ce-8451-1576a5927e36 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:25:21 devstack sudo[104733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-b55f227e-699e-45ce-8451-1576a5927e36
Nov 04 12:25:21 devstack sudo[104733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:25:21 devstack sudo[104733]: pam_unix(sudo:session): session closed for user root
Nov 04 12:25:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1160cfe8-ed85-41cb-b7cf-3b827d5b128c tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-b55f227e-699e-45ce-8451-1576a5927e36" returned: 0 in 0.245s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:25:21 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1160cfe8-ed85-41cb-b7cf-3b827d5b128c tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:25:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1160cfe8-ed85-41cb-b7cf-3b827d5b128c tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:25:21 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1160cfe8-ed85-41cb-b7cf-3b827d5b128c tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e75f75e4-6b04-4679-8243-9ebd143fd2cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b55f227e-699e-45ce-8451-1576a5927e36', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:25:21 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1160cfe8-ed85-41cb-b7cf-3b827d5b128c tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (183ebd92-5382-4aec-b22b-9223d84da24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:25:21 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-1160cfe8-ed85-41cb-b7cf-3b827d5b128c tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Volume volume-b55f227e-699e-45ce-8451-1576a5927e36 (b55f227e-699e-45ce-8451-1576a5927e36): created successfully
Nov 04 12:25:21 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1160cfe8-ed85-41cb-b7cf-3b827d5b128c tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (183ebd92-5382-4aec-b22b-9223d84da24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:25:21 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1160cfe8-ed85-41cb-b7cf-3b827d5b128c tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Flow 'volume_create_manager' (6124357f-4c4d-48a3-8f10-cf413ddb1366) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:25:21 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-1160cfe8-ed85-41cb-b7cf-3b827d5b128c tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Created volume successfully.
Nov 04 12:25:21 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-98f79846-ef09-4741-b3a4-f6ee3dec6c67 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:25:21 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-98f79846-ef09-4741-b3a4-f6ee3dec6c67 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Flow 'volume_create_manager' (06236f35-cb1d-4335-8968-8c4445484ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:25:21 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-98f79846-ef09-4741-b3a4-f6ee3dec6c67 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7bda801-ead0-469a-a4f4-9a2ad4d0cd03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:25:21 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-98f79846-ef09-4741-b3a4-f6ee3dec6c67 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7bda801-ead0-469a-a4f4-9a2ad4d0cd03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-678062727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ef31f50-016f-4a14-9850-ec5e0fd46fa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e0ceeff93d44589ac5abdb40d498439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:25:22Z,use_quota=True,user_id='b990764611694edebf3d153fc391c74f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:25:21 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-98f79846-ef09-4741-b3a4-f6ee3dec6c67 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (621a521a-d90e-49c1-9a91-68c83512cbb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:25:21 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-98f79846-ef09-4741-b3a4-f6ee3dec6c67 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (621a521a-d90e-49c1-9a91-68c83512cbb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:25:21 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-98f79846-ef09-4741-b3a4-f6ee3dec6c67 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7057b0a-3388-4c96-a36c-d7d0e3a4c5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:25:21 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-98f79846-ef09-4741-b3a4-f6ee3dec6c67 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7057b0a-3388-4c96-a36c-d7d0e3a4c5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ef31f50-016f-4a14-9850-ec5e0fd46fa5', 'volume_name': 'volume-3ef31f50-016f-4a14-9850-ec5e0fd46fa5', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:25:21 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-98f79846-ef09-4741-b3a4-f6ee3dec6c67 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43cea0c5-ee20-49e7-a78f-d013cca13731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:25:21 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-98f79846-ef09-4741-b3a4-f6ee3dec6c67 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43cea0c5-ee20-49e7-a78f-d013cca13731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:25:21 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-98f79846-ef09-4741-b3a4-f6ee3dec6c67 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7dafcd3-b9c8-4a49-994d-9b6a11661d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:25:21 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-98f79846-ef09-4741-b3a4-f6ee3dec6c67 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Volume 3ef31f50-016f-4a14-9850-ec5e0fd46fa5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ef31f50-016f-4a14-9850-ec5e0fd46fa5', 'volume_size': 1}
Nov 04 12:25:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-98f79846-ef09-4741-b3a4-f6ee3dec6c67 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:25:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-98f79846-ef09-4741-b3a4-f6ee3dec6c67 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:25:21 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-98f79846-ef09-4741-b3a4-f6ee3dec6c67 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-678062727',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ef31f50-016f-4a14-9850-ec5e0fd46fa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e0ceeff93d44589ac5abdb40d498439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:25:22Z,use_quota=True,user_id='b990764611694edebf3d153fc391c74f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:25:21 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-98f79846-ef09-4741-b3a4-f6ee3dec6c67 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Creating volume 3ef31f50-016f-4a14-9850-ec5e0fd46fa5 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:25:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-98f79846-ef09-4741-b3a4-f6ee3dec6c67 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-98f79846-ef09-4741-b3a4-f6ee3dec6c67 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-98f79846-ef09-4741-b3a4-f6ee3dec6c67 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-98f79846-ef09-4741-b3a4-f6ee3dec6c67 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-98f79846-ef09-4741-b3a4-f6ee3dec6c67 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-98f79846-ef09-4741-b3a4-f6ee3dec6c67 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:25:22 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-98f79846-ef09-4741-b3a4-f6ee3dec6c67 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-98f79846-ef09-4741-b3a4-f6ee3dec6c67 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3ef31f50-016f-4a14-9850-ec5e0fd46fa5 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:25:22 devstack sudo[104737]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3ef31f50-016f-4a14-9850-ec5e0fd46fa5 1073741824
Nov 04 12:25:22 devstack sudo[104737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-90693370-f349-4f75-9eb2-038130ef1213 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-90693370-f349-4f75-9eb2-038130ef1213 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Flow 'volume_create_manager' (cde022da-ad69-4680-ae84-08c167984a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-90693370-f349-4f75-9eb2-038130ef1213 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40b719a3-a4c9-4030-949e-d09e86424e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-90693370-f349-4f75-9eb2-038130ef1213 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40b719a3-a4c9-4030-949e-d09e86424e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1926012252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0785a89-eb4e-45d6-93f4-ec96f4f63755,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e0ceeff93d44589ac5abdb40d498439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:25:22Z,use_quota=True,user_id='b990764611694edebf3d153fc391c74f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-90693370-f349-4f75-9eb2-038130ef1213 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05ef3857-101c-4ddf-a94a-cafc1cb85001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-90693370-f349-4f75-9eb2-038130ef1213 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05ef3857-101c-4ddf-a94a-cafc1cb85001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-90693370-f349-4f75-9eb2-038130ef1213 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3b12d81-c5e8-4251-aa06-4e781a16059e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-90693370-f349-4f75-9eb2-038130ef1213 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3b12d81-c5e8-4251-aa06-4e781a16059e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0785a89-eb4e-45d6-93f4-ec96f4f63755', 'volume_name': 'volume-c0785a89-eb4e-45d6-93f4-ec96f4f63755', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-90693370-f349-4f75-9eb2-038130ef1213 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9711579d-0e1c-4e8a-b448-4a42baefbfd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-90693370-f349-4f75-9eb2-038130ef1213 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9711579d-0e1c-4e8a-b448-4a42baefbfd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-90693370-f349-4f75-9eb2-038130ef1213 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fe02014-8c23-41a5-b799-65ef0354de66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:25:22 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-90693370-f349-4f75-9eb2-038130ef1213 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Volume c0785a89-eb4e-45d6-93f4-ec96f4f63755: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0785a89-eb4e-45d6-93f4-ec96f4f63755', 'volume_size': 1}
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-90693370-f349-4f75-9eb2-038130ef1213 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:25:22 devstack sudo[104737]: pam_unix(sudo:session): session closed for user root
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-98f79846-ef09-4741-b3a4-f6ee3dec6c67 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3ef31f50-016f-4a14-9850-ec5e0fd46fa5 1073741824" returned: 0 in 0.565s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-98f79846-ef09-4741-b3a4-f6ee3dec6c67 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3ef31f50-016f-4a14-9850-ec5e0fd46fa5 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:25:22 devstack sudo[104743]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3ef31f50-016f-4a14-9850-ec5e0fd46fa5
Nov 04 12:25:22 devstack sudo[104743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-29251946-03f3-4638-ab26-5ed297a50a2d tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-29251946-03f3-4638-ab26-5ed297a50a2d tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Flow 'volume_create_manager' (15f6fd1b-70c0-47f9-ab46-e67bad6872a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-29251946-03f3-4638-ab26-5ed297a50a2d tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c41db69b-33e7-4f33-a96b-1bd8e6f18aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-29251946-03f3-4638-ab26-5ed297a50a2d tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c41db69b-33e7-4f33-a96b-1bd8e6f18aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1051649634',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56f54501-deb1-4b72-90f5-372f28bb66f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e0ceeff93d44589ac5abdb40d498439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:25:23Z,use_quota=True,user_id='b990764611694edebf3d153fc391c74f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-29251946-03f3-4638-ab26-5ed297a50a2d tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fc76404-7976-4718-9c61-767a3dc8ec2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-29251946-03f3-4638-ab26-5ed297a50a2d tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fc76404-7976-4718-9c61-767a3dc8ec2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-29251946-03f3-4638-ab26-5ed297a50a2d tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c43416d1-8856-4e8f-a3cf-0fbaefb21857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-29251946-03f3-4638-ab26-5ed297a50a2d tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c43416d1-8856-4e8f-a3cf-0fbaefb21857) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56f54501-deb1-4b72-90f5-372f28bb66f1', 'volume_name': 'volume-56f54501-deb1-4b72-90f5-372f28bb66f1', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-29251946-03f3-4638-ab26-5ed297a50a2d tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (555bbe71-d89d-48f4-a1b2-4008daa127a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-29251946-03f3-4638-ab26-5ed297a50a2d tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (555bbe71-d89d-48f4-a1b2-4008daa127a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-29251946-03f3-4638-ab26-5ed297a50a2d tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4fd5c82-a922-4e80-b514-4ad6d504f1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:25:22 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-29251946-03f3-4638-ab26-5ed297a50a2d tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Volume 56f54501-deb1-4b72-90f5-372f28bb66f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56f54501-deb1-4b72-90f5-372f28bb66f1', 'volume_size': 1}
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-29251946-03f3-4638-ab26-5ed297a50a2d tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:25:22 devstack sudo[104743]: pam_unix(sudo:session): session closed for user root
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-98f79846-ef09-4741-b3a4-f6ee3dec6c67 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3ef31f50-016f-4a14-9850-ec5e0fd46fa5" returned: 0 in 0.298s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-98f79846-ef09-4741-b3a4-f6ee3dec6c67 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-98f79846-ef09-4741-b3a4-f6ee3dec6c67 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-90693370-f349-4f75-9eb2-038130ef1213 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.445s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-90693370-f349-4f75-9eb2-038130ef1213 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1926012252',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0785a89-eb4e-45d6-93f4-ec96f4f63755,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e0ceeff93d44589ac5abdb40d498439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:25:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:25:22Z,use_quota=True,user_id='b990764611694edebf3d153fc391c74f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-90693370-f349-4f75-9eb2-038130ef1213 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Creating volume c0785a89-eb4e-45d6-93f4-ec96f4f63755 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-90693370-f349-4f75-9eb2-038130ef1213 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-90693370-f349-4f75-9eb2-038130ef1213 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-90693370-f349-4f75-9eb2-038130ef1213 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-90693370-f349-4f75-9eb2-038130ef1213 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-90693370-f349-4f75-9eb2-038130ef1213 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-90693370-f349-4f75-9eb2-038130ef1213 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:25:22 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-90693370-f349-4f75-9eb2-038130ef1213 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-90693370-f349-4f75-9eb2-038130ef1213 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c0785a89-eb4e-45d6-93f4-ec96f4f63755 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-98f79846-ef09-4741-b3a4-f6ee3dec6c67 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7dafcd3-b9c8-4a49-994d-9b6a11661d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ef31f50-016f-4a14-9850-ec5e0fd46fa5', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:25:22 devstack sudo[104746]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c0785a89-eb4e-45d6-93f4-ec96f4f63755 1073741824
Nov 04 12:25:22 devstack sudo[104746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-98f79846-ef09-4741-b3a4-f6ee3dec6c67 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a9e963c-689d-401b-a3e3-ef4ac062c8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:25:22 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-98f79846-ef09-4741-b3a4-f6ee3dec6c67 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Volume volume-3ef31f50-016f-4a14-9850-ec5e0fd46fa5 (3ef31f50-016f-4a14-9850-ec5e0fd46fa5): created successfully
Nov 04 12:25:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-98f79846-ef09-4741-b3a4-f6ee3dec6c67 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a9e963c-689d-401b-a3e3-ef4ac062c8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:25:23 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-98f79846-ef09-4741-b3a4-f6ee3dec6c67 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Flow 'volume_create_manager' (06236f35-cb1d-4335-8968-8c4445484ea4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:25:23 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-98f79846-ef09-4741-b3a4-f6ee3dec6c67 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Created volume successfully.
Nov 04 12:25:23 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-84953ad2-b16a-4c6a-b935-126aa73a5969 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:25:23 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-84953ad2-b16a-4c6a-b935-126aa73a5969 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Flow 'volume_create_manager' (55e431b2-f0ec-4dc6-9b50-9aac91930b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:25:23 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-84953ad2-b16a-4c6a-b935-126aa73a5969 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f4595fd-9507-4946-85d9-2277fb293573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:25:23 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-84953ad2-b16a-4c6a-b935-126aa73a5969 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f4595fd-9507-4946-85d9-2277fb293573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-986532081',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26136d0b-2e57-44f4-875b-63991157764a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e0ceeff93d44589ac5abdb40d498439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:25:23Z,use_quota=True,user_id='b990764611694edebf3d153fc391c74f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:25:23 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-84953ad2-b16a-4c6a-b935-126aa73a5969 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15b07ad2-956b-4209-b21f-bbd5f6be013b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:25:23 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-84953ad2-b16a-4c6a-b935-126aa73a5969 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15b07ad2-956b-4209-b21f-bbd5f6be013b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:25:23 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-84953ad2-b16a-4c6a-b935-126aa73a5969 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebb0bdaf-abec-4b7e-bd29-ee9d77b92a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:25:23 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-84953ad2-b16a-4c6a-b935-126aa73a5969 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebb0bdaf-abec-4b7e-bd29-ee9d77b92a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26136d0b-2e57-44f4-875b-63991157764a', 'volume_name': 'volume-26136d0b-2e57-44f4-875b-63991157764a', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:25:23 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-84953ad2-b16a-4c6a-b935-126aa73a5969 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f22edbe-b498-4a54-ba6d-ea307cdd3354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:25:23 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-84953ad2-b16a-4c6a-b935-126aa73a5969 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f22edbe-b498-4a54-ba6d-ea307cdd3354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:25:23 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-84953ad2-b16a-4c6a-b935-126aa73a5969 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43148aa4-7d2e-40b3-a51f-77c1bd3c3439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:25:23 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-84953ad2-b16a-4c6a-b935-126aa73a5969 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Volume 26136d0b-2e57-44f4-875b-63991157764a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26136d0b-2e57-44f4-875b-63991157764a', 'volume_size': 1}
Nov 04 12:25:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-84953ad2-b16a-4c6a-b935-126aa73a5969 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:25:23 devstack sudo[104746]: pam_unix(sudo:session): session closed for user root
Nov 04 12:25:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-90693370-f349-4f75-9eb2-038130ef1213 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c0785a89-eb4e-45d6-93f4-ec96f4f63755 1073741824" returned: 0 in 0.558s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:25:23 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a5fe71c-501f-44a3-9b60-ecbc97c5c222 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:25:23 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3a5fe71c-501f-44a3-9b60-ecbc97c5c222 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Flow 'volume_create_manager' (bd891083-efe0-409c-b917-35b69394c949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:25:23 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3a5fe71c-501f-44a3-9b60-ecbc97c5c222 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b678f549-4029-46e3-921e-3cafa91e82f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:25:23 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3a5fe71c-501f-44a3-9b60-ecbc97c5c222 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b678f549-4029-46e3-921e-3cafa91e82f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1032524018',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77d22966-769a-4553-b8da-629dd76ff180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e0ceeff93d44589ac5abdb40d498439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:25:23Z,use_quota=True,user_id='b990764611694edebf3d153fc391c74f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:25:23 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3a5fe71c-501f-44a3-9b60-ecbc97c5c222 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ece67d4e-9464-4cbb-9da9-ebafc65513d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:25:23 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3a5fe71c-501f-44a3-9b60-ecbc97c5c222 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ece67d4e-9464-4cbb-9da9-ebafc65513d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:25:23 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3a5fe71c-501f-44a3-9b60-ecbc97c5c222 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e485ea2-dd86-4798-9898-1642ab8dd779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:25:23 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3a5fe71c-501f-44a3-9b60-ecbc97c5c222 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e485ea2-dd86-4798-9898-1642ab8dd779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77d22966-769a-4553-b8da-629dd76ff180', 'volume_name': 'volume-77d22966-769a-4553-b8da-629dd76ff180', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:25:23 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3a5fe71c-501f-44a3-9b60-ecbc97c5c222 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64cb94f4-e2f3-480b-98ad-c74537db69d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:25:23 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3a5fe71c-501f-44a3-9b60-ecbc97c5c222 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64cb94f4-e2f3-480b-98ad-c74537db69d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:25:23 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3a5fe71c-501f-44a3-9b60-ecbc97c5c222 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f038ab7-f6c4-434f-a966-919cf556d1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:25:23 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-3a5fe71c-501f-44a3-9b60-ecbc97c5c222 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Volume 77d22966-769a-4553-b8da-629dd76ff180: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77d22966-769a-4553-b8da-629dd76ff180', 'volume_size': 1}
Nov 04 12:25:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3a5fe71c-501f-44a3-9b60-ecbc97c5c222 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:25:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-90693370-f349-4f75-9eb2-038130ef1213 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c0785a89-eb4e-45d6-93f4-ec96f4f63755 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:25:23 devstack sudo[104754]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c0785a89-eb4e-45d6-93f4-ec96f4f63755
Nov 04 12:25:23 devstack sudo[104754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:25:23 devstack sudo[104754]: pam_unix(sudo:session): session closed for user root
Nov 04 12:25:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-90693370-f349-4f75-9eb2-038130ef1213 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c0785a89-eb4e-45d6-93f4-ec96f4f63755" returned: 0 in 0.286s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:25:23 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-90693370-f349-4f75-9eb2-038130ef1213 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:25:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-90693370-f349-4f75-9eb2-038130ef1213 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:25:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-29251946-03f3-4638-ab26-5ed297a50a2d tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.115s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:25:23 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-29251946-03f3-4638-ab26-5ed297a50a2d tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1051649634',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56f54501-deb1-4b72-90f5-372f28bb66f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e0ceeff93d44589ac5abdb40d498439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:25:23Z,use_quota=True,user_id='b990764611694edebf3d153fc391c74f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:25:23 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-29251946-03f3-4638-ab26-5ed297a50a2d tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Creating volume 56f54501-deb1-4b72-90f5-372f28bb66f1 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:25:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-29251946-03f3-4638-ab26-5ed297a50a2d tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:25:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-29251946-03f3-4638-ab26-5ed297a50a2d tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:25:23 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-29251946-03f3-4638-ab26-5ed297a50a2d tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:25:23 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-29251946-03f3-4638-ab26-5ed297a50a2d tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:25:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-29251946-03f3-4638-ab26-5ed297a50a2d tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:25:23 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-29251946-03f3-4638-ab26-5ed297a50a2d tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:25:23 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-29251946-03f3-4638-ab26-5ed297a50a2d tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:25:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-29251946-03f3-4638-ab26-5ed297a50a2d tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-56f54501-deb1-4b72-90f5-372f28bb66f1 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:25:23 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-90693370-f349-4f75-9eb2-038130ef1213 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fe02014-8c23-41a5-b799-65ef0354de66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0785a89-eb4e-45d6-93f4-ec96f4f63755', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:25:23 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-90693370-f349-4f75-9eb2-038130ef1213 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8dc27ea-9c7e-4e62-87ec-aec7bd5e3577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:25:23 devstack sudo[104757]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-56f54501-deb1-4b72-90f5-372f28bb66f1 1073741824
Nov 04 12:25:23 devstack sudo[104757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:25:24 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-90693370-f349-4f75-9eb2-038130ef1213 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Volume volume-c0785a89-eb4e-45d6-93f4-ec96f4f63755 (c0785a89-eb4e-45d6-93f4-ec96f4f63755): created successfully
Nov 04 12:25:24 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-90693370-f349-4f75-9eb2-038130ef1213 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8dc27ea-9c7e-4e62-87ec-aec7bd5e3577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:25:24 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-90693370-f349-4f75-9eb2-038130ef1213 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Flow 'volume_create_manager' (cde022da-ad69-4680-ae84-08c167984a9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:25:24 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-90693370-f349-4f75-9eb2-038130ef1213 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Created volume successfully.
Nov 04 12:25:24 devstack sudo[104757]: pam_unix(sudo:session): session closed for user root
Nov 04 12:25:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-29251946-03f3-4638-ab26-5ed297a50a2d tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-56f54501-deb1-4b72-90f5-372f28bb66f1 1073741824" returned: 0 in 0.505s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:25:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-29251946-03f3-4638-ab26-5ed297a50a2d tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-56f54501-deb1-4b72-90f5-372f28bb66f1 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:25:24 devstack sudo[104763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-56f54501-deb1-4b72-90f5-372f28bb66f1
Nov 04 12:25:24 devstack sudo[104763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:25:24 devstack sudo[104763]: pam_unix(sudo:session): session closed for user root
Nov 04 12:25:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-29251946-03f3-4638-ab26-5ed297a50a2d tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-56f54501-deb1-4b72-90f5-372f28bb66f1" returned: 0 in 0.255s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:25:24 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-29251946-03f3-4638-ab26-5ed297a50a2d tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:25:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-29251946-03f3-4638-ab26-5ed297a50a2d tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:25:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-84953ad2-b16a-4c6a-b935-126aa73a5969 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.589s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:25:24 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-84953ad2-b16a-4c6a-b935-126aa73a5969 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-986532081',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26136d0b-2e57-44f4-875b-63991157764a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e0ceeff93d44589ac5abdb40d498439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:25:23Z,use_quota=True,user_id='b990764611694edebf3d153fc391c74f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:25:24 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-84953ad2-b16a-4c6a-b935-126aa73a5969 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Creating volume 26136d0b-2e57-44f4-875b-63991157764a {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:25:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-84953ad2-b16a-4c6a-b935-126aa73a5969 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:25:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-84953ad2-b16a-4c6a-b935-126aa73a5969 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:25:24 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-84953ad2-b16a-4c6a-b935-126aa73a5969 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:25:24 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-84953ad2-b16a-4c6a-b935-126aa73a5969 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:25:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-84953ad2-b16a-4c6a-b935-126aa73a5969 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:25:24 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-84953ad2-b16a-4c6a-b935-126aa73a5969 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:25:24 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-84953ad2-b16a-4c6a-b935-126aa73a5969 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:25:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-84953ad2-b16a-4c6a-b935-126aa73a5969 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-26136d0b-2e57-44f4-875b-63991157764a 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:25:24 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-29251946-03f3-4638-ab26-5ed297a50a2d tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4fd5c82-a922-4e80-b514-4ad6d504f1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56f54501-deb1-4b72-90f5-372f28bb66f1', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:25:24 devstack sudo[104766]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-26136d0b-2e57-44f4-875b-63991157764a 1073741824
Nov 04 12:25:24 devstack sudo[104766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:25:24 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-29251946-03f3-4638-ab26-5ed297a50a2d tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c8273c2-fb77-46b1-8a5a-c07e2c868543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:25:24 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-29251946-03f3-4638-ab26-5ed297a50a2d tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Volume volume-56f54501-deb1-4b72-90f5-372f28bb66f1 (56f54501-deb1-4b72-90f5-372f28bb66f1): created successfully
Nov 04 12:25:24 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-29251946-03f3-4638-ab26-5ed297a50a2d tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c8273c2-fb77-46b1-8a5a-c07e2c868543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:25:24 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-29251946-03f3-4638-ab26-5ed297a50a2d tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Flow 'volume_create_manager' (15f6fd1b-70c0-47f9-ab46-e67bad6872a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:25:24 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-29251946-03f3-4638-ab26-5ed297a50a2d tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Created volume successfully.
Nov 04 12:25:25 devstack sudo[104766]: pam_unix(sudo:session): session closed for user root
Nov 04 12:25:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-84953ad2-b16a-4c6a-b935-126aa73a5969 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-26136d0b-2e57-44f4-875b-63991157764a 1073741824" returned: 0 in 0.453s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:25:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-84953ad2-b16a-4c6a-b935-126aa73a5969 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-26136d0b-2e57-44f4-875b-63991157764a {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:25:25 devstack sudo[104772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-26136d0b-2e57-44f4-875b-63991157764a
Nov 04 12:25:25 devstack sudo[104772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:25:25 devstack sudo[104772]: pam_unix(sudo:session): session closed for user root
Nov 04 12:25:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-84953ad2-b16a-4c6a-b935-126aa73a5969 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-26136d0b-2e57-44f4-875b-63991157764a" returned: 0 in 0.240s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:25:25 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-84953ad2-b16a-4c6a-b935-126aa73a5969 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:25:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-84953ad2-b16a-4c6a-b935-126aa73a5969 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:25:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3a5fe71c-501f-44a3-9b60-ecbc97c5c222 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.859s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:25:25 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3a5fe71c-501f-44a3-9b60-ecbc97c5c222 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1032524018',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77d22966-769a-4553-b8da-629dd76ff180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e0ceeff93d44589ac5abdb40d498439',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:25:23Z,use_quota=True,user_id='b990764611694edebf3d153fc391c74f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:25:25 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-3a5fe71c-501f-44a3-9b60-ecbc97c5c222 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Creating volume 77d22966-769a-4553-b8da-629dd76ff180 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:25:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3a5fe71c-501f-44a3-9b60-ecbc97c5c222 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:25:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3a5fe71c-501f-44a3-9b60-ecbc97c5c222 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:25:25 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3a5fe71c-501f-44a3-9b60-ecbc97c5c222 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:25:25 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3a5fe71c-501f-44a3-9b60-ecbc97c5c222 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:25:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3a5fe71c-501f-44a3-9b60-ecbc97c5c222 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:25:25 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3a5fe71c-501f-44a3-9b60-ecbc97c5c222 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:25:25 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-3a5fe71c-501f-44a3-9b60-ecbc97c5c222 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:25:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3a5fe71c-501f-44a3-9b60-ecbc97c5c222 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-77d22966-769a-4553-b8da-629dd76ff180 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:25:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-84953ad2-b16a-4c6a-b935-126aa73a5969 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43148aa4-7d2e-40b3-a51f-77c1bd3c3439) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26136d0b-2e57-44f4-875b-63991157764a', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:25:25 devstack sudo[104775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-77d22966-769a-4553-b8da-629dd76ff180 1073741824
Nov 04 12:25:25 devstack sudo[104775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:25:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-84953ad2-b16a-4c6a-b935-126aa73a5969 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8508700a-6269-425c-9e40-60dac4a114b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:25:25 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-84953ad2-b16a-4c6a-b935-126aa73a5969 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Volume volume-26136d0b-2e57-44f4-875b-63991157764a (26136d0b-2e57-44f4-875b-63991157764a): created successfully
Nov 04 12:25:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-84953ad2-b16a-4c6a-b935-126aa73a5969 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8508700a-6269-425c-9e40-60dac4a114b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:25:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-84953ad2-b16a-4c6a-b935-126aa73a5969 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Flow 'volume_create_manager' (55e431b2-f0ec-4dc6-9b50-9aac91930b8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:25:25 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-84953ad2-b16a-4c6a-b935-126aa73a5969 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Created volume successfully.
Nov 04 12:25:25 devstack sudo[104775]: pam_unix(sudo:session): session closed for user root
Nov 04 12:25:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3a5fe71c-501f-44a3-9b60-ecbc97c5c222 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-77d22966-769a-4553-b8da-629dd76ff180 1073741824" returned: 0 in 0.433s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:25:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3a5fe71c-501f-44a3-9b60-ecbc97c5c222 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-77d22966-769a-4553-b8da-629dd76ff180 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:25:25 devstack sudo[104781]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-77d22966-769a-4553-b8da-629dd76ff180
Nov 04 12:25:25 devstack sudo[104781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:25:26 devstack sudo[104781]: pam_unix(sudo:session): session closed for user root
Nov 04 12:25:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3a5fe71c-501f-44a3-9b60-ecbc97c5c222 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-77d22966-769a-4553-b8da-629dd76ff180" returned: 0 in 0.261s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:25:26 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3a5fe71c-501f-44a3-9b60-ecbc97c5c222 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:25:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3a5fe71c-501f-44a3-9b60-ecbc97c5c222 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:25:26 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3a5fe71c-501f-44a3-9b60-ecbc97c5c222 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f038ab7-f6c4-434f-a966-919cf556d1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77d22966-769a-4553-b8da-629dd76ff180', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:25:26 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3a5fe71c-501f-44a3-9b60-ecbc97c5c222 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (485d229f-379c-4ac1-9042-43f19c807d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:25:26 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-3a5fe71c-501f-44a3-9b60-ecbc97c5c222 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Volume volume-77d22966-769a-4553-b8da-629dd76ff180 (77d22966-769a-4553-b8da-629dd76ff180): created successfully
Nov 04 12:25:26 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3a5fe71c-501f-44a3-9b60-ecbc97c5c222 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (485d229f-379c-4ac1-9042-43f19c807d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:25:26 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3a5fe71c-501f-44a3-9b60-ecbc97c5c222 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Flow 'volume_create_manager' (bd891083-efe0-409c-b917-35b69394c949) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:25:26 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-3a5fe71c-501f-44a3-9b60-ecbc97c5c222 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Created volume successfully.
Nov 04 12:25:26 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-60eba84e-efbc-4ffe-a8ba-a79501631c2b tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Acquiring lock "cinder-77d22966-769a-4553-b8da-629dd76ff180-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:25:26 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-60eba84e-efbc-4ffe-a8ba-a79501631c2b tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "cinder-77d22966-769a-4553-b8da-629dd76ff180-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:25:26 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-60eba84e-efbc-4ffe-a8ba-a79501631c2b tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Acquiring lock "cinder-quobyte-77d22966-769a-4553-b8da-629dd76ff180" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:25:26 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-60eba84e-efbc-4ffe-a8ba-a79501631c2b tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "cinder-quobyte-77d22966-769a-4553-b8da-629dd76ff180" acquired by "delete_volume" :: waited 0.016s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:25:26 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef25c0f-224b-490a-a7f7-b8ae378b07c9]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:25:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-60eba84e-efbc-4ffe-a8ba-a79501631c2b tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-77d22966-769a-4553-b8da-629dd76ff180 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:25:27 devstack sudo[104877]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-77d22966-769a-4553-b8da-629dd76ff180
Nov 04 12:25:27 devstack sudo[104877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:25:27 devstack sudo[104877]: pam_unix(sudo:session): session closed for user root
Nov 04 12:25:27 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-60eba84e-efbc-4ffe-a8ba-a79501631c2b tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-77d22966-769a-4553-b8da-629dd76ff180" returned: 0 in 0.377s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:25:27 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-60eba84e-efbc-4ffe-a8ba-a79501631c2b tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-77d22966-769a-4553-b8da-629dd76ff180 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:25:27 devstack sudo[104882]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-77d22966-769a-4553-b8da-629dd76ff180
Nov 04 12:25:27 devstack sudo[104882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:25:27 devstack sudo[104882]: pam_unix(sudo:session): session closed for user root
Nov 04 12:25:27 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-60eba84e-efbc-4ffe-a8ba-a79501631c2b tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-77d22966-769a-4553-b8da-629dd76ff180" returned: 0 in 0.275s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:25:27 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-60eba84e-efbc-4ffe-a8ba-a79501631c2b tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "cinder-quobyte-77d22966-769a-4553-b8da-629dd76ff180" released by "delete_volume" :: held 0.696s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:25:27 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-60eba84e-efbc-4ffe-a8ba-a79501631c2b tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Created reservations ['268cc9f8-fa1f-4585-b821-ed23369e6d3c', 'ca2570d6-b535-4ce2-864b-db68ad87a038', 'a26f8861-692d-4c6c-a670-ea3a3d27c4e4', 'a757a707-01b5-4410-80ab-f4019aae1550'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:25:27 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-60eba84e-efbc-4ffe-a8ba-a79501631c2b tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:25:27 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-60eba84e-efbc-4ffe-a8ba-a79501631c2b tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:25:27 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-60eba84e-efbc-4ffe-a8ba-a79501631c2b tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:25:27 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-60eba84e-efbc-4ffe-a8ba-a79501631c2b tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:25:27 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-60eba84e-efbc-4ffe-a8ba-a79501631c2b tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:25:27 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-60eba84e-efbc-4ffe-a8ba-a79501631c2b tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:25:27 devstack sudo[104905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:25:27 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:25:28 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root
Nov 04 12:25:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-60eba84e-efbc-4ffe-a8ba-a79501631c2b tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.267s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:25:28 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-60eba84e-efbc-4ffe-a8ba-a79501631c2b tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:25:28 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-60eba84e-efbc-4ffe-a8ba-a79501631c2b tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Deleted volume successfully.
Nov 04 12:25:28 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-42874f77-1137-4cf4-95a1-f2a202c034c8 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Acquiring lock "cinder-26136d0b-2e57-44f4-875b-63991157764a-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:25:28 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-42874f77-1137-4cf4-95a1-f2a202c034c8 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "cinder-26136d0b-2e57-44f4-875b-63991157764a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:25:28 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-60eba84e-efbc-4ffe-a8ba-a79501631c2b tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "cinder-77d22966-769a-4553-b8da-629dd76ff180-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:25:28 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-42874f77-1137-4cf4-95a1-f2a202c034c8 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Acquiring lock "cinder-quobyte-26136d0b-2e57-44f4-875b-63991157764a" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:25:28 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-42874f77-1137-4cf4-95a1-f2a202c034c8 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "cinder-quobyte-26136d0b-2e57-44f4-875b-63991157764a" acquired by "delete_volume" :: waited 0.023s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:25:28 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f496250-2e2f-4955-90d9-90c3a7561537]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:25:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-42874f77-1137-4cf4-95a1-f2a202c034c8 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-26136d0b-2e57-44f4-875b-63991157764a {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:25:28 devstack sudo[104910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-26136d0b-2e57-44f4-875b-63991157764a
Nov 04 12:25:28 devstack sudo[104910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:25:28 devstack sudo[104910]: pam_unix(sudo:session): session closed for user root
Nov 04 12:25:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-42874f77-1137-4cf4-95a1-f2a202c034c8 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-26136d0b-2e57-44f4-875b-63991157764a" returned: 0 in 0.395s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:25:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-42874f77-1137-4cf4-95a1-f2a202c034c8 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-26136d0b-2e57-44f4-875b-63991157764a {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:25:28 devstack sudo[104940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-26136d0b-2e57-44f4-875b-63991157764a
Nov 04 12:25:28 devstack sudo[104940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:25:28 devstack sudo[104940]: pam_unix(sudo:session): session closed for user root
Nov 04 12:25:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-42874f77-1137-4cf4-95a1-f2a202c034c8 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-26136d0b-2e57-44f4-875b-63991157764a" returned: 0 in 0.317s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:25:28 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-42874f77-1137-4cf4-95a1-f2a202c034c8 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "cinder-quobyte-26136d0b-2e57-44f4-875b-63991157764a" released by "delete_volume" :: held 0.753s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:25:28 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-42874f77-1137-4cf4-95a1-f2a202c034c8 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Created reservations ['cce9de3f-d3ba-4a8f-9009-bccb070abe99', '1803fcc2-df15-4b00-b336-553d199686d9', '5a8138d8-4b88-4659-ab96-436cba03e433', '02f9b9b7-5d0d-46c8-b038-6034b01324a0'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:25:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-42874f77-1137-4cf4-95a1-f2a202c034c8 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:25:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-42874f77-1137-4cf4-95a1-f2a202c034c8 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:25:29 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-42874f77-1137-4cf4-95a1-f2a202c034c8 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:25:29 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-42874f77-1137-4cf4-95a1-f2a202c034c8 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:25:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-42874f77-1137-4cf4-95a1-f2a202c034c8 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:25:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-42874f77-1137-4cf4-95a1-f2a202c034c8 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:25:29 devstack sudo[104945]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:25:29 devstack sudo[104945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:25:29 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d73a38e4-655b-4f99-b630-49730288b446 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Acquiring lock "cinder-56f54501-deb1-4b72-90f5-372f28bb66f1-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:25:29 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d73a38e4-655b-4f99-b630-49730288b446 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "cinder-56f54501-deb1-4b72-90f5-372f28bb66f1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:25:29 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d73a38e4-655b-4f99-b630-49730288b446 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Acquiring lock "cinder-quobyte-56f54501-deb1-4b72-90f5-372f28bb66f1" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:25:29 devstack sudo[104945]: pam_unix(sudo:session): session closed for user root
Nov 04 12:25:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-42874f77-1137-4cf4-95a1-f2a202c034c8 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.300s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:25:29 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-42874f77-1137-4cf4-95a1-f2a202c034c8 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:25:29 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-42874f77-1137-4cf4-95a1-f2a202c034c8 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Deleted volume successfully.
Nov 04 12:25:29 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d73a38e4-655b-4f99-b630-49730288b446 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "cinder-quobyte-56f54501-deb1-4b72-90f5-372f28bb66f1" acquired by "delete_volume" :: waited 0.032s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:25:29 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-42874f77-1137-4cf4-95a1-f2a202c034c8 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "cinder-26136d0b-2e57-44f4-875b-63991157764a-delete_volume" released by "delete_volume" :: held 1.299s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:25:29 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f836d79-a185-4539-91ae-3750c0a32118]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:25:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d73a38e4-655b-4f99-b630-49730288b446 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-56f54501-deb1-4b72-90f5-372f28bb66f1 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:25:29 devstack sudo[104948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-56f54501-deb1-4b72-90f5-372f28bb66f1
Nov 04 12:25:29 devstack sudo[104948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:25:29 devstack sudo[104948]: pam_unix(sudo:session): session closed for user root
Nov 04 12:25:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d73a38e4-655b-4f99-b630-49730288b446 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-56f54501-deb1-4b72-90f5-372f28bb66f1" returned: 0 in 0.411s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:25:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d73a38e4-655b-4f99-b630-49730288b446 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-56f54501-deb1-4b72-90f5-372f28bb66f1 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:25:29 devstack sudo[104953]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-56f54501-deb1-4b72-90f5-372f28bb66f1
Nov 04 12:25:29 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:25:30 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root
Nov 04 12:25:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d73a38e4-655b-4f99-b630-49730288b446 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-56f54501-deb1-4b72-90f5-372f28bb66f1" returned: 0 in 0.282s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:25:30 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d73a38e4-655b-4f99-b630-49730288b446 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "cinder-quobyte-56f54501-deb1-4b72-90f5-372f28bb66f1" released by "delete_volume" :: held 0.752s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:25:30 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-d73a38e4-655b-4f99-b630-49730288b446 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Created reservations ['1f79e6b8-c76b-47d0-a608-c3d7d51fb977', 'da4a93cf-b06b-4c2b-9c77-916bead88a25', '4c1035ce-90a2-4425-bdac-cdd65e34d166', '478d879d-7b1c-4a57-b16c-2bd5fcc2551b'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:25:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d73a38e4-655b-4f99-b630-49730288b446 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:25:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d73a38e4-655b-4f99-b630-49730288b446 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:25:30 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d73a38e4-655b-4f99-b630-49730288b446 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:25:30 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d73a38e4-655b-4f99-b630-49730288b446 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:25:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d73a38e4-655b-4f99-b630-49730288b446 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:25:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d73a38e4-655b-4f99-b630-49730288b446 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:25:30 devstack sudo[104956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:25:30 devstack sudo[104956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:25:30 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1876bf91-8ee9-4127-86c2-3381473177c8 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Acquiring lock "cinder-c0785a89-eb4e-45d6-93f4-ec96f4f63755-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:25:30 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1876bf91-8ee9-4127-86c2-3381473177c8 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "cinder-c0785a89-eb4e-45d6-93f4-ec96f4f63755-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:25:30 devstack sudo[104956]: pam_unix(sudo:session): session closed for user root
Nov 04 12:25:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d73a38e4-655b-4f99-b630-49730288b446 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.273s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:25:30 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-d73a38e4-655b-4f99-b630-49730288b446 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:25:30 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-d73a38e4-655b-4f99-b630-49730288b446 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Deleted volume successfully.
Nov 04 12:25:30 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1876bf91-8ee9-4127-86c2-3381473177c8 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Acquiring lock "cinder-quobyte-c0785a89-eb4e-45d6-93f4-ec96f4f63755" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:25:30 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1876bf91-8ee9-4127-86c2-3381473177c8 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "cinder-quobyte-c0785a89-eb4e-45d6-93f4-ec96f4f63755" acquired by "delete_volume" :: waited 0.021s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:25:30 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d73a38e4-655b-4f99-b630-49730288b446 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "cinder-56f54501-deb1-4b72-90f5-372f28bb66f1-delete_volume" released by "delete_volume" :: held 1.302s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:25:30 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e986f0-5eca-4d1d-b923-dcbdbe1957ee]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:25:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1876bf91-8ee9-4127-86c2-3381473177c8 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c0785a89-eb4e-45d6-93f4-ec96f4f63755 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:25:30 devstack sudo[104959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c0785a89-eb4e-45d6-93f4-ec96f4f63755
Nov 04 12:25:30 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:25:30 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root
Nov 04 12:25:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1876bf91-8ee9-4127-86c2-3381473177c8 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c0785a89-eb4e-45d6-93f4-ec96f4f63755" returned: 0 in 0.375s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:25:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1876bf91-8ee9-4127-86c2-3381473177c8 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c0785a89-eb4e-45d6-93f4-ec96f4f63755 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:25:30 devstack sudo[104964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c0785a89-eb4e-45d6-93f4-ec96f4f63755
Nov 04 12:25:30 devstack sudo[104964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:25:31 devstack sudo[104964]: pam_unix(sudo:session): session closed for user root
Nov 04 12:25:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1876bf91-8ee9-4127-86c2-3381473177c8 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c0785a89-eb4e-45d6-93f4-ec96f4f63755" returned: 0 in 0.262s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:25:31 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1876bf91-8ee9-4127-86c2-3381473177c8 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "cinder-quobyte-c0785a89-eb4e-45d6-93f4-ec96f4f63755" released by "delete_volume" :: held 0.686s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:25:31 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-1876bf91-8ee9-4127-86c2-3381473177c8 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Created reservations ['ddfb5a10-9d3d-4a0c-8c51-363cb84091fb', 'b054a2ec-3e73-4006-948c-31677dbbff9d', 'c5b26139-c343-4fdf-9f56-bc6524dfdd77', '0cae01e0-e391-4265-a2af-136ae6258964'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:25:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1876bf91-8ee9-4127-86c2-3381473177c8 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:25:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1876bf91-8ee9-4127-86c2-3381473177c8 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:25:31 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1876bf91-8ee9-4127-86c2-3381473177c8 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:25:31 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1876bf91-8ee9-4127-86c2-3381473177c8 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:25:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1876bf91-8ee9-4127-86c2-3381473177c8 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:25:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1876bf91-8ee9-4127-86c2-3381473177c8 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:25:31 devstack sudo[104968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:25:31 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:25:31 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-882f733b-2ad1-4e68-88b0-a0b229e2add9 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Acquiring lock "cinder-3ef31f50-016f-4a14-9850-ec5e0fd46fa5-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:25:31 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root
Nov 04 12:25:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1876bf91-8ee9-4127-86c2-3381473177c8 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.269s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:25:31 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-1876bf91-8ee9-4127-86c2-3381473177c8 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:25:31 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-1876bf91-8ee9-4127-86c2-3381473177c8 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Deleted volume successfully.
Nov 04 12:25:31 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-882f733b-2ad1-4e68-88b0-a0b229e2add9 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "cinder-3ef31f50-016f-4a14-9850-ec5e0fd46fa5-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:25:31 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1876bf91-8ee9-4127-86c2-3381473177c8 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "cinder-c0785a89-eb4e-45d6-93f4-ec96f4f63755-delete_volume" released by "delete_volume" :: held 1.224s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:25:31 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-882f733b-2ad1-4e68-88b0-a0b229e2add9 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Acquiring lock "cinder-quobyte-3ef31f50-016f-4a14-9850-ec5e0fd46fa5" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:25:31 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-882f733b-2ad1-4e68-88b0-a0b229e2add9 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "cinder-quobyte-3ef31f50-016f-4a14-9850-ec5e0fd46fa5" acquired by "delete_volume" :: waited 0.014s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:25:31 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4cb0729-799e-4d64-8237-f1004ac7f99b]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:25:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-882f733b-2ad1-4e68-88b0-a0b229e2add9 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3ef31f50-016f-4a14-9850-ec5e0fd46fa5 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:25:31 devstack sudo[104971]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3ef31f50-016f-4a14-9850-ec5e0fd46fa5
Nov 04 12:25:31 devstack sudo[104971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:25:32 devstack sudo[104971]: pam_unix(sudo:session): session closed for user root
Nov 04 12:25:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-882f733b-2ad1-4e68-88b0-a0b229e2add9 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3ef31f50-016f-4a14-9850-ec5e0fd46fa5" returned: 0 in 0.377s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:25:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-882f733b-2ad1-4e68-88b0-a0b229e2add9 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3ef31f50-016f-4a14-9850-ec5e0fd46fa5 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:25:32 devstack sudo[104976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3ef31f50-016f-4a14-9850-ec5e0fd46fa5
Nov 04 12:25:32 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:25:32 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root
Nov 04 12:25:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-882f733b-2ad1-4e68-88b0-a0b229e2add9 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3ef31f50-016f-4a14-9850-ec5e0fd46fa5" returned: 0 in 0.268s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:25:32 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-882f733b-2ad1-4e68-88b0-a0b229e2add9 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "cinder-quobyte-3ef31f50-016f-4a14-9850-ec5e0fd46fa5" released by "delete_volume" :: held 0.690s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:25:32 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-882f733b-2ad1-4e68-88b0-a0b229e2add9 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Created reservations ['3a932ca1-5efe-4eba-ba54-79cd222102ef', 'f0b542e1-9f0b-4195-9b8a-1406f96c15e5', '34076cce-afbe-4635-8c1e-8a963497dcfc', 'afa310de-caf9-4d8b-befb-2563a8d0f67e'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:25:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-882f733b-2ad1-4e68-88b0-a0b229e2add9 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:25:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-882f733b-2ad1-4e68-88b0-a0b229e2add9 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:25:32 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-882f733b-2ad1-4e68-88b0-a0b229e2add9 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:25:32 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-882f733b-2ad1-4e68-88b0-a0b229e2add9 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:25:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-882f733b-2ad1-4e68-88b0-a0b229e2add9 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:25:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-882f733b-2ad1-4e68-88b0-a0b229e2add9 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:25:32 devstack sudo[104985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:25:32 devstack sudo[104985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:25:32 devstack sudo[104985]: pam_unix(sudo:session): session closed for user root
Nov 04 12:25:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-882f733b-2ad1-4e68-88b0-a0b229e2add9 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.239s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:25:32 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-882f733b-2ad1-4e68-88b0-a0b229e2add9 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:25:32 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-882f733b-2ad1-4e68-88b0-a0b229e2add9 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Deleted volume successfully.
Nov 04 12:25:32 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ff8dc866-fc35-456c-be72-2875b9cc0b5b tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Acquiring lock "cinder-b55f227e-699e-45ce-8451-1576a5927e36-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:25:32 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-882f733b-2ad1-4e68-88b0-a0b229e2add9 tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "cinder-3ef31f50-016f-4a14-9850-ec5e0fd46fa5-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:25:32 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ff8dc866-fc35-456c-be72-2875b9cc0b5b tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "cinder-b55f227e-699e-45ce-8451-1576a5927e36-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:25:32 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ff8dc866-fc35-456c-be72-2875b9cc0b5b tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Acquiring lock "cinder-quobyte-b55f227e-699e-45ce-8451-1576a5927e36" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:25:32 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ff8dc866-fc35-456c-be72-2875b9cc0b5b tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "cinder-quobyte-b55f227e-699e-45ce-8451-1576a5927e36" acquired by "delete_volume" :: waited 0.019s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:25:32 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a5b72c-a568-4858-a6e2-d0d679bdd56d]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:25:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ff8dc866-fc35-456c-be72-2875b9cc0b5b tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-b55f227e-699e-45ce-8451-1576a5927e36 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:25:33 devstack sudo[104988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-b55f227e-699e-45ce-8451-1576a5927e36
Nov 04 12:25:33 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:25:33 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root
Nov 04 12:25:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ff8dc866-fc35-456c-be72-2875b9cc0b5b tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-b55f227e-699e-45ce-8451-1576a5927e36" returned: 0 in 0.372s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:25:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ff8dc866-fc35-456c-be72-2875b9cc0b5b tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-b55f227e-699e-45ce-8451-1576a5927e36 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:25:33 devstack sudo[104993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-b55f227e-699e-45ce-8451-1576a5927e36
Nov 04 12:25:33 devstack sudo[104993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:25:33 devstack sudo[104993]: pam_unix(sudo:session): session closed for user root
Nov 04 12:25:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ff8dc866-fc35-456c-be72-2875b9cc0b5b tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-b55f227e-699e-45ce-8451-1576a5927e36" returned: 0 in 0.284s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:25:33 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ff8dc866-fc35-456c-be72-2875b9cc0b5b tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "cinder-quobyte-b55f227e-699e-45ce-8451-1576a5927e36" released by "delete_volume" :: held 0.707s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:25:33 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-ff8dc866-fc35-456c-be72-2875b9cc0b5b tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Created reservations ['ce7b752d-00dc-478d-bd11-0c1ec5b54d14', 'db94acd9-447d-4ec1-8d84-741e0433318f', '05469d3c-854b-4d2b-8217-9c3542a1f5ac', '536b0dad-59b3-4733-85ae-1972c6dc9ec4'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:25:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ff8dc866-fc35-456c-be72-2875b9cc0b5b tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:25:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ff8dc866-fc35-456c-be72-2875b9cc0b5b tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:25:33 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ff8dc866-fc35-456c-be72-2875b9cc0b5b tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:25:33 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ff8dc866-fc35-456c-be72-2875b9cc0b5b tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:25:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ff8dc866-fc35-456c-be72-2875b9cc0b5b tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:25:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ff8dc866-fc35-456c-be72-2875b9cc0b5b tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:25:33 devstack sudo[104996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:25:33 devstack sudo[104996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:25:34 devstack sudo[104996]: pam_unix(sudo:session): session closed for user root
Nov 04 12:25:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ff8dc866-fc35-456c-be72-2875b9cc0b5b tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.260s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:25:34 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-ff8dc866-fc35-456c-be72-2875b9cc0b5b tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:25:34 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-ff8dc866-fc35-456c-be72-2875b9cc0b5b tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Deleted volume successfully.
Nov 04 12:25:34 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ff8dc866-fc35-456c-be72-2875b9cc0b5b tempest-CreateVolumesFromSourceVolumeTest-2074600880 None] Lock "cinder-b55f227e-699e-45ce-8451-1576a5927e36-delete_volume" released by "delete_volume" :: held 1.196s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:25:43 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=40,cinder:UPDATE=61,cinder:DELETE=6,cinder:INSERT=18 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:25:44 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=44,cinder:UPDATE=71,cinder:INSERT=12,cinder:DELETE=6 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:25:49 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:25:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:25:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:25:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:25:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:25:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:25:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:25:49 devstack sudo[105042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:25:49 devstack sudo[105042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:25:50 devstack sudo[105042]: pam_unix(sudo:session): session closed for user root
Nov 04 12:25:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.392s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:25:50 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:25:50 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager._thread_info {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:25:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread count: 28 {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 12:25:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread info: [<_MainThread(MainThread, started 137165867425920)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137165754678912)>, <Thread(Thread-3 (stat_writer), started daemon 137165754130752)>, <Thread(Rabbit-heartbeat, started daemon 137165752997504)>, <Thread(Thread-5 (_runner), started daemon 137165753227712)>, <Thread(Thread-7 (_runner), started daemon 137165751273856)>, <Thread(fd_logger, started daemon 137165755322048)>, <Thread(privsep_reader, started daemon 137165748896704)>, <Thread(tpool_thread_0, started daemon 137165742520000)>, <Thread(tpool_thread_1, started daemon 137165734127296)>, <Thread(tpool_thread_2, started daemon 137165725734592)>, <Thread(tpool_thread_3, started daemon 137165717341888)>, <Thread(tpool_thread_4, started daemon 137165708949184)>, <Thread(tpool_thread_5, started daemon 137165700556480)>, <Thread(tpool_thread_6, started daemon 137165692163776)>, <Thread(tpool_thread_7, started daemon 137165683771072)>, <Thread(tpool_thread_8, started daemon 137165675378368)>, <Thread(tpool_thread_9, started daemon 137165666985664)>, <Thread(tpool_thread_10, started daemon 137165658592960)>, <Thread(tpool_thread_11, started daemon 137165650183872)>, <Thread(tpool_thread_12, started daemon 137165641774784)>, <Thread(tpool_thread_13, started daemon 137165633365696)>, <Thread(tpool_thread_14, started daemon 137165624956608)>, <Thread(tpool_thread_15, started daemon 137165616547520)>, <Thread(tpool_thread_16, started daemon 137165608138432)>, <Thread(tpool_thread_17, started daemon 137165599729344)>, <Thread(tpool_thread_18, started daemon 137165591320256)>, <Thread(tpool_thread_19, started daemon 137165582911168)>] {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 12:25:54 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-6c1b746b-6b73-46d2-b7e4-db8f703c9b4c req-7ce2bbbd-d67b-42da-bbe9-fb8d61a6cb79 tempest-TestMinimumBasicScenario-1715384600 None] Terminate volume connection completed successfully.
Nov 04 12:25:54 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-6c1b746b-6b73-46d2-b7e4-db8f703c9b4c req-7ce2bbbd-d67b-42da-bbe9-fb8d61a6cb79 tempest-TestMinimumBasicScenario-1715384600 None] Deleting attachment b49a0a2b-529e-493d-bea0-5848707e9df6. {{(pid=87169) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 12:25:55 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d0e38c2a-eb0a-4ec8-874c-76ccc9ca61fb tempest-TestMinimumBasicScenario-1715384600 None] Acquiring lock "cinder-00696832-16c1-4b00-8599-944665f489c7-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:25:55 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d0e38c2a-eb0a-4ec8-874c-76ccc9ca61fb tempest-TestMinimumBasicScenario-1715384600 None] Lock "cinder-00696832-16c1-4b00-8599-944665f489c7-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:25:55 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d0e38c2a-eb0a-4ec8-874c-76ccc9ca61fb tempest-TestMinimumBasicScenario-1715384600 None] Acquiring lock "cinder-quobyte-00696832-16c1-4b00-8599-944665f489c7" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:25:55 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d0e38c2a-eb0a-4ec8-874c-76ccc9ca61fb tempest-TestMinimumBasicScenario-1715384600 None] Lock "cinder-quobyte-00696832-16c1-4b00-8599-944665f489c7" acquired by "delete_volume" :: waited 0.017s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:25:55 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f22774-a1a3-46ae-847d-b4bb170faf0f]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:25:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0e38c2a-eb0a-4ec8-874c-76ccc9ca61fb tempest-TestMinimumBasicScenario-1715384600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-00696832-16c1-4b00-8599-944665f489c7 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:25:56 devstack sudo[105056]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-00696832-16c1-4b00-8599-944665f489c7
Nov 04 12:25:56 devstack sudo[105056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:25:56 devstack sudo[105056]: pam_unix(sudo:session): session closed for user root
Nov 04 12:25:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0e38c2a-eb0a-4ec8-874c-76ccc9ca61fb tempest-TestMinimumBasicScenario-1715384600 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-00696832-16c1-4b00-8599-944665f489c7" returned: 0 in 0.428s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:25:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0e38c2a-eb0a-4ec8-874c-76ccc9ca61fb tempest-TestMinimumBasicScenario-1715384600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-00696832-16c1-4b00-8599-944665f489c7 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:25:56 devstack sudo[105061]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-00696832-16c1-4b00-8599-944665f489c7
Nov 04 12:25:56 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:25:56 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root
Nov 04 12:25:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0e38c2a-eb0a-4ec8-874c-76ccc9ca61fb tempest-TestMinimumBasicScenario-1715384600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-00696832-16c1-4b00-8599-944665f489c7" returned: 0 in 0.280s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:25:56 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d0e38c2a-eb0a-4ec8-874c-76ccc9ca61fb tempest-TestMinimumBasicScenario-1715384600 None] Lock "cinder-quobyte-00696832-16c1-4b00-8599-944665f489c7" released by "delete_volume" :: held 0.762s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:25:56 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-d0e38c2a-eb0a-4ec8-874c-76ccc9ca61fb tempest-TestMinimumBasicScenario-1715384600 None] Created reservations ['6cb64cda-013a-413e-8185-b5fcf42c4132', '182ab0fd-811b-4d24-bac3-b14b2a61a196', '7f65808b-2af8-46b2-b080-77a5b5b09b75', '7f649933-60b6-42ca-9da0-9d8edb0a5a38'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:25:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d0e38c2a-eb0a-4ec8-874c-76ccc9ca61fb tempest-TestMinimumBasicScenario-1715384600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:25:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d0e38c2a-eb0a-4ec8-874c-76ccc9ca61fb tempest-TestMinimumBasicScenario-1715384600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:25:56 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d0e38c2a-eb0a-4ec8-874c-76ccc9ca61fb tempest-TestMinimumBasicScenario-1715384600 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:25:56 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d0e38c2a-eb0a-4ec8-874c-76ccc9ca61fb tempest-TestMinimumBasicScenario-1715384600 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:25:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d0e38c2a-eb0a-4ec8-874c-76ccc9ca61fb tempest-TestMinimumBasicScenario-1715384600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:25:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0e38c2a-eb0a-4ec8-874c-76ccc9ca61fb tempest-TestMinimumBasicScenario-1715384600 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:25:56 devstack sudo[105064]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:25:56 devstack sudo[105064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:25:57 devstack sudo[105064]: pam_unix(sudo:session): session closed for user root
Nov 04 12:25:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d0e38c2a-eb0a-4ec8-874c-76ccc9ca61fb tempest-TestMinimumBasicScenario-1715384600 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.285s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:25:57 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-d0e38c2a-eb0a-4ec8-874c-76ccc9ca61fb tempest-TestMinimumBasicScenario-1715384600 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:25:57 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-d0e38c2a-eb0a-4ec8-874c-76ccc9ca61fb tempest-TestMinimumBasicScenario-1715384600 None] Deleted volume successfully.
Nov 04 12:25:57 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d0e38c2a-eb0a-4ec8-874c-76ccc9ca61fb tempest-TestMinimumBasicScenario-1715384600 None] Lock "cinder-00696832-16c1-4b00-8599-944665f489c7-delete_volume" released by "delete_volume" :: held 1.270s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:26:04 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-a460dd5e-2f66-4ecd-972d-3f500314b868 tempest-SnapshotDependencyTests-333550157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:26:04 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a460dd5e-2f66-4ecd-972d-3f500314b868 tempest-SnapshotDependencyTests-333550157 None] Flow 'volume_create_manager' (f850094d-078b-4b59-af93-0d1a6cdb327f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:26:04 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a460dd5e-2f66-4ecd-972d-3f500314b868 tempest-SnapshotDependencyTests-333550157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7912ea6-1e14-4f0c-a41f-d32553961542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:26:04 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a460dd5e-2f66-4ecd-972d-3f500314b868 tempest-SnapshotDependencyTests-333550157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7912ea6-1e14-4f0c-a41f-d32553961542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-311083951',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a31ad8a-3769-40d0-a782-d997d6bc4698,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c8b7869831047658f607b59a9a0168b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:26:05Z,use_quota=True,user_id='07f079c2263548f2936366458521769b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:26:04 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a460dd5e-2f66-4ecd-972d-3f500314b868 tempest-SnapshotDependencyTests-333550157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc92aa78-e66a-45e4-ae4c-d5b7ddcda491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:26:04 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a460dd5e-2f66-4ecd-972d-3f500314b868 tempest-SnapshotDependencyTests-333550157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc92aa78-e66a-45e4-ae4c-d5b7ddcda491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:26:04 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a460dd5e-2f66-4ecd-972d-3f500314b868 tempest-SnapshotDependencyTests-333550157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbe0d030-f16b-434b-bfff-3d7a788311cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:26:04 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a460dd5e-2f66-4ecd-972d-3f500314b868 tempest-SnapshotDependencyTests-333550157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbe0d030-f16b-434b-bfff-3d7a788311cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a31ad8a-3769-40d0-a782-d997d6bc4698', 'volume_name': 'volume-9a31ad8a-3769-40d0-a782-d997d6bc4698', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:26:04 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a460dd5e-2f66-4ecd-972d-3f500314b868 tempest-SnapshotDependencyTests-333550157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98a095b6-ced0-4244-9bac-7cca427895bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:26:04 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a460dd5e-2f66-4ecd-972d-3f500314b868 tempest-SnapshotDependencyTests-333550157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98a095b6-ced0-4244-9bac-7cca427895bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:26:04 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a460dd5e-2f66-4ecd-972d-3f500314b868 tempest-SnapshotDependencyTests-333550157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d133f2d9-c967-4b9a-ab16-ef7f619f80ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:26:04 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-a460dd5e-2f66-4ecd-972d-3f500314b868 tempest-SnapshotDependencyTests-333550157 None] Volume 9a31ad8a-3769-40d0-a782-d997d6bc4698: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a31ad8a-3769-40d0-a782-d997d6bc4698', 'volume_size': 1}
Nov 04 12:26:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a460dd5e-2f66-4ecd-972d-3f500314b868 tempest-SnapshotDependencyTests-333550157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:26:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a460dd5e-2f66-4ecd-972d-3f500314b868 tempest-SnapshotDependencyTests-333550157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:26:04 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a460dd5e-2f66-4ecd-972d-3f500314b868 tempest-SnapshotDependencyTests-333550157 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:26:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-311083951',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a31ad8a-3769-40d0-a782-d997d6bc4698,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c8b7869831047658f607b59a9a0168b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:26:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:26:05Z,use_quota=True,user_id='07f079c2263548f2936366458521769b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:26:04 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-a460dd5e-2f66-4ecd-972d-3f500314b868 tempest-SnapshotDependencyTests-333550157 None] Creating volume 9a31ad8a-3769-40d0-a782-d997d6bc4698 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:26:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a460dd5e-2f66-4ecd-972d-3f500314b868 tempest-SnapshotDependencyTests-333550157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:26:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a460dd5e-2f66-4ecd-972d-3f500314b868 tempest-SnapshotDependencyTests-333550157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:26:04 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a460dd5e-2f66-4ecd-972d-3f500314b868 tempest-SnapshotDependencyTests-333550157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:26:04 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a460dd5e-2f66-4ecd-972d-3f500314b868 tempest-SnapshotDependencyTests-333550157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:26:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a460dd5e-2f66-4ecd-972d-3f500314b868 tempest-SnapshotDependencyTests-333550157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:26:04 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a460dd5e-2f66-4ecd-972d-3f500314b868 tempest-SnapshotDependencyTests-333550157 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:26:04 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-a460dd5e-2f66-4ecd-972d-3f500314b868 tempest-SnapshotDependencyTests-333550157 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:26:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a460dd5e-2f66-4ecd-972d-3f500314b868 tempest-SnapshotDependencyTests-333550157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:26:04 devstack sudo[105091]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698 1073741824
Nov 04 12:26:04 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:26:05 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root
Nov 04 12:26:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a460dd5e-2f66-4ecd-972d-3f500314b868 tempest-SnapshotDependencyTests-333550157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698 1073741824" returned: 0 in 0.428s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:26:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a460dd5e-2f66-4ecd-972d-3f500314b868 tempest-SnapshotDependencyTests-333550157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:26:05 devstack sudo[105097]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698
Nov 04 12:26:05 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:26:05 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root
Nov 04 12:26:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a460dd5e-2f66-4ecd-972d-3f500314b868 tempest-SnapshotDependencyTests-333550157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698" returned: 0 in 0.303s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:26:05 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a460dd5e-2f66-4ecd-972d-3f500314b868 tempest-SnapshotDependencyTests-333550157 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:26:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a460dd5e-2f66-4ecd-972d-3f500314b868 tempest-SnapshotDependencyTests-333550157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:26:05 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a460dd5e-2f66-4ecd-972d-3f500314b868 tempest-SnapshotDependencyTests-333550157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d133f2d9-c967-4b9a-ab16-ef7f619f80ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a31ad8a-3769-40d0-a782-d997d6bc4698', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:26:05 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a460dd5e-2f66-4ecd-972d-3f500314b868 tempest-SnapshotDependencyTests-333550157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee6fe3b-d417-4af6-9cd0-2c39f6d7e9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:26:05 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-a460dd5e-2f66-4ecd-972d-3f500314b868 tempest-SnapshotDependencyTests-333550157 None] Volume volume-9a31ad8a-3769-40d0-a782-d997d6bc4698 (9a31ad8a-3769-40d0-a782-d997d6bc4698): created successfully
Nov 04 12:26:05 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a460dd5e-2f66-4ecd-972d-3f500314b868 tempest-SnapshotDependencyTests-333550157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee6fe3b-d417-4af6-9cd0-2c39f6d7e9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:26:05 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a460dd5e-2f66-4ecd-972d-3f500314b868 tempest-SnapshotDependencyTests-333550157 None] Flow 'volume_create_manager' (f850094d-078b-4b59-af93-0d1a6cdb327f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:26:05 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-a460dd5e-2f66-4ecd-972d-3f500314b868 tempest-SnapshotDependencyTests-333550157 None] Created volume successfully.
Nov 04 12:26:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-fdd86bb1-9a28-4890-bbb3-5afb2c2de2a7 tempest-SnapshotDependencyTests-333550157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:26:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-fdd86bb1-9a28-4890-bbb3-5afb2c2de2a7 tempest-SnapshotDependencyTests-333550157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:26:07 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-fdd86bb1-9a28-4890-bbb3-5afb2c2de2a7 tempest-SnapshotDependencyTests-333550157 None] Creating offline snapshot f055c740-bfb4-4623-949d-982ff2b2b398 of volume 9a31ad8a-3769-40d0-a782-d997d6bc4698 {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:26:07 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad1172a-7678-4e83-b2ee-24098d01bffa]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:26:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fdd86bb1-9a28-4890-bbb3-5afb2c2de2a7 tempest-SnapshotDependencyTests-333550157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:26:07 devstack sudo[105101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698
Nov 04 12:26:07 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:26:07 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root
Nov 04 12:26:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fdd86bb1-9a28-4890-bbb3-5afb2c2de2a7 tempest-SnapshotDependencyTests-333550157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698" returned: 0 in 0.401s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:26:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fdd86bb1-9a28-4890-bbb3-5afb2c2de2a7 tempest-SnapshotDependencyTests-333550157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698.f055c740-bfb4-4623-949d-982ff2b2b398 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:26:07 devstack sudo[105107]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698.f055c740-bfb4-4623-949d-982ff2b2b398 1G
Nov 04 12:26:07 devstack sudo[105107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:26:08 devstack sudo[105107]: pam_unix(sudo:session): session closed for user root
Nov 04 12:26:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fdd86bb1-9a28-4890-bbb3-5afb2c2de2a7 tempest-SnapshotDependencyTests-333550157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698.f055c740-bfb4-4623-949d-982ff2b2b398 1G" returned: 0 in 0.473s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:26:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fdd86bb1-9a28-4890-bbb3-5afb2c2de2a7 tempest-SnapshotDependencyTests-333550157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a31ad8a-3769-40d0-a782-d997d6bc4698 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698.f055c740-bfb4-4623-949d-982ff2b2b398 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:26:08 devstack sudo[105114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a31ad8a-3769-40d0-a782-d997d6bc4698 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698.f055c740-bfb4-4623-949d-982ff2b2b398
Nov 04 12:26:08 devstack sudo[105114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:26:08 devstack sudo[105114]: pam_unix(sudo:session): session closed for user root
Nov 04 12:26:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fdd86bb1-9a28-4890-bbb3-5afb2c2de2a7 tempest-SnapshotDependencyTests-333550157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a31ad8a-3769-40d0-a782-d997d6bc4698 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698.f055c740-bfb4-4623-949d-982ff2b2b398" returned: 0 in 0.319s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:26:08 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-fdd86bb1-9a28-4890-bbb3-5afb2c2de2a7 tempest-SnapshotDependencyTests-333550157 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698.f055c740-bfb4-4623-949d-982ff2b2b398 is being set with open permissions: ugo+rw
Nov 04 12:26:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fdd86bb1-9a28-4890-bbb3-5afb2c2de2a7 tempest-SnapshotDependencyTests-333550157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698.f055c740-bfb4-4623-949d-982ff2b2b398 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:26:08 devstack sudo[105120]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698.f055c740-bfb4-4623-949d-982ff2b2b398
Nov 04 12:26:08 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:26:08 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root
Nov 04 12:26:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fdd86bb1-9a28-4890-bbb3-5afb2c2de2a7 tempest-SnapshotDependencyTests-333550157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698.f055c740-bfb4-4623-949d-982ff2b2b398" returned: 0 in 0.248s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:26:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fdd86bb1-9a28-4890-bbb3-5afb2c2de2a7 tempest-SnapshotDependencyTests-333550157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:26:08 devstack sudo[105123]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698.info
Nov 04 12:26:08 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:26:08 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root
Nov 04 12:26:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fdd86bb1-9a28-4890-bbb3-5afb2c2de2a7 tempest-SnapshotDependencyTests-333550157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698.info" returned: 0 in 0.258s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:26:08 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-fdd86bb1-9a28-4890-bbb3-5afb2c2de2a7 tempest-SnapshotDependencyTests-333550157 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698.info is being set with open permissions: ugo+rw
Nov 04 12:26:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fdd86bb1-9a28-4890-bbb3-5afb2c2de2a7 tempest-SnapshotDependencyTests-333550157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:26:08 devstack sudo[105126]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698.info
Nov 04 12:26:08 devstack sudo[105126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:26:09 devstack sudo[105126]: pam_unix(sudo:session): session closed for user root
Nov 04 12:26:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fdd86bb1-9a28-4890-bbb3-5afb2c2de2a7 tempest-SnapshotDependencyTests-333550157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698.info" returned: 0 in 0.256s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:26:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-fdd86bb1-9a28-4890-bbb3-5afb2c2de2a7 tempest-SnapshotDependencyTests-333550157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.057s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:26:09 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-fdd86bb1-9a28-4890-bbb3-5afb2c2de2a7 tempest-SnapshotDependencyTests-333550157 None] Create snapshot completed successfully
Nov 04 12:26:11 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:26:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Flow 'volume_create_manager' (99dc8680-8df7-4681-9dee-6907ef702ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:26:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d46a537-b6bc-47b8-a6dd-998b96297382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:26:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d46a537-b6bc-47b8-a6dd-998b96297382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:26:11Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2c20029-781b-4a9d-8f04-5dbb80cf627f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c8b7869831047658f607b59a9a0168b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f055c740-bfb4-4623-949d-982ff2b2b398,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:26:11Z,use_quota=True,user_id='07f079c2263548f2936366458521769b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:26:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df8ac28e-241a-465d-8952-5483d6e6ad2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:26:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df8ac28e-241a-465d-8952-5483d6e6ad2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:26:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42b1f4ce-55d5-4343-bb8d-252ce9a43186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:26:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42b1f4ce-55d5-4343-bb8d-252ce9a43186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a2c20029-781b-4a9d-8f04-5dbb80cf627f', 'volume_name': 'volume-a2c20029-781b-4a9d-8f04-5dbb80cf627f', 'volume_size': 1, 'snapshot_id': 'f055c740-bfb4-4623-949d-982ff2b2b398'}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:26:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (907e2739-82c1-4fe7-9a96-4c3309b83c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:26:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (907e2739-82c1-4fe7-9a96-4c3309b83c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:26:11 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (433cb840-00ee-473f-85fe-81da6e0bef1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:26:11 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Volume a2c20029-781b-4a9d-8f04-5dbb80cf627f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a2c20029-781b-4a9d-8f04-5dbb80cf627f', 'volume_size': 1, 'snapshot_id': 'f055c740-bfb4-4623-949d-982ff2b2b398'}
Nov 04 12:26:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:26:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:26:11 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Acquiring lock "cinder-quobyte-f055c740-bfb4-4623-949d-982ff2b2b398-a2c20029-781b-4a9d-8f04-5dbb80cf627f" by "_create_volume_from_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:26:11 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Lock "cinder-quobyte-f055c740-bfb4-4623-949d-982ff2b2b398-a2c20029-781b-4a9d-8f04-5dbb80cf627f" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:26:11 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Creating volume a2c20029-781b-4a9d-8f04-5dbb80cf627f from snapshot f055c740-bfb4-4623-949d-982ff2b2b398 {{(pid=87169) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 04 12:26:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:26:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:26:11 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:26:11 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:26:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:26:11 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:26:11 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Acquiring lock "cinder-quobyte-a2c20029-781b-4a9d-8f04-5dbb80cf627f" by "_copy_volume_from_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:26:11 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Lock "cinder-quobyte-a2c20029-781b-4a9d-8f04-5dbb80cf627f" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:26:11 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] snapshot: f055c740-bfb4-4623-949d-982ff2b2b398, volume: a2c20029-781b-4a9d-8f04-5dbb80cf627f,  {{(pid=87169) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 04 12:26:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:26:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:26:11 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:26:11 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:26:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:26:11 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96e4521-27f7-4b33-aed3-474e9582cf20]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:26:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698.f055c740-bfb4-4623-949d-982ff2b2b398 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:26:11 devstack sudo[105130]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698.f055c740-bfb4-4623-949d-982ff2b2b398
Nov 04 12:26:11 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:26:11 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root
Nov 04 12:26:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698.f055c740-bfb4-4623-949d-982ff2b2b398" returned: 0 in 0.377s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:26:11 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a31ad8a-3769-40d0-a782-d997d6bc4698(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:26:11 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8868bab-7f08-4d9c-8a72-92cace841a9a]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:26:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:26:11 devstack sudo[105137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698
Nov 04 12:26:11 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:26:12 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root
Nov 04 12:26:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698" returned: 0 in 0.383s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:26:12 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698 {{(pid=87169) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 04 12:26:12 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Creating direct copy from snapshot {{(pid=87169) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 04 12:26:12 devstack cinder-volume[87169]: DEBUG cinder.utils [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Path /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a2c20029-781b-4a9d-8f04-5dbb80cf627f not found in is_blk_device check {{(pid=87169) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 04 12:26:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a2c20029-781b-4a9d-8f04-5dbb80cf627f {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:26:12 devstack sudo[105142]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a2c20029-781b-4a9d-8f04-5dbb80cf627f
Nov 04 12:26:12 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:26:18 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root
Nov 04 12:26:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a2c20029-781b-4a9d-8f04-5dbb80cf627f" returned: 0 in 6.681s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:26:18 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Image conversion details: src /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698, size 1024.00 MB, duration 6.68 sec, destination /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a2c20029-781b-4a9d-8f04-5dbb80cf627f {{(pid=87169) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 12:26:18 devstack cinder-volume[87169]: INFO cinder.image.image_utils [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Converted 1024.00 MB image at 153.22 MB/s
Nov 04 12:26:18 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a2c20029-781b-4a9d-8f04-5dbb80cf627f is being set with open permissions: ugo+rw
Nov 04 12:26:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a2c20029-781b-4a9d-8f04-5dbb80cf627f {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:26:18 devstack sudo[105155]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a2c20029-781b-4a9d-8f04-5dbb80cf627f
Nov 04 12:26:18 devstack sudo[105155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:26:18 devstack sudo[105155]: pam_unix(sudo:session): session closed for user root
Nov 04 12:26:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a2c20029-781b-4a9d-8f04-5dbb80cf627f" returned: 0 in 0.267s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:26:18 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Lock "cinder-quobyte-a2c20029-781b-4a9d-8f04-5dbb80cf627f" released by "_copy_volume_from_snapshot" :: held 7.802s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:26:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Lock "cinder-quobyte-f055c740-bfb4-4623-949d-982ff2b2b398-a2c20029-781b-4a9d-8f04-5dbb80cf627f" released by "_create_volume_from_snapshot" :: held 7.892s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:26:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.909s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:26:19 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (433cb840-00ee-473f-85fe-81da6e0bef1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2c20029-781b-4a9d-8f04-5dbb80cf627f', 'volume_size': 1, 'snapshot_id': 'f055c740-bfb4-4623-949d-982ff2b2b398'}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:26:19 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62a35788-876c-4c98-aa59-101e239d475d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:26:19 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Volume volume-a2c20029-781b-4a9d-8f04-5dbb80cf627f (a2c20029-781b-4a9d-8f04-5dbb80cf627f): created successfully
Nov 04 12:26:19 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62a35788-876c-4c98-aa59-101e239d475d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:26:19 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Flow 'volume_create_manager' (99dc8680-8df7-4681-9dee-6907ef702ff6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:26:19 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-3994dafe-24ee-44ba-81a7-fbb41c755385 tempest-SnapshotDependencyTests-333550157 None] Created volume successfully.
Nov 04 12:26:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9da120a0-25da-4d06-9f53-0d90d31b7a9a tempest-SnapshotDependencyTests-333550157 None] Acquiring lock "cinder-f055c740-bfb4-4623-949d-982ff2b2b398-delete_snapshot" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:26:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9da120a0-25da-4d06-9f53-0d90d31b7a9a tempest-SnapshotDependencyTests-333550157 None] Lock "cinder-f055c740-bfb4-4623-949d-982ff2b2b398-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:26:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9da120a0-25da-4d06-9f53-0d90d31b7a9a tempest-SnapshotDependencyTests-333550157 None] Acquiring lock "cinder-quobyte-9a31ad8a-3769-40d0-a782-d997d6bc4698" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:26:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9da120a0-25da-4d06-9f53-0d90d31b7a9a tempest-SnapshotDependencyTests-333550157 None] Lock "cinder-quobyte-9a31ad8a-3769-40d0-a782-d997d6bc4698" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:26:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9da120a0-25da-4d06-9f53-0d90d31b7a9a tempest-SnapshotDependencyTests-333550157 None] Acquiring lock "cinder-quobyte-f055c740-bfb4-4623-949d-982ff2b2b398" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:26:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9da120a0-25da-4d06-9f53-0d90d31b7a9a tempest-SnapshotDependencyTests-333550157 None] Lock "cinder-quobyte-f055c740-bfb4-4623-949d-982ff2b2b398" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:26:19 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-9da120a0-25da-4d06-9f53-0d90d31b7a9a tempest-SnapshotDependencyTests-333550157 None] Deleting offline snapshot f055c740-bfb4-4623-949d-982ff2b2b398 of volume 9a31ad8a-3769-40d0-a782-d997d6bc4698 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:26:19 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-9da120a0-25da-4d06-9f53-0d90d31b7a9a tempest-SnapshotDependencyTests-333550157 None] snapshot_file for this snap is: volume-9a31ad8a-3769-40d0-a782-d997d6bc4698.f055c740-bfb4-4623-949d-982ff2b2b398 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:26:19 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be8baa3-f3e7-4e7e-86af-07cb843d1687]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:26:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9da120a0-25da-4d06-9f53-0d90d31b7a9a tempest-SnapshotDependencyTests-333550157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698.f055c740-bfb4-4623-949d-982ff2b2b398 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:26:20 devstack sudo[105158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698.f055c740-bfb4-4623-949d-982ff2b2b398
Nov 04 12:26:20 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:26:20 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root
Nov 04 12:26:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9da120a0-25da-4d06-9f53-0d90d31b7a9a tempest-SnapshotDependencyTests-333550157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698.f055c740-bfb4-4623-949d-982ff2b2b398" returned: 0 in 0.404s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:26:20 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-9da120a0-25da-4d06-9f53-0d90d31b7a9a tempest-SnapshotDependencyTests-333550157 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a31ad8a-3769-40d0-a782-d997d6bc4698(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:26:20 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a27010f-b3da-4646-9713-d1466d94f595]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:26:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9da120a0-25da-4d06-9f53-0d90d31b7a9a tempest-SnapshotDependencyTests-333550157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:26:20 devstack sudo[105163]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698
Nov 04 12:26:20 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:26:21 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root
Nov 04 12:26:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9da120a0-25da-4d06-9f53-0d90d31b7a9a tempest-SnapshotDependencyTests-333550157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698" returned: 0 in 0.613s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:26:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9da120a0-25da-4d06-9f53-0d90d31b7a9a tempest-SnapshotDependencyTests-333550157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698.f055c740-bfb4-4623-949d-982ff2b2b398 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:26:21 devstack sudo[105169]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698.f055c740-bfb4-4623-949d-982ff2b2b398
Nov 04 12:26:21 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:26:21 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root
Nov 04 12:26:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9da120a0-25da-4d06-9f53-0d90d31b7a9a tempest-SnapshotDependencyTests-333550157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698.f055c740-bfb4-4623-949d-982ff2b2b398" returned: 0 in 0.386s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:26:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9da120a0-25da-4d06-9f53-0d90d31b7a9a tempest-SnapshotDependencyTests-333550157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698.f055c740-bfb4-4623-949d-982ff2b2b398 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:26:21 devstack sudo[105175]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698.f055c740-bfb4-4623-949d-982ff2b2b398
Nov 04 12:26:21 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:26:21 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root
Nov 04 12:26:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9da120a0-25da-4d06-9f53-0d90d31b7a9a tempest-SnapshotDependencyTests-333550157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698.f055c740-bfb4-4623-949d-982ff2b2b398" returned: 0 in 0.332s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:26:21 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9da120a0-25da-4d06-9f53-0d90d31b7a9a tempest-SnapshotDependencyTests-333550157 None] Lock "cinder-quobyte-f055c740-bfb4-4623-949d-982ff2b2b398" released by "_delete_snapshot" :: held 1.867s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:26:21 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9da120a0-25da-4d06-9f53-0d90d31b7a9a tempest-SnapshotDependencyTests-333550157 None] Lock "cinder-quobyte-9a31ad8a-3769-40d0-a782-d997d6bc4698" released by "delete_snapshot" :: held 1.891s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:26:21 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-9da120a0-25da-4d06-9f53-0d90d31b7a9a tempest-SnapshotDependencyTests-333550157 None] Created reservations ['1bb9c6f2-bfa4-4da9-81b4-bac79ea95738', 'cb9df259-b2f4-47d0-80f7-16c062759e42', 'a4fd472c-b3c5-46bb-85c4-a957ff2d800d', '8fb8e62e-bb6b-4fb0-bb41-31f1cd0f0e1f'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:26:21 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-9da120a0-25da-4d06-9f53-0d90d31b7a9a tempest-SnapshotDependencyTests-333550157 None] Delete snapshot completed successfully.
Nov 04 12:26:21 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9da120a0-25da-4d06-9f53-0d90d31b7a9a tempest-SnapshotDependencyTests-333550157 None] Lock "cinder-f055c740-bfb4-4623-949d-982ff2b2b398-delete_snapshot" released by "delete_snapshot" :: held 2.071s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:26:22 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-79c4ddba-b045-44fc-901b-4fa4cea59f7a tempest-SnapshotDependencyTests-333550157 None] Acquiring lock "cinder-9a31ad8a-3769-40d0-a782-d997d6bc4698-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:26:22 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-79c4ddba-b045-44fc-901b-4fa4cea59f7a tempest-SnapshotDependencyTests-333550157 None] Lock "cinder-9a31ad8a-3769-40d0-a782-d997d6bc4698-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:26:22 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-79c4ddba-b045-44fc-901b-4fa4cea59f7a tempest-SnapshotDependencyTests-333550157 None] Acquiring lock "cinder-quobyte-9a31ad8a-3769-40d0-a782-d997d6bc4698" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:26:22 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-79c4ddba-b045-44fc-901b-4fa4cea59f7a tempest-SnapshotDependencyTests-333550157 None] Lock "cinder-quobyte-9a31ad8a-3769-40d0-a782-d997d6bc4698" acquired by "delete_volume" :: waited 0.023s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:26:22 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa51ea6c-6872-4ab1-9a39-497141110ec3]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:26:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-79c4ddba-b045-44fc-901b-4fa4cea59f7a tempest-SnapshotDependencyTests-333550157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:26:22 devstack sudo[105178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698
Nov 04 12:26:22 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:26:22 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root
Nov 04 12:26:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-79c4ddba-b045-44fc-901b-4fa4cea59f7a tempest-SnapshotDependencyTests-333550157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698" returned: 0 in 0.400s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:26:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-79c4ddba-b045-44fc-901b-4fa4cea59f7a tempest-SnapshotDependencyTests-333550157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:26:22 devstack sudo[105184]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698
Nov 04 12:26:22 devstack sudo[105184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:26:22 devstack sudo[105184]: pam_unix(sudo:session): session closed for user root
Nov 04 12:26:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-79c4ddba-b045-44fc-901b-4fa4cea59f7a tempest-SnapshotDependencyTests-333550157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9a31ad8a-3769-40d0-a782-d997d6bc4698" returned: 0 in 0.256s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:26:22 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-79c4ddba-b045-44fc-901b-4fa4cea59f7a tempest-SnapshotDependencyTests-333550157 None] Lock "cinder-quobyte-9a31ad8a-3769-40d0-a782-d997d6bc4698" released by "delete_volume" :: held 0.733s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:26:22 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-79c4ddba-b045-44fc-901b-4fa4cea59f7a tempest-SnapshotDependencyTests-333550157 None] Created reservations ['bae364a9-21b6-478a-b7b7-d2ff45b9daf0', '5d04b19b-bad0-4ac0-b36e-487ed53d3a5a', '8648eb25-568d-4a8d-88d8-a98ca94c9dba', 'b1d08799-d35b-4493-9c91-a1fb62d3bb9e'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:26:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-79c4ddba-b045-44fc-901b-4fa4cea59f7a tempest-SnapshotDependencyTests-333550157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:26:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-79c4ddba-b045-44fc-901b-4fa4cea59f7a tempest-SnapshotDependencyTests-333550157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:26:22 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-79c4ddba-b045-44fc-901b-4fa4cea59f7a tempest-SnapshotDependencyTests-333550157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:26:22 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-79c4ddba-b045-44fc-901b-4fa4cea59f7a tempest-SnapshotDependencyTests-333550157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:26:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-79c4ddba-b045-44fc-901b-4fa4cea59f7a tempest-SnapshotDependencyTests-333550157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:26:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-79c4ddba-b045-44fc-901b-4fa4cea59f7a tempest-SnapshotDependencyTests-333550157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:26:23 devstack sudo[105187]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:26:23 devstack sudo[105187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:26:23 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-37471583-2fef-400a-b80d-9cf2f8da04ba tempest-SnapshotDependencyTests-333550157 None] Acquiring lock "cinder-a2c20029-781b-4a9d-8f04-5dbb80cf627f-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:26:23 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-37471583-2fef-400a-b80d-9cf2f8da04ba tempest-SnapshotDependencyTests-333550157 None] Lock "cinder-a2c20029-781b-4a9d-8f04-5dbb80cf627f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:26:23 devstack sudo[105187]: pam_unix(sudo:session): session closed for user root
Nov 04 12:26:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-79c4ddba-b045-44fc-901b-4fa4cea59f7a tempest-SnapshotDependencyTests-333550157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.309s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:26:23 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-79c4ddba-b045-44fc-901b-4fa4cea59f7a tempest-SnapshotDependencyTests-333550157 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:26:23 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-79c4ddba-b045-44fc-901b-4fa4cea59f7a tempest-SnapshotDependencyTests-333550157 None] Deleted volume successfully.
Nov 04 12:26:23 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-37471583-2fef-400a-b80d-9cf2f8da04ba tempest-SnapshotDependencyTests-333550157 None] Acquiring lock "cinder-quobyte-a2c20029-781b-4a9d-8f04-5dbb80cf627f" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:26:23 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-79c4ddba-b045-44fc-901b-4fa4cea59f7a tempest-SnapshotDependencyTests-333550157 None] Lock "cinder-9a31ad8a-3769-40d0-a782-d997d6bc4698-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:26:23 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-37471583-2fef-400a-b80d-9cf2f8da04ba tempest-SnapshotDependencyTests-333550157 None] Lock "cinder-quobyte-a2c20029-781b-4a9d-8f04-5dbb80cf627f" acquired by "delete_volume" :: waited 0.023s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:26:23 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[162bb96c-f185-4697-ac5a-57e4c0877098]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:26:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-37471583-2fef-400a-b80d-9cf2f8da04ba tempest-SnapshotDependencyTests-333550157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a2c20029-781b-4a9d-8f04-5dbb80cf627f {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:26:23 devstack sudo[105190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a2c20029-781b-4a9d-8f04-5dbb80cf627f
Nov 04 12:26:23 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:26:23 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root
Nov 04 12:26:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-37471583-2fef-400a-b80d-9cf2f8da04ba tempest-SnapshotDependencyTests-333550157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a2c20029-781b-4a9d-8f04-5dbb80cf627f" returned: 0 in 0.412s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:26:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-37471583-2fef-400a-b80d-9cf2f8da04ba tempest-SnapshotDependencyTests-333550157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a2c20029-781b-4a9d-8f04-5dbb80cf627f {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:26:23 devstack sudo[105195]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a2c20029-781b-4a9d-8f04-5dbb80cf627f
Nov 04 12:26:23 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:26:24 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root
Nov 04 12:26:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-37471583-2fef-400a-b80d-9cf2f8da04ba tempest-SnapshotDependencyTests-333550157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a2c20029-781b-4a9d-8f04-5dbb80cf627f" returned: 0 in 0.290s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:26:24 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-37471583-2fef-400a-b80d-9cf2f8da04ba tempest-SnapshotDependencyTests-333550157 None] Lock "cinder-quobyte-a2c20029-781b-4a9d-8f04-5dbb80cf627f" released by "delete_volume" :: held 0.753s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:26:24 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-37471583-2fef-400a-b80d-9cf2f8da04ba tempest-SnapshotDependencyTests-333550157 None] Created reservations ['0e51cd44-2f21-46f9-a361-9728a95f50fc', '52abe1f4-4f8a-4a8d-b70f-7265aede3edb', '23c8cfb3-ee9e-4f65-bfbd-c268de8a794e', '6f91fa3d-9acf-4811-a3e8-61084d96a282'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:26:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-37471583-2fef-400a-b80d-9cf2f8da04ba tempest-SnapshotDependencyTests-333550157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:26:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-37471583-2fef-400a-b80d-9cf2f8da04ba tempest-SnapshotDependencyTests-333550157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:26:24 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-37471583-2fef-400a-b80d-9cf2f8da04ba tempest-SnapshotDependencyTests-333550157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:26:24 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-37471583-2fef-400a-b80d-9cf2f8da04ba tempest-SnapshotDependencyTests-333550157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:26:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-37471583-2fef-400a-b80d-9cf2f8da04ba tempest-SnapshotDependencyTests-333550157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:26:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-37471583-2fef-400a-b80d-9cf2f8da04ba tempest-SnapshotDependencyTests-333550157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:26:24 devstack sudo[105198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:26:24 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:26:24 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root
Nov 04 12:26:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-37471583-2fef-400a-b80d-9cf2f8da04ba tempest-SnapshotDependencyTests-333550157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.293s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:26:24 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-37471583-2fef-400a-b80d-9cf2f8da04ba tempest-SnapshotDependencyTests-333550157 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:26:24 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-37471583-2fef-400a-b80d-9cf2f8da04ba tempest-SnapshotDependencyTests-333550157 None] Deleted volume successfully.
Nov 04 12:26:24 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-37471583-2fef-400a-b80d-9cf2f8da04ba tempest-SnapshotDependencyTests-333550157 None] Lock "cinder-a2c20029-781b-4a9d-8f04-5dbb80cf627f-delete_volume" released by "delete_volume" :: held 1.311s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:26:34 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=31,cinder:INSERT=7,cinder:UPDATE=33,cinder:DELETE=1 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:26:34 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=31,cinder:UPDATE=42,cinder:INSERT=12,cinder:DELETE=5 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:26:40 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-6db697e6-522e-4c12-ac61-070a42ccd316 tempest-TestStampPattern-1003780276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:26:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6db697e6-522e-4c12-ac61-070a42ccd316 tempest-TestStampPattern-1003780276 None] Flow 'volume_create_manager' (880f4999-3d36-440f-a03e-240c6d442de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:26:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6db697e6-522e-4c12-ac61-070a42ccd316 tempest-TestStampPattern-1003780276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (626cdc74-ca34-4d0a-97be-cbf1e36b926a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:26:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6db697e6-522e-4c12-ac61-070a42ccd316 tempest-TestStampPattern-1003780276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (626cdc74-ca34-4d0a-97be-cbf1e36b926a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-629281033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bcea5f0-1f8e-40e9-9503-8f371d3d39fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0603eff0eb2e4e32beeae0c4d1ef78a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:26:40Z,use_quota=True,user_id='9319afe44e1f4cde86d004ba95f1b0f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:26:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6db697e6-522e-4c12-ac61-070a42ccd316 tempest-TestStampPattern-1003780276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (148a4cad-3f5f-408b-a537-15cd1e9e79f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:26:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6db697e6-522e-4c12-ac61-070a42ccd316 tempest-TestStampPattern-1003780276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (148a4cad-3f5f-408b-a537-15cd1e9e79f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:26:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6db697e6-522e-4c12-ac61-070a42ccd316 tempest-TestStampPattern-1003780276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66f92759-418f-4974-847e-89703d33f206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:26:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6db697e6-522e-4c12-ac61-070a42ccd316 tempest-TestStampPattern-1003780276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66f92759-418f-4974-847e-89703d33f206) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bcea5f0-1f8e-40e9-9503-8f371d3d39fe', 'volume_name': 'volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:26:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6db697e6-522e-4c12-ac61-070a42ccd316 tempest-TestStampPattern-1003780276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91ef8423-2c06-4a89-a4e8-dc2fadeb063c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:26:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6db697e6-522e-4c12-ac61-070a42ccd316 tempest-TestStampPattern-1003780276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91ef8423-2c06-4a89-a4e8-dc2fadeb063c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:26:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6db697e6-522e-4c12-ac61-070a42ccd316 tempest-TestStampPattern-1003780276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98e6b649-44ac-44d8-8d0d-c475f90d0ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:26:40 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-6db697e6-522e-4c12-ac61-070a42ccd316 tempest-TestStampPattern-1003780276 None] Volume 2bcea5f0-1f8e-40e9-9503-8f371d3d39fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe', 'volume_size': 1}
Nov 04 12:26:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-6db697e6-522e-4c12-ac61-070a42ccd316 tempest-TestStampPattern-1003780276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:26:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-6db697e6-522e-4c12-ac61-070a42ccd316 tempest-TestStampPattern-1003780276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:26:40 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-6db697e6-522e-4c12-ac61-070a42ccd316 tempest-TestStampPattern-1003780276 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-629281033',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bcea5f0-1f8e-40e9-9503-8f371d3d39fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0603eff0eb2e4e32beeae0c4d1ef78a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:26:40Z,use_quota=True,user_id='9319afe44e1f4cde86d004ba95f1b0f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:26:40 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-6db697e6-522e-4c12-ac61-070a42ccd316 tempest-TestStampPattern-1003780276 None] Creating volume 2bcea5f0-1f8e-40e9-9503-8f371d3d39fe {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:26:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-6db697e6-522e-4c12-ac61-070a42ccd316 tempest-TestStampPattern-1003780276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:26:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-6db697e6-522e-4c12-ac61-070a42ccd316 tempest-TestStampPattern-1003780276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:26:40 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-6db697e6-522e-4c12-ac61-070a42ccd316 tempest-TestStampPattern-1003780276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:26:40 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-6db697e6-522e-4c12-ac61-070a42ccd316 tempest-TestStampPattern-1003780276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:26:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-6db697e6-522e-4c12-ac61-070a42ccd316 tempest-TestStampPattern-1003780276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:26:40 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-6db697e6-522e-4c12-ac61-070a42ccd316 tempest-TestStampPattern-1003780276 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:26:40 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-6db697e6-522e-4c12-ac61-070a42ccd316 tempest-TestStampPattern-1003780276 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:26:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6db697e6-522e-4c12-ac61-070a42ccd316 tempest-TestStampPattern-1003780276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:26:40 devstack sudo[105248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe 1073741824
Nov 04 12:26:40 devstack sudo[105248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:26:40 devstack sudo[105248]: pam_unix(sudo:session): session closed for user root
Nov 04 12:26:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6db697e6-522e-4c12-ac61-070a42ccd316 tempest-TestStampPattern-1003780276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe 1073741824" returned: 0 in 0.455s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:26:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6db697e6-522e-4c12-ac61-070a42ccd316 tempest-TestStampPattern-1003780276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:26:40 devstack sudo[105254]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe
Nov 04 12:26:40 devstack sudo[105254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:26:41 devstack sudo[105254]: pam_unix(sudo:session): session closed for user root
Nov 04 12:26:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6db697e6-522e-4c12-ac61-070a42ccd316 tempest-TestStampPattern-1003780276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe" returned: 0 in 0.298s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:26:41 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-6db697e6-522e-4c12-ac61-070a42ccd316 tempest-TestStampPattern-1003780276 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:26:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-6db697e6-522e-4c12-ac61-070a42ccd316 tempest-TestStampPattern-1003780276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:26:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6db697e6-522e-4c12-ac61-070a42ccd316 tempest-TestStampPattern-1003780276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98e6b649-44ac-44d8-8d0d-c475f90d0ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:26:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6db697e6-522e-4c12-ac61-070a42ccd316 tempest-TestStampPattern-1003780276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bda126d-d013-4c34-a904-95aebaec7c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:26:41 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-6db697e6-522e-4c12-ac61-070a42ccd316 tempest-TestStampPattern-1003780276 None] Volume volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe (2bcea5f0-1f8e-40e9-9503-8f371d3d39fe): created successfully
Nov 04 12:26:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6db697e6-522e-4c12-ac61-070a42ccd316 tempest-TestStampPattern-1003780276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bda126d-d013-4c34-a904-95aebaec7c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:26:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6db697e6-522e-4c12-ac61-070a42ccd316 tempest-TestStampPattern-1003780276 None] Flow 'volume_create_manager' (880f4999-3d36-440f-a03e-240c6d442de9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:26:41 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-6db697e6-522e-4c12-ac61-070a42ccd316 tempest-TestStampPattern-1003780276 None] Created volume successfully.
Nov 04 12:26:49 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:26:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:26:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:26:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:26:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:26:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:26:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:26:49 devstack sudo[105347]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:26:49 devstack sudo[105347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:26:50 devstack sudo[105347]: pam_unix(sudo:session): session closed for user root
Nov 04 12:26:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.318s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:26:50 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:26:50 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager._thread_info {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:26:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread count: 28 {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 12:26:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread info: [<_MainThread(MainThread, started 137165867425920)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137165754678912)>, <Thread(Thread-3 (stat_writer), started daemon 137165754130752)>, <Thread(Rabbit-heartbeat, started daemon 137165752997504)>, <Thread(Thread-5 (_runner), started daemon 137165753227712)>, <Thread(Thread-7 (_runner), started daemon 137165751273856)>, <Thread(fd_logger, started daemon 137165755322048)>, <Thread(privsep_reader, started daemon 137165748896704)>, <Thread(tpool_thread_0, started daemon 137165742520000)>, <Thread(tpool_thread_1, started daemon 137165734127296)>, <Thread(tpool_thread_2, started daemon 137165725734592)>, <Thread(tpool_thread_3, started daemon 137165717341888)>, <Thread(tpool_thread_4, started daemon 137165708949184)>, <Thread(tpool_thread_5, started daemon 137165700556480)>, <Thread(tpool_thread_6, started daemon 137165692163776)>, <Thread(tpool_thread_7, started daemon 137165683771072)>, <Thread(tpool_thread_8, started daemon 137165675378368)>, <Thread(tpool_thread_9, started daemon 137165666985664)>, <Thread(tpool_thread_10, started daemon 137165658592960)>, <Thread(tpool_thread_11, started daemon 137165650183872)>, <Thread(tpool_thread_12, started daemon 137165641774784)>, <Thread(tpool_thread_13, started daemon 137165633365696)>, <Thread(tpool_thread_14, started daemon 137165624956608)>, <Thread(tpool_thread_15, started daemon 137165616547520)>, <Thread(tpool_thread_16, started daemon 137165608138432)>, <Thread(tpool_thread_17, started daemon 137165599729344)>, <Thread(tpool_thread_18, started daemon 137165591320256)>, <Thread(tpool_thread_19, started daemon 137165582911168)>] {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 12:26:51 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:26:51 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:27:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-eadccb27-668b-41e5-a371-a7f4ec4d19b4 req-8ef889e5-a625-4355-a5a0-0a38d3800fe1 tempest-TestStampPattern-1003780276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:27:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-eadccb27-668b-41e5-a371-a7f4ec4d19b4 req-8ef889e5-a625-4355-a5a0-0a38d3800fe1 tempest-TestStampPattern-1003780276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:27:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-eadccb27-668b-41e5-a371-a7f4ec4d19b4 req-8ef889e5-a625-4355-a5a0-0a38d3800fe1 tempest-TestStampPattern-1003780276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:27:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-eadccb27-668b-41e5-a371-a7f4ec4d19b4 req-8ef889e5-a625-4355-a5a0-0a38d3800fe1 tempest-TestStampPattern-1003780276 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79', 'name': 'volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a34628c7-6715-429f-b96b-9f4f7a78c691', 'enforce_multipath': True} {{(pid=87169) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 04 12:27:09 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-eadccb27-668b-41e5-a371-a7f4ec4d19b4 req-8ef889e5-a625-4355-a5a0-0a38d3800fe1 tempest-TestStampPattern-1003780276 None] attachment_update completed successfully.
Nov 04 12:27:13 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-97b4b301-a5a8-4b16-a1dd-6f179702df3d req-a3f0b460-3d09-45df-8cd3-1a2655b3fdb0 tempest-TestStampPattern-1003780276 None] Terminate volume connection completed successfully.
Nov 04 12:27:13 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-97b4b301-a5a8-4b16-a1dd-6f179702df3d req-a3f0b460-3d09-45df-8cd3-1a2655b3fdb0 tempest-TestStampPattern-1003780276 None] Deleting attachment a34628c7-6715-429f-b96b-9f4f7a78c691. {{(pid=87169) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 12:27:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7ac25079-526a-437b-a83f-4dd7f97f56df tempest-TestStampPattern-1003780276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:27:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7ac25079-526a-437b-a83f-4dd7f97f56df tempest-TestStampPattern-1003780276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:27:14 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-7ac25079-526a-437b-a83f-4dd7f97f56df tempest-TestStampPattern-1003780276 None] Creating offline snapshot 013ab556-e47d-4680-afba-cfd336c22af0 of volume 2bcea5f0-1f8e-40e9-9503-8f371d3d39fe {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:27:14 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e49c2fc-621c-4618-b168-4d8c5ca5eeab]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:27:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7ac25079-526a-437b-a83f-4dd7f97f56df tempest-TestStampPattern-1003780276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:27:14 devstack sudo[105857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe
Nov 04 12:27:14 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:27:14 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root
Nov 04 12:27:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7ac25079-526a-437b-a83f-4dd7f97f56df tempest-TestStampPattern-1003780276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe" returned: 0 in 0.343s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:27:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7ac25079-526a-437b-a83f-4dd7f97f56df tempest-TestStampPattern-1003780276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe.013ab556-e47d-4680-afba-cfd336c22af0 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:27:14 devstack sudo[105862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe.013ab556-e47d-4680-afba-cfd336c22af0 1G
Nov 04 12:27:14 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:27:15 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root
Nov 04 12:27:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7ac25079-526a-437b-a83f-4dd7f97f56df tempest-TestStampPattern-1003780276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe.013ab556-e47d-4680-afba-cfd336c22af0 1G" returned: 0 in 0.389s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:27:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7ac25079-526a-437b-a83f-4dd7f97f56df tempest-TestStampPattern-1003780276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe.013ab556-e47d-4680-afba-cfd336c22af0 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:27:15 devstack sudo[105867]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe.013ab556-e47d-4680-afba-cfd336c22af0
Nov 04 12:27:15 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:27:15 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root
Nov 04 12:27:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7ac25079-526a-437b-a83f-4dd7f97f56df tempest-TestStampPattern-1003780276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe.013ab556-e47d-4680-afba-cfd336c22af0" returned: 0 in 0.284s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:27:15 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-7ac25079-526a-437b-a83f-4dd7f97f56df tempest-TestStampPattern-1003780276 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe.013ab556-e47d-4680-afba-cfd336c22af0 is being set with open permissions: ugo+rw
Nov 04 12:27:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7ac25079-526a-437b-a83f-4dd7f97f56df tempest-TestStampPattern-1003780276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe.013ab556-e47d-4680-afba-cfd336c22af0 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:27:15 devstack sudo[105872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe.013ab556-e47d-4680-afba-cfd336c22af0
Nov 04 12:27:15 devstack sudo[105872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:27:15 devstack sudo[105872]: pam_unix(sudo:session): session closed for user root
Nov 04 12:27:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7ac25079-526a-437b-a83f-4dd7f97f56df tempest-TestStampPattern-1003780276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe.013ab556-e47d-4680-afba-cfd336c22af0" returned: 0 in 0.237s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:27:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7ac25079-526a-437b-a83f-4dd7f97f56df tempest-TestStampPattern-1003780276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:27:15 devstack sudo[105875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe.info
Nov 04 12:27:15 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:27:16 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root
Nov 04 12:27:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7ac25079-526a-437b-a83f-4dd7f97f56df tempest-TestStampPattern-1003780276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe.info" returned: 0 in 0.254s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:27:16 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-7ac25079-526a-437b-a83f-4dd7f97f56df tempest-TestStampPattern-1003780276 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe.info is being set with open permissions: ugo+rw
Nov 04 12:27:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7ac25079-526a-437b-a83f-4dd7f97f56df tempest-TestStampPattern-1003780276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:27:16 devstack sudo[105878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe.info
Nov 04 12:27:16 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:27:16 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root
Nov 04 12:27:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7ac25079-526a-437b-a83f-4dd7f97f56df tempest-TestStampPattern-1003780276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe.info" returned: 0 in 0.235s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:27:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7ac25079-526a-437b-a83f-4dd7f97f56df tempest-TestStampPattern-1003780276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.828s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:27:16 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-7ac25079-526a-437b-a83f-4dd7f97f56df tempest-TestStampPattern-1003780276 None] Create snapshot completed successfully
Nov 04 12:27:22 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:27:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Flow 'volume_create_manager' (0cede69a-6443-4160-a0eb-d57d2921cb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:27:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e62a444-14ed-429e-ab57-0104ac18bc31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:27:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e62a444-14ed-429e-ab57-0104ac18bc31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:27:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-596023884',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34c6c570-267a-4aa6-833c-c329433b4155,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0603eff0eb2e4e32beeae0c4d1ef78a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:27:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=013ab556-e47d-4680-afba-cfd336c22af0,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:27:22Z,use_quota=True,user_id='9319afe44e1f4cde86d004ba95f1b0f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:27:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26cfb818-029e-42aa-9de8-5ab9477b1f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:27:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26cfb818-029e-42aa-9de8-5ab9477b1f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:27:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8130bcfd-b468-4f5e-8414-ecb85a353049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:27:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8130bcfd-b468-4f5e-8414-ecb85a353049) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '34c6c570-267a-4aa6-833c-c329433b4155', 'volume_name': 'volume-34c6c570-267a-4aa6-833c-c329433b4155', 'volume_size': 1, 'snapshot_id': '013ab556-e47d-4680-afba-cfd336c22af0'}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:27:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df8b8620-65ba-450c-bd6d-b5ad8e606f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:27:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df8b8620-65ba-450c-bd6d-b5ad8e606f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:27:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9025623-4ebc-457d-9437-d241194c6349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:27:22 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Volume 34c6c570-267a-4aa6-833c-c329433b4155: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-34c6c570-267a-4aa6-833c-c329433b4155', 'volume_size': 1, 'snapshot_id': '013ab556-e47d-4680-afba-cfd336c22af0'}
Nov 04 12:27:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:27:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:27:22 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Acquiring lock "cinder-quobyte-013ab556-e47d-4680-afba-cfd336c22af0-34c6c570-267a-4aa6-833c-c329433b4155" by "_create_volume_from_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:27:22 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Lock "cinder-quobyte-013ab556-e47d-4680-afba-cfd336c22af0-34c6c570-267a-4aa6-833c-c329433b4155" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:27:22 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Creating volume 34c6c570-267a-4aa6-833c-c329433b4155 from snapshot 013ab556-e47d-4680-afba-cfd336c22af0 {{(pid=87169) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 04 12:27:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:27:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:27:22 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:27:22 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:27:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:27:22 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:27:22 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Acquiring lock "cinder-quobyte-34c6c570-267a-4aa6-833c-c329433b4155" by "_copy_volume_from_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:27:22 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Lock "cinder-quobyte-34c6c570-267a-4aa6-833c-c329433b4155" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:27:22 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] snapshot: 013ab556-e47d-4680-afba-cfd336c22af0, volume: 34c6c570-267a-4aa6-833c-c329433b4155,  {{(pid=87169) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 04 12:27:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:27:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:27:22 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:27:22 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:27:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:27:22 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[da26f44f-a7e4-46cf-9868-e15b1ea3411b]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:27:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe.013ab556-e47d-4680-afba-cfd336c22af0 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:27:22 devstack sudo[105910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe.013ab556-e47d-4680-afba-cfd336c22af0
Nov 04 12:27:22 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:27:22 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root
Nov 04 12:27:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe.013ab556-e47d-4680-afba-cfd336c22af0" returned: 0 in 0.381s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:27:22 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:27:22 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[75aaf373-f0cc-4f54-9535-a8b6ed48f00f]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:27:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:27:22 devstack sudo[105915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe
Nov 04 12:27:22 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:27:23 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root
Nov 04 12:27:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe" returned: 0 in 0.369s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:27:23 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe {{(pid=87169) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 04 12:27:23 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Creating direct copy from snapshot {{(pid=87169) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 04 12:27:23 devstack cinder-volume[87169]: DEBUG cinder.utils [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Path /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-34c6c570-267a-4aa6-833c-c329433b4155 not found in is_blk_device check {{(pid=87169) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 04 12:27:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-34c6c570-267a-4aa6-833c-c329433b4155 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:27:23 devstack sudo[105923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-34c6c570-267a-4aa6-833c-c329433b4155
Nov 04 12:27:23 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:27:32 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root
Nov 04 12:27:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-34c6c570-267a-4aa6-833c-c329433b4155" returned: 0 in 8.987s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:27:32 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Image conversion details: src /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe, size 1024.00 MB, duration 8.99 sec, destination /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-34c6c570-267a-4aa6-833c-c329433b4155 {{(pid=87169) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 12:27:32 devstack cinder-volume[87169]: INFO cinder.image.image_utils [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Converted 1024.00 MB image at 113.92 MB/s
Nov 04 12:27:32 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-34c6c570-267a-4aa6-833c-c329433b4155 is being set with open permissions: ugo+rw
Nov 04 12:27:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-34c6c570-267a-4aa6-833c-c329433b4155 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:27:32 devstack sudo[106006]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-34c6c570-267a-4aa6-833c-c329433b4155
Nov 04 12:27:32 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:27:32 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=9,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:27:32 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=17,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:27:32 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root
Nov 04 12:27:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-34c6c570-267a-4aa6-833c-c329433b4155" returned: 0 in 0.307s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:27:32 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Lock "cinder-quobyte-34c6c570-267a-4aa6-833c-c329433b4155" released by "_copy_volume_from_snapshot" :: held 10.135s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:27:32 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Lock "cinder-quobyte-013ab556-e47d-4680-afba-cfd336c22af0-34c6c570-267a-4aa6-833c-c329433b4155" released by "_create_volume_from_snapshot" :: held 10.219s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:27:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.238s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:27:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9025623-4ebc-457d-9437-d241194c6349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34c6c570-267a-4aa6-833c-c329433b4155', 'volume_size': 1, 'snapshot_id': '013ab556-e47d-4680-afba-cfd336c22af0'}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:27:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efca4c3a-1355-481e-bf85-94fe3a49847b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:27:32 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Volume volume-34c6c570-267a-4aa6-833c-c329433b4155 (34c6c570-267a-4aa6-833c-c329433b4155): created successfully
Nov 04 12:27:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efca4c3a-1355-481e-bf85-94fe3a49847b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:27:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Flow 'volume_create_manager' (0cede69a-6443-4160-a0eb-d57d2921cb62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:27:32 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-b3912031-807d-4154-ac5d-9c8d500792f0 tempest-TestStampPattern-1003780276 None] Created volume successfully.
Nov 04 12:27:42 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=1,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:27:42 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:27:49 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:27:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:27:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:27:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:27:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:27:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:27:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:27:49 devstack sudo[106065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:27:49 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:27:50 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root
Nov 04 12:27:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.233s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:27:50 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:27:50 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager._thread_info {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:27:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread count: 28 {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 12:27:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread info: [<_MainThread(MainThread, started 137165867425920)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137165754678912)>, <Thread(Thread-3 (stat_writer), started daemon 137165754130752)>, <Thread(Rabbit-heartbeat, started daemon 137165752997504)>, <Thread(Thread-5 (_runner), started daemon 137165753227712)>, <Thread(Thread-7 (_runner), started daemon 137165751273856)>, <Thread(fd_logger, started daemon 137165755322048)>, <Thread(privsep_reader, started daemon 137165748896704)>, <Thread(tpool_thread_0, started daemon 137165742520000)>, <Thread(tpool_thread_1, started daemon 137165734127296)>, <Thread(tpool_thread_2, started daemon 137165725734592)>, <Thread(tpool_thread_3, started daemon 137165717341888)>, <Thread(tpool_thread_4, started daemon 137165708949184)>, <Thread(tpool_thread_5, started daemon 137165700556480)>, <Thread(tpool_thread_6, started daemon 137165692163776)>, <Thread(tpool_thread_7, started daemon 137165683771072)>, <Thread(tpool_thread_8, started daemon 137165675378368)>, <Thread(tpool_thread_9, started daemon 137165666985664)>, <Thread(tpool_thread_10, started daemon 137165658592960)>, <Thread(tpool_thread_11, started daemon 137165650183872)>, <Thread(tpool_thread_12, started daemon 137165641774784)>, <Thread(tpool_thread_13, started daemon 137165633365696)>, <Thread(tpool_thread_14, started daemon 137165624956608)>, <Thread(tpool_thread_15, started daemon 137165616547520)>, <Thread(tpool_thread_16, started daemon 137165608138432)>, <Thread(tpool_thread_17, started daemon 137165599729344)>, <Thread(tpool_thread_18, started daemon 137165591320256)>, <Thread(tpool_thread_19, started daemon 137165582911168)>] {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 12:28:08 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:28:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-a6ab69a1-3d40-4524-a188-061d9e312aa7 req-9b130ecc-0716-442f-8387-6ada4df6d00f tempest-TestStampPattern-1003780276 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:28:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-a6ab69a1-3d40-4524-a188-061d9e312aa7 req-9b130ecc-0716-442f-8387-6ada4df6d00f tempest-TestStampPattern-1003780276 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:28:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [req-a6ab69a1-3d40-4524-a188-061d9e312aa7 req-9b130ecc-0716-442f-8387-6ada4df6d00f tempest-TestStampPattern-1003780276 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:28:12 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-a6ab69a1-3d40-4524-a188-061d9e312aa7 req-9b130ecc-0716-442f-8387-6ada4df6d00f tempest-TestStampPattern-1003780276 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79', 'name': 'volume-34c6c570-267a-4aa6-833c-c329433b4155', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f5c9d6dd-baa9-4786-b5ec-a98924e43d20', 'enforce_multipath': True} {{(pid=87169) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}}
Nov 04 12:28:12 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-a6ab69a1-3d40-4524-a188-061d9e312aa7 req-9b130ecc-0716-442f-8387-6ada4df6d00f tempest-TestStampPattern-1003780276 None] attachment_update completed successfully.
Nov 04 12:28:14 devstack cinder-volume[87169]: INFO cinder.volume.manager [req-b065c111-25a8-415d-a12e-0d146d46bb50 req-e1782c1c-df9f-49fe-af7a-9722618df25b tempest-TestStampPattern-1003780276 None] Terminate volume connection completed successfully.
Nov 04 12:28:14 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [req-b065c111-25a8-415d-a12e-0d146d46bb50 req-e1782c1c-df9f-49fe-af7a-9722618df25b tempest-TestStampPattern-1003780276 None] Deleting attachment f5c9d6dd-baa9-4786-b5ec-a98924e43d20. {{(pid=87169) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}}
Nov 04 12:28:18 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-0742a244-86d1-44fe-a486-fe242bd7e95c tempest-TestStampPattern-1003780276 None] Acquiring lock "cinder-34c6c570-267a-4aa6-833c-c329433b4155-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:28:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-0742a244-86d1-44fe-a486-fe242bd7e95c tempest-TestStampPattern-1003780276 None] Lock "cinder-34c6c570-267a-4aa6-833c-c329433b4155-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:28:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-0742a244-86d1-44fe-a486-fe242bd7e95c tempest-TestStampPattern-1003780276 None] Acquiring lock "cinder-quobyte-34c6c570-267a-4aa6-833c-c329433b4155" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:28:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-0742a244-86d1-44fe-a486-fe242bd7e95c tempest-TestStampPattern-1003780276 None] Lock "cinder-quobyte-34c6c570-267a-4aa6-833c-c329433b4155" acquired by "delete_volume" :: waited 0.013s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:28:19 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c5e5b7-6bc2-4631-aec6-7587ae373f88]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:28:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0742a244-86d1-44fe-a486-fe242bd7e95c tempest-TestStampPattern-1003780276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-34c6c570-267a-4aa6-833c-c329433b4155 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:19 devstack sudo[106591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-34c6c570-267a-4aa6-833c-c329433b4155
Nov 04 12:28:19 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:19 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0742a244-86d1-44fe-a486-fe242bd7e95c tempest-TestStampPattern-1003780276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-34c6c570-267a-4aa6-833c-c329433b4155" returned: 0 in 0.341s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0742a244-86d1-44fe-a486-fe242bd7e95c tempest-TestStampPattern-1003780276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-34c6c570-267a-4aa6-833c-c329433b4155 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:19 devstack sudo[106596]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-34c6c570-267a-4aa6-833c-c329433b4155
Nov 04 12:28:19 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:19 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0742a244-86d1-44fe-a486-fe242bd7e95c tempest-TestStampPattern-1003780276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-34c6c570-267a-4aa6-833c-c329433b4155" returned: 0 in 0.260s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-0742a244-86d1-44fe-a486-fe242bd7e95c tempest-TestStampPattern-1003780276 None] Lock "cinder-quobyte-34c6c570-267a-4aa6-833c-c329433b4155" released by "delete_volume" :: held 0.641s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:28:19 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-0742a244-86d1-44fe-a486-fe242bd7e95c tempest-TestStampPattern-1003780276 None] Created reservations ['5e84559f-aebf-4013-aac2-5309b23ce2f7', 'ac830a68-f529-44b0-85d0-bb97ab1b3028', 'c488923c-825d-4668-9144-05931549d156', 'f1a41e65-85c3-4130-9f75-58f25896b764'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:28:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-0742a244-86d1-44fe-a486-fe242bd7e95c tempest-TestStampPattern-1003780276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:28:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-0742a244-86d1-44fe-a486-fe242bd7e95c tempest-TestStampPattern-1003780276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:28:19 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-0742a244-86d1-44fe-a486-fe242bd7e95c tempest-TestStampPattern-1003780276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:28:19 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-0742a244-86d1-44fe-a486-fe242bd7e95c tempest-TestStampPattern-1003780276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:28:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-0742a244-86d1-44fe-a486-fe242bd7e95c tempest-TestStampPattern-1003780276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:28:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0742a244-86d1-44fe-a486-fe242bd7e95c tempest-TestStampPattern-1003780276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:19 devstack sudo[106599]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:28:19 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:20 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0742a244-86d1-44fe-a486-fe242bd7e95c tempest-TestStampPattern-1003780276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.243s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:20 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-0742a244-86d1-44fe-a486-fe242bd7e95c tempest-TestStampPattern-1003780276 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:28:20 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-0742a244-86d1-44fe-a486-fe242bd7e95c tempest-TestStampPattern-1003780276 None] Deleted volume successfully.
Nov 04 12:28:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-0742a244-86d1-44fe-a486-fe242bd7e95c tempest-TestStampPattern-1003780276 None] Lock "cinder-34c6c570-267a-4aa6-833c-c329433b4155-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:28:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-abf465b8-2947-4d7c-a32f-b937ba44045d tempest-TestStampPattern-1003780276 None] Acquiring lock "cinder-013ab556-e47d-4680-afba-cfd336c22af0-delete_snapshot" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:28:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-abf465b8-2947-4d7c-a32f-b937ba44045d tempest-TestStampPattern-1003780276 None] Lock "cinder-013ab556-e47d-4680-afba-cfd336c22af0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:28:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-abf465b8-2947-4d7c-a32f-b937ba44045d tempest-TestStampPattern-1003780276 None] Acquiring lock "cinder-quobyte-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:28:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-abf465b8-2947-4d7c-a32f-b937ba44045d tempest-TestStampPattern-1003780276 None] Lock "cinder-quobyte-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:28:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-abf465b8-2947-4d7c-a32f-b937ba44045d tempest-TestStampPattern-1003780276 None] Acquiring lock "cinder-quobyte-013ab556-e47d-4680-afba-cfd336c22af0" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:28:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-abf465b8-2947-4d7c-a32f-b937ba44045d tempest-TestStampPattern-1003780276 None] Lock "cinder-quobyte-013ab556-e47d-4680-afba-cfd336c22af0" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:28:20 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-abf465b8-2947-4d7c-a32f-b937ba44045d tempest-TestStampPattern-1003780276 None] Deleting offline snapshot 013ab556-e47d-4680-afba-cfd336c22af0 of volume 2bcea5f0-1f8e-40e9-9503-8f371d3d39fe {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:28:20 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-abf465b8-2947-4d7c-a32f-b937ba44045d tempest-TestStampPattern-1003780276 None] snapshot_file for this snap is: volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe.013ab556-e47d-4680-afba-cfd336c22af0 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:28:20 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92b1fef-bef1-4cf4-aa8d-05ef3a016588]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:28:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-abf465b8-2947-4d7c-a32f-b937ba44045d tempest-TestStampPattern-1003780276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe.013ab556-e47d-4680-afba-cfd336c22af0 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:20 devstack sudo[106602]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe.013ab556-e47d-4680-afba-cfd336c22af0
Nov 04 12:28:20 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:20 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-abf465b8-2947-4d7c-a32f-b937ba44045d tempest-TestStampPattern-1003780276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe.013ab556-e47d-4680-afba-cfd336c22af0" returned: 0 in 0.346s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:20 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-abf465b8-2947-4d7c-a32f-b937ba44045d tempest-TestStampPattern-1003780276 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:28:20 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef9007a-8014-46cd-ba77-fd48c7f36b2b]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:28:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-abf465b8-2947-4d7c-a32f-b937ba44045d tempest-TestStampPattern-1003780276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:20 devstack sudo[106608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe
Nov 04 12:28:20 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:21 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-abf465b8-2947-4d7c-a32f-b937ba44045d tempest-TestStampPattern-1003780276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe" returned: 0 in 0.517s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-abf465b8-2947-4d7c-a32f-b937ba44045d tempest-TestStampPattern-1003780276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe.013ab556-e47d-4680-afba-cfd336c22af0 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:21 devstack sudo[106613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe.013ab556-e47d-4680-afba-cfd336c22af0
Nov 04 12:28:21 devstack sudo[106613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:21 devstack sudo[106613]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-abf465b8-2947-4d7c-a32f-b937ba44045d tempest-TestStampPattern-1003780276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe.013ab556-e47d-4680-afba-cfd336c22af0" returned: 0 in 0.326s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-abf465b8-2947-4d7c-a32f-b937ba44045d tempest-TestStampPattern-1003780276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe.013ab556-e47d-4680-afba-cfd336c22af0 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:21 devstack sudo[106619]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe.013ab556-e47d-4680-afba-cfd336c22af0
Nov 04 12:28:21 devstack sudo[106619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:21 devstack sudo[106619]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-abf465b8-2947-4d7c-a32f-b937ba44045d tempest-TestStampPattern-1003780276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe.013ab556-e47d-4680-afba-cfd336c22af0" returned: 0 in 0.242s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:21 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-abf465b8-2947-4d7c-a32f-b937ba44045d tempest-TestStampPattern-1003780276 None] Lock "cinder-quobyte-013ab556-e47d-4680-afba-cfd336c22af0" released by "_delete_snapshot" :: held 1.529s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:28:21 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-abf465b8-2947-4d7c-a32f-b937ba44045d tempest-TestStampPattern-1003780276 None] Lock "cinder-quobyte-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe" released by "delete_snapshot" :: held 1.554s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:28:22 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-abf465b8-2947-4d7c-a32f-b937ba44045d tempest-TestStampPattern-1003780276 None] Created reservations ['99fcc2cf-4819-4375-af2f-5d6a64d3f6af', '139acfe6-9499-439d-b50b-1a7004f29e17', '76ad9f4a-d8b0-4102-9b8e-ca58ce52372f', 'a389e889-2f3a-4c03-9b06-05659cf6d3a7'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:28:22 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-abf465b8-2947-4d7c-a32f-b937ba44045d tempest-TestStampPattern-1003780276 None] Delete snapshot completed successfully.
Nov 04 12:28:22 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-abf465b8-2947-4d7c-a32f-b937ba44045d tempest-TestStampPattern-1003780276 None] Lock "cinder-013ab556-e47d-4680-afba-cfd336c22af0-delete_snapshot" released by "delete_snapshot" :: held 1.674s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:28:25 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-027825d4-80fd-41ef-b1ff-c9952f323f0c tempest-TestStampPattern-1003780276 None] Acquiring lock "cinder-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:28:25 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-027825d4-80fd-41ef-b1ff-c9952f323f0c tempest-TestStampPattern-1003780276 None] Lock "cinder-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:28:25 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-027825d4-80fd-41ef-b1ff-c9952f323f0c tempest-TestStampPattern-1003780276 None] Acquiring lock "cinder-quobyte-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:28:25 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-027825d4-80fd-41ef-b1ff-c9952f323f0c tempest-TestStampPattern-1003780276 None] Lock "cinder-quobyte-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe" acquired by "delete_volume" :: waited 0.017s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:28:25 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af312c2-29a4-430d-a341-00bae53ee70b]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:28:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-027825d4-80fd-41ef-b1ff-c9952f323f0c tempest-TestStampPattern-1003780276 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:26 devstack sudo[106649]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe
Nov 04 12:28:26 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:26 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-027825d4-80fd-41ef-b1ff-c9952f323f0c tempest-TestStampPattern-1003780276 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe" returned: 0 in 0.373s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-027825d4-80fd-41ef-b1ff-c9952f323f0c tempest-TestStampPattern-1003780276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:26 devstack sudo[106654]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe
Nov 04 12:28:26 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:26 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-027825d4-80fd-41ef-b1ff-c9952f323f0c tempest-TestStampPattern-1003780276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe" returned: 0 in 0.243s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:26 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-027825d4-80fd-41ef-b1ff-c9952f323f0c tempest-TestStampPattern-1003780276 None] Lock "cinder-quobyte-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe" released by "delete_volume" :: held 0.677s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:28:26 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-027825d4-80fd-41ef-b1ff-c9952f323f0c tempest-TestStampPattern-1003780276 None] Created reservations ['98efcd31-28f3-4904-8f62-2ef78a9db2fd', '9ef7993b-1f38-4560-af34-6bee87218b04', '283286bc-fc6e-4d27-b0a0-0bc53ab4eabf', 'dcad4551-9596-4f54-a6a7-cd9b8ad72689'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:28:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-027825d4-80fd-41ef-b1ff-c9952f323f0c tempest-TestStampPattern-1003780276 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:28:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-027825d4-80fd-41ef-b1ff-c9952f323f0c tempest-TestStampPattern-1003780276 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:28:26 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-027825d4-80fd-41ef-b1ff-c9952f323f0c tempest-TestStampPattern-1003780276 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:28:26 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-027825d4-80fd-41ef-b1ff-c9952f323f0c tempest-TestStampPattern-1003780276 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:28:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-027825d4-80fd-41ef-b1ff-c9952f323f0c tempest-TestStampPattern-1003780276 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:28:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-027825d4-80fd-41ef-b1ff-c9952f323f0c tempest-TestStampPattern-1003780276 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:26 devstack sudo[106657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:28:26 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:26 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-027825d4-80fd-41ef-b1ff-c9952f323f0c tempest-TestStampPattern-1003780276 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.240s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:26 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-027825d4-80fd-41ef-b1ff-c9952f323f0c tempest-TestStampPattern-1003780276 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:28:26 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-027825d4-80fd-41ef-b1ff-c9952f323f0c tempest-TestStampPattern-1003780276 None] Deleted volume successfully.
Nov 04 12:28:26 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-027825d4-80fd-41ef-b1ff-c9952f323f0c tempest-TestStampPattern-1003780276 None] Lock "cinder-2bcea5f0-1f8e-40e9-9503-8f371d3d39fe-delete_volume" released by "delete_volume" :: held 1.108s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:28:36 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=27,cinder:UPDATE=22,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:28:36 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=19,cinder:UPDATE=24,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:28:38 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-66798b8b-d763-4b41-8f2d-39e3a0d3465a tempest-CreateVolumesFromSnapshotTest-1904388847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:28:38 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-66798b8b-d763-4b41-8f2d-39e3a0d3465a tempest-CreateVolumesFromSnapshotTest-1904388847 None] Flow 'volume_create_manager' (510c8cc1-f6e2-4366-b497-f77b483879ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:28:38 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-66798b8b-d763-4b41-8f2d-39e3a0d3465a tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89d965ff-7205-4dbc-b5ac-ccdf8f81e516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:28:38 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-66798b8b-d763-4b41-8f2d-39e3a0d3465a tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89d965ff-7205-4dbc-b5ac-ccdf8f81e516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1141907247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4899528d-8f45-4cd1-a411-4acee9e94d97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff26a61417e9478b9c6289ddeafe0959',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:28:39Z,use_quota=True,user_id='a11c0b9b28fa403f9e3f09af1d1dd7a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:28:38 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-66798b8b-d763-4b41-8f2d-39e3a0d3465a tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6eaff41-818d-445f-bc2d-b278a51e1778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:28:38 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-66798b8b-d763-4b41-8f2d-39e3a0d3465a tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6eaff41-818d-445f-bc2d-b278a51e1778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:28:38 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-66798b8b-d763-4b41-8f2d-39e3a0d3465a tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bb2cfae-c218-45c1-90d8-c583d5ee44da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:28:38 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-66798b8b-d763-4b41-8f2d-39e3a0d3465a tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bb2cfae-c218-45c1-90d8-c583d5ee44da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4899528d-8f45-4cd1-a411-4acee9e94d97', 'volume_name': 'volume-4899528d-8f45-4cd1-a411-4acee9e94d97', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:28:38 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-66798b8b-d763-4b41-8f2d-39e3a0d3465a tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f038555-5f89-4af4-bfb2-0e472f902685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:28:38 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-66798b8b-d763-4b41-8f2d-39e3a0d3465a tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f038555-5f89-4af4-bfb2-0e472f902685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:28:38 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-66798b8b-d763-4b41-8f2d-39e3a0d3465a tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f00363ec-ad4b-417b-9e9f-442f47782b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:28:38 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-66798b8b-d763-4b41-8f2d-39e3a0d3465a tempest-CreateVolumesFromSnapshotTest-1904388847 None] Volume 4899528d-8f45-4cd1-a411-4acee9e94d97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4899528d-8f45-4cd1-a411-4acee9e94d97', 'volume_size': 1}
Nov 04 12:28:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-66798b8b-d763-4b41-8f2d-39e3a0d3465a tempest-CreateVolumesFromSnapshotTest-1904388847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:28:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-66798b8b-d763-4b41-8f2d-39e3a0d3465a tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:28:38 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-66798b8b-d763-4b41-8f2d-39e3a0d3465a tempest-CreateVolumesFromSnapshotTest-1904388847 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1141907247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4899528d-8f45-4cd1-a411-4acee9e94d97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff26a61417e9478b9c6289ddeafe0959',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:28:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:28:39Z,use_quota=True,user_id='a11c0b9b28fa403f9e3f09af1d1dd7a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:28:38 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-66798b8b-d763-4b41-8f2d-39e3a0d3465a tempest-CreateVolumesFromSnapshotTest-1904388847 None] Creating volume 4899528d-8f45-4cd1-a411-4acee9e94d97 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:28:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-66798b8b-d763-4b41-8f2d-39e3a0d3465a tempest-CreateVolumesFromSnapshotTest-1904388847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:28:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-66798b8b-d763-4b41-8f2d-39e3a0d3465a tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:28:38 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-66798b8b-d763-4b41-8f2d-39e3a0d3465a tempest-CreateVolumesFromSnapshotTest-1904388847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:28:38 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-66798b8b-d763-4b41-8f2d-39e3a0d3465a tempest-CreateVolumesFromSnapshotTest-1904388847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:28:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-66798b8b-d763-4b41-8f2d-39e3a0d3465a tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:28:38 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-66798b8b-d763-4b41-8f2d-39e3a0d3465a tempest-CreateVolumesFromSnapshotTest-1904388847 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:28:38 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-66798b8b-d763-4b41-8f2d-39e3a0d3465a tempest-CreateVolumesFromSnapshotTest-1904388847 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:28:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-66798b8b-d763-4b41-8f2d-39e3a0d3465a tempest-CreateVolumesFromSnapshotTest-1904388847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:38 devstack sudo[106707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97 1073741824
Nov 04 12:28:38 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:39 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-66798b8b-d763-4b41-8f2d-39e3a0d3465a tempest-CreateVolumesFromSnapshotTest-1904388847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97 1073741824" returned: 0 in 0.408s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-66798b8b-d763-4b41-8f2d-39e3a0d3465a tempest-CreateVolumesFromSnapshotTest-1904388847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:39 devstack sudo[106713]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97
Nov 04 12:28:39 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:39 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-66798b8b-d763-4b41-8f2d-39e3a0d3465a tempest-CreateVolumesFromSnapshotTest-1904388847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97" returned: 0 in 0.238s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:39 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-66798b8b-d763-4b41-8f2d-39e3a0d3465a tempest-CreateVolumesFromSnapshotTest-1904388847 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:28:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-66798b8b-d763-4b41-8f2d-39e3a0d3465a tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:28:39 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-66798b8b-d763-4b41-8f2d-39e3a0d3465a tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f00363ec-ad4b-417b-9e9f-442f47782b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4899528d-8f45-4cd1-a411-4acee9e94d97', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:28:39 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-66798b8b-d763-4b41-8f2d-39e3a0d3465a tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82983ac9-91b8-4b93-85e3-7d20dac49e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:28:39 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-66798b8b-d763-4b41-8f2d-39e3a0d3465a tempest-CreateVolumesFromSnapshotTest-1904388847 None] Volume volume-4899528d-8f45-4cd1-a411-4acee9e94d97 (4899528d-8f45-4cd1-a411-4acee9e94d97): created successfully
Nov 04 12:28:39 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-66798b8b-d763-4b41-8f2d-39e3a0d3465a tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82983ac9-91b8-4b93-85e3-7d20dac49e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:28:39 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-66798b8b-d763-4b41-8f2d-39e3a0d3465a tempest-CreateVolumesFromSnapshotTest-1904388847 None] Flow 'volume_create_manager' (510c8cc1-f6e2-4366-b497-f77b483879ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:28:39 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-66798b8b-d763-4b41-8f2d-39e3a0d3465a tempest-CreateVolumesFromSnapshotTest-1904388847 None] Created volume successfully.
Nov 04 12:28:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-98b5527f-4e6d-444f-927b-f8d68e06f51b tempest-CreateVolumesFromSnapshotTest-1904388847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:28:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-98b5527f-4e6d-444f-927b-f8d68e06f51b tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:28:39 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-98b5527f-4e6d-444f-927b-f8d68e06f51b tempest-CreateVolumesFromSnapshotTest-1904388847 None] Creating offline snapshot 78ebdcd9-a508-465f-8407-bcf8e89bfd42 of volume 4899528d-8f45-4cd1-a411-4acee9e94d97 {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:28:39 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a056402-ad2d-42f4-970f-d5ebf7083567]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:28:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-98b5527f-4e6d-444f-927b-f8d68e06f51b tempest-CreateVolumesFromSnapshotTest-1904388847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:40 devstack sudo[106716]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97
Nov 04 12:28:40 devstack sudo[106716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:40 devstack sudo[106716]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-98b5527f-4e6d-444f-927b-f8d68e06f51b tempest-CreateVolumesFromSnapshotTest-1904388847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97" returned: 0 in 0.364s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-98b5527f-4e6d-444f-927b-f8d68e06f51b tempest-CreateVolumesFromSnapshotTest-1904388847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97.78ebdcd9-a508-465f-8407-bcf8e89bfd42 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:40 devstack sudo[106721]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97.78ebdcd9-a508-465f-8407-bcf8e89bfd42 1G
Nov 04 12:28:40 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:40 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-98b5527f-4e6d-444f-927b-f8d68e06f51b tempest-CreateVolumesFromSnapshotTest-1904388847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97.78ebdcd9-a508-465f-8407-bcf8e89bfd42 1G" returned: 0 in 0.373s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-98b5527f-4e6d-444f-927b-f8d68e06f51b tempest-CreateVolumesFromSnapshotTest-1904388847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4899528d-8f45-4cd1-a411-4acee9e94d97 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97.78ebdcd9-a508-465f-8407-bcf8e89bfd42 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:40 devstack sudo[106727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4899528d-8f45-4cd1-a411-4acee9e94d97 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97.78ebdcd9-a508-465f-8407-bcf8e89bfd42
Nov 04 12:28:40 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:40 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-98b5527f-4e6d-444f-927b-f8d68e06f51b tempest-CreateVolumesFromSnapshotTest-1904388847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4899528d-8f45-4cd1-a411-4acee9e94d97 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97.78ebdcd9-a508-465f-8407-bcf8e89bfd42" returned: 0 in 0.303s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:40 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-98b5527f-4e6d-444f-927b-f8d68e06f51b tempest-CreateVolumesFromSnapshotTest-1904388847 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97.78ebdcd9-a508-465f-8407-bcf8e89bfd42 is being set with open permissions: ugo+rw
Nov 04 12:28:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-98b5527f-4e6d-444f-927b-f8d68e06f51b tempest-CreateVolumesFromSnapshotTest-1904388847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97.78ebdcd9-a508-465f-8407-bcf8e89bfd42 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:40 devstack sudo[106732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97.78ebdcd9-a508-465f-8407-bcf8e89bfd42
Nov 04 12:28:40 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:41 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-98b5527f-4e6d-444f-927b-f8d68e06f51b tempest-CreateVolumesFromSnapshotTest-1904388847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97.78ebdcd9-a508-465f-8407-bcf8e89bfd42" returned: 0 in 0.233s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-98b5527f-4e6d-444f-927b-f8d68e06f51b tempest-CreateVolumesFromSnapshotTest-1904388847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:41 devstack sudo[106735]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97.info
Nov 04 12:28:41 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:41 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-98b5527f-4e6d-444f-927b-f8d68e06f51b tempest-CreateVolumesFromSnapshotTest-1904388847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97.info" returned: 0 in 0.252s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:41 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-98b5527f-4e6d-444f-927b-f8d68e06f51b tempest-CreateVolumesFromSnapshotTest-1904388847 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97.info is being set with open permissions: ugo+rw
Nov 04 12:28:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-98b5527f-4e6d-444f-927b-f8d68e06f51b tempest-CreateVolumesFromSnapshotTest-1904388847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:41 devstack sudo[106739]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97.info
Nov 04 12:28:41 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:41 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-98b5527f-4e6d-444f-927b-f8d68e06f51b tempest-CreateVolumesFromSnapshotTest-1904388847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97.info" returned: 0 in 0.245s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-98b5527f-4e6d-444f-927b-f8d68e06f51b tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.855s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:28:41 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-98b5527f-4e6d-444f-927b-f8d68e06f51b tempest-CreateVolumesFromSnapshotTest-1904388847 None] Create snapshot completed successfully
Nov 04 12:28:42 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-95ead3e2-87d0-41b6-9442-19aac801cd3f tempest-CreateVolumesFromSnapshotTest-1904388847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:28:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-95ead3e2-87d0-41b6-9442-19aac801cd3f tempest-CreateVolumesFromSnapshotTest-1904388847 None] Flow 'volume_create_manager' (62b11fbe-cedd-4516-b3d9-7efb0d2531af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:28:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-95ead3e2-87d0-41b6-9442-19aac801cd3f tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bd23ea6-a76c-40a4-b380-39d6047ad789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:28:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-95ead3e2-87d0-41b6-9442-19aac801cd3f tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bd23ea6-a76c-40a4-b380-39d6047ad789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:28:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-204371504',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71ad3796-2e2c-4eaa-8c88-e5e6e7ff8dff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff26a61417e9478b9c6289ddeafe0959',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:28:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:28:42Z,use_quota=True,user_id='a11c0b9b28fa403f9e3f09af1d1dd7a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:28:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-95ead3e2-87d0-41b6-9442-19aac801cd3f tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (074d99d3-1cfa-401b-9583-8eec61c5c733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:28:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-95ead3e2-87d0-41b6-9442-19aac801cd3f tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (074d99d3-1cfa-401b-9583-8eec61c5c733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:28:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-95ead3e2-87d0-41b6-9442-19aac801cd3f tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f854a302-6820-4bff-9728-49476c400f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:28:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-95ead3e2-87d0-41b6-9442-19aac801cd3f tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f854a302-6820-4bff-9728-49476c400f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71ad3796-2e2c-4eaa-8c88-e5e6e7ff8dff', 'volume_name': 'volume-71ad3796-2e2c-4eaa-8c88-e5e6e7ff8dff', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:28:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-95ead3e2-87d0-41b6-9442-19aac801cd3f tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd9963ce-bdd8-4e80-847e-cfbfdee4acfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:28:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-95ead3e2-87d0-41b6-9442-19aac801cd3f tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd9963ce-bdd8-4e80-847e-cfbfdee4acfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:28:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-95ead3e2-87d0-41b6-9442-19aac801cd3f tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b8921ff-cfdd-488b-973b-84b713b42f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:28:42 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-95ead3e2-87d0-41b6-9442-19aac801cd3f tempest-CreateVolumesFromSnapshotTest-1904388847 None] Volume 71ad3796-2e2c-4eaa-8c88-e5e6e7ff8dff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71ad3796-2e2c-4eaa-8c88-e5e6e7ff8dff', 'volume_size': 1}
Nov 04 12:28:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-95ead3e2-87d0-41b6-9442-19aac801cd3f tempest-CreateVolumesFromSnapshotTest-1904388847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:28:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-95ead3e2-87d0-41b6-9442-19aac801cd3f tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:28:42 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-95ead3e2-87d0-41b6-9442-19aac801cd3f tempest-CreateVolumesFromSnapshotTest-1904388847 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:28:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-204371504',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71ad3796-2e2c-4eaa-8c88-e5e6e7ff8dff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff26a61417e9478b9c6289ddeafe0959',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:28:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:28:42Z,use_quota=True,user_id='a11c0b9b28fa403f9e3f09af1d1dd7a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:28:42 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-95ead3e2-87d0-41b6-9442-19aac801cd3f tempest-CreateVolumesFromSnapshotTest-1904388847 None] Creating volume 71ad3796-2e2c-4eaa-8c88-e5e6e7ff8dff {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:28:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-95ead3e2-87d0-41b6-9442-19aac801cd3f tempest-CreateVolumesFromSnapshotTest-1904388847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:28:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-95ead3e2-87d0-41b6-9442-19aac801cd3f tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:28:42 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-95ead3e2-87d0-41b6-9442-19aac801cd3f tempest-CreateVolumesFromSnapshotTest-1904388847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:28:42 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-95ead3e2-87d0-41b6-9442-19aac801cd3f tempest-CreateVolumesFromSnapshotTest-1904388847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:28:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-95ead3e2-87d0-41b6-9442-19aac801cd3f tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:28:42 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-95ead3e2-87d0-41b6-9442-19aac801cd3f tempest-CreateVolumesFromSnapshotTest-1904388847 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:28:42 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-95ead3e2-87d0-41b6-9442-19aac801cd3f tempest-CreateVolumesFromSnapshotTest-1904388847 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:28:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-95ead3e2-87d0-41b6-9442-19aac801cd3f tempest-CreateVolumesFromSnapshotTest-1904388847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-71ad3796-2e2c-4eaa-8c88-e5e6e7ff8dff 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:42 devstack sudo[106742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-71ad3796-2e2c-4eaa-8c88-e5e6e7ff8dff 1073741824
Nov 04 12:28:42 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:42 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-05106d4c-326b-4352-821e-4bce32abec4d tempest-CreateVolumesFromSnapshotTest-1904388847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:28:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-05106d4c-326b-4352-821e-4bce32abec4d tempest-CreateVolumesFromSnapshotTest-1904388847 None] Flow 'volume_create_manager' (4ab4a626-0aad-4607-a59e-5bce2fcd2606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:28:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-05106d4c-326b-4352-821e-4bce32abec4d tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2079a041-2fc3-4842-9bfa-101f89a0aaa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:28:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-05106d4c-326b-4352-821e-4bce32abec4d tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2079a041-2fc3-4842-9bfa-101f89a0aaa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:28:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2037607529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64d04984-ef17-4e26-8581-17a9ebe18329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff26a61417e9478b9c6289ddeafe0959',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:28:43Z,use_quota=True,user_id='a11c0b9b28fa403f9e3f09af1d1dd7a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:28:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-05106d4c-326b-4352-821e-4bce32abec4d tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b59d98a-bddc-4e7d-98e9-25f3ffa44536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:28:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-05106d4c-326b-4352-821e-4bce32abec4d tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b59d98a-bddc-4e7d-98e9-25f3ffa44536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:28:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-05106d4c-326b-4352-821e-4bce32abec4d tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c5e3bfb-8751-4302-9717-85a90b713b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:28:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-05106d4c-326b-4352-821e-4bce32abec4d tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c5e3bfb-8751-4302-9717-85a90b713b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64d04984-ef17-4e26-8581-17a9ebe18329', 'volume_name': 'volume-64d04984-ef17-4e26-8581-17a9ebe18329', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:28:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-05106d4c-326b-4352-821e-4bce32abec4d tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccf2702f-5888-4c35-94f9-d6949e90414a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:28:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-05106d4c-326b-4352-821e-4bce32abec4d tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccf2702f-5888-4c35-94f9-d6949e90414a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:28:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-05106d4c-326b-4352-821e-4bce32abec4d tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b226d092-64b5-476b-ac23-699416b14996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:28:42 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-05106d4c-326b-4352-821e-4bce32abec4d tempest-CreateVolumesFromSnapshotTest-1904388847 None] Volume 64d04984-ef17-4e26-8581-17a9ebe18329: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64d04984-ef17-4e26-8581-17a9ebe18329', 'volume_size': 1}
Nov 04 12:28:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-05106d4c-326b-4352-821e-4bce32abec4d tempest-CreateVolumesFromSnapshotTest-1904388847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:28:42 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-95ead3e2-87d0-41b6-9442-19aac801cd3f tempest-CreateVolumesFromSnapshotTest-1904388847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-71ad3796-2e2c-4eaa-8c88-e5e6e7ff8dff 1073741824" returned: 0 in 0.482s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-95ead3e2-87d0-41b6-9442-19aac801cd3f tempest-CreateVolumesFromSnapshotTest-1904388847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-71ad3796-2e2c-4eaa-8c88-e5e6e7ff8dff {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:43 devstack sudo[106748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-71ad3796-2e2c-4eaa-8c88-e5e6e7ff8dff
Nov 04 12:28:43 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-d00c9783-e34f-48cd-935c-0218994b9c3e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d00c9783-e34f-48cd-935c-0218994b9c3e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Flow 'volume_create_manager' (66ecc5cc-ecdd-489f-8a57-298514e71b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d00c9783-e34f-48cd-935c-0218994b9c3e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (310a20fb-be56-448c-9b66-a29421346cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d00c9783-e34f-48cd-935c-0218994b9c3e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (310a20fb-be56-448c-9b66-a29421346cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-801475473',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=033678ab-58d8-494c-a0a7-e5fb8aed06ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff26a61417e9478b9c6289ddeafe0959',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:28:43Z,use_quota=True,user_id='a11c0b9b28fa403f9e3f09af1d1dd7a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d00c9783-e34f-48cd-935c-0218994b9c3e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9065d857-2440-470b-8db8-4e5ccb7ba59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d00c9783-e34f-48cd-935c-0218994b9c3e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9065d857-2440-470b-8db8-4e5ccb7ba59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d00c9783-e34f-48cd-935c-0218994b9c3e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (830d81a7-c00e-4ebe-b629-ae69e59da934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d00c9783-e34f-48cd-935c-0218994b9c3e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (830d81a7-c00e-4ebe-b629-ae69e59da934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '033678ab-58d8-494c-a0a7-e5fb8aed06ae', 'volume_name': 'volume-033678ab-58d8-494c-a0a7-e5fb8aed06ae', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d00c9783-e34f-48cd-935c-0218994b9c3e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5ffcc76-3427-4031-8c61-36343cfb2042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d00c9783-e34f-48cd-935c-0218994b9c3e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5ffcc76-3427-4031-8c61-36343cfb2042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d00c9783-e34f-48cd-935c-0218994b9c3e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12b4af0d-91d4-4030-9942-d073f1631e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:28:43 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-d00c9783-e34f-48cd-935c-0218994b9c3e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Volume 033678ab-58d8-494c-a0a7-e5fb8aed06ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-033678ab-58d8-494c-a0a7-e5fb8aed06ae', 'volume_size': 1}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d00c9783-e34f-48cd-935c-0218994b9c3e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:28:43 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-95ead3e2-87d0-41b6-9442-19aac801cd3f tempest-CreateVolumesFromSnapshotTest-1904388847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-71ad3796-2e2c-4eaa-8c88-e5e6e7ff8dff" returned: 0 in 0.275s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-95ead3e2-87d0-41b6-9442-19aac801cd3f tempest-CreateVolumesFromSnapshotTest-1904388847 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-95ead3e2-87d0-41b6-9442-19aac801cd3f tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-05106d4c-326b-4352-821e-4bce32abec4d tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.443s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-05106d4c-326b-4352-821e-4bce32abec4d tempest-CreateVolumesFromSnapshotTest-1904388847 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:28:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2037607529',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64d04984-ef17-4e26-8581-17a9ebe18329,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff26a61417e9478b9c6289ddeafe0959',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:28:43Z,use_quota=True,user_id='a11c0b9b28fa403f9e3f09af1d1dd7a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-05106d4c-326b-4352-821e-4bce32abec4d tempest-CreateVolumesFromSnapshotTest-1904388847 None] Creating volume 64d04984-ef17-4e26-8581-17a9ebe18329 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-05106d4c-326b-4352-821e-4bce32abec4d tempest-CreateVolumesFromSnapshotTest-1904388847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-05106d4c-326b-4352-821e-4bce32abec4d tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-05106d4c-326b-4352-821e-4bce32abec4d tempest-CreateVolumesFromSnapshotTest-1904388847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-05106d4c-326b-4352-821e-4bce32abec4d tempest-CreateVolumesFromSnapshotTest-1904388847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-05106d4c-326b-4352-821e-4bce32abec4d tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-05106d4c-326b-4352-821e-4bce32abec4d tempest-CreateVolumesFromSnapshotTest-1904388847 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:28:43 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-05106d4c-326b-4352-821e-4bce32abec4d tempest-CreateVolumesFromSnapshotTest-1904388847 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-05106d4c-326b-4352-821e-4bce32abec4d tempest-CreateVolumesFromSnapshotTest-1904388847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-64d04984-ef17-4e26-8581-17a9ebe18329 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-95ead3e2-87d0-41b6-9442-19aac801cd3f tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b8921ff-cfdd-488b-973b-84b713b42f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71ad3796-2e2c-4eaa-8c88-e5e6e7ff8dff', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:28:43 devstack sudo[106751]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-64d04984-ef17-4e26-8581-17a9ebe18329 1073741824
Nov 04 12:28:43 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-95ead3e2-87d0-41b6-9442-19aac801cd3f tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (124f5512-6e66-4eaf-9df3-a0e2efc82fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:28:43 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-95ead3e2-87d0-41b6-9442-19aac801cd3f tempest-CreateVolumesFromSnapshotTest-1904388847 None] Volume volume-71ad3796-2e2c-4eaa-8c88-e5e6e7ff8dff (71ad3796-2e2c-4eaa-8c88-e5e6e7ff8dff): created successfully
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-95ead3e2-87d0-41b6-9442-19aac801cd3f tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (124f5512-6e66-4eaf-9df3-a0e2efc82fdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-95ead3e2-87d0-41b6-9442-19aac801cd3f tempest-CreateVolumesFromSnapshotTest-1904388847 None] Flow 'volume_create_manager' (62b11fbe-cedd-4516-b3d9-7efb0d2531af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:28:43 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-95ead3e2-87d0-41b6-9442-19aac801cd3f tempest-CreateVolumesFromSnapshotTest-1904388847 None] Created volume successfully.
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-5272d45b-d147-42e2-b8d0-3aae1c8fbd69 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5272d45b-d147-42e2-b8d0-3aae1c8fbd69 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Flow 'volume_create_manager' (8591bb15-40bf-40b3-8e2d-6e618dee645f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5272d45b-d147-42e2-b8d0-3aae1c8fbd69 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (550b7bf3-40c3-4b91-9309-1b171b25857b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5272d45b-d147-42e2-b8d0-3aae1c8fbd69 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (550b7bf3-40c3-4b91-9309-1b171b25857b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1710637656',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4daea30-699d-4902-80c0-80b8a3ab0c42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff26a61417e9478b9c6289ddeafe0959',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:28:43Z,use_quota=True,user_id='a11c0b9b28fa403f9e3f09af1d1dd7a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5272d45b-d147-42e2-b8d0-3aae1c8fbd69 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5993bf50-7e2f-4005-8c81-cb7b2aa53de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5272d45b-d147-42e2-b8d0-3aae1c8fbd69 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5993bf50-7e2f-4005-8c81-cb7b2aa53de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5272d45b-d147-42e2-b8d0-3aae1c8fbd69 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8867d9e-cce4-4b62-8b91-2a5f3f9e05d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5272d45b-d147-42e2-b8d0-3aae1c8fbd69 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8867d9e-cce4-4b62-8b91-2a5f3f9e05d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4daea30-699d-4902-80c0-80b8a3ab0c42', 'volume_name': 'volume-d4daea30-699d-4902-80c0-80b8a3ab0c42', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5272d45b-d147-42e2-b8d0-3aae1c8fbd69 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce2cda67-e8ca-48ba-a8e7-d34db242a5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5272d45b-d147-42e2-b8d0-3aae1c8fbd69 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce2cda67-e8ca-48ba-a8e7-d34db242a5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5272d45b-d147-42e2-b8d0-3aae1c8fbd69 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2473a5c4-9933-43a5-9252-e5f1083e9723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:28:43 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-5272d45b-d147-42e2-b8d0-3aae1c8fbd69 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Volume d4daea30-699d-4902-80c0-80b8a3ab0c42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4daea30-699d-4902-80c0-80b8a3ab0c42', 'volume_size': 1}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5272d45b-d147-42e2-b8d0-3aae1c8fbd69 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f676057-15f9-4dfc-b6fc-36e3ec6b8d1b tempest-CreateVolumesFromSnapshotTest-1904388847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:28:43 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1f676057-15f9-4dfc-b6fc-36e3ec6b8d1b tempest-CreateVolumesFromSnapshotTest-1904388847 None] Flow 'volume_create_manager' (6b2b8717-b69b-4b57-a574-86252a43575a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1f676057-15f9-4dfc-b6fc-36e3ec6b8d1b tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd1e1d6a-09fe-4b81-8d27-d1914a49a721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-05106d4c-326b-4352-821e-4bce32abec4d tempest-CreateVolumesFromSnapshotTest-1904388847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-64d04984-ef17-4e26-8581-17a9ebe18329 1073741824" returned: 0 in 0.568s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1f676057-15f9-4dfc-b6fc-36e3ec6b8d1b tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd1e1d6a-09fe-4b81-8d27-d1914a49a721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-709622556',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a219a651-d3b8-40c4-86fa-cd0b399b2015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff26a61417e9478b9c6289ddeafe0959',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:28:44Z,use_quota=True,user_id='a11c0b9b28fa403f9e3f09af1d1dd7a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1f676057-15f9-4dfc-b6fc-36e3ec6b8d1b tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa6cc0cf-cff1-446b-8129-ae26d0b8577c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1f676057-15f9-4dfc-b6fc-36e3ec6b8d1b tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa6cc0cf-cff1-446b-8129-ae26d0b8577c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1f676057-15f9-4dfc-b6fc-36e3ec6b8d1b tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f66443d-c16a-405d-bc21-c372f60c8304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1f676057-15f9-4dfc-b6fc-36e3ec6b8d1b tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f66443d-c16a-405d-bc21-c372f60c8304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a219a651-d3b8-40c4-86fa-cd0b399b2015', 'volume_name': 'volume-a219a651-d3b8-40c4-86fa-cd0b399b2015', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1f676057-15f9-4dfc-b6fc-36e3ec6b8d1b tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (908d51d9-2e28-4b7e-af52-f6cbb6be4f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1f676057-15f9-4dfc-b6fc-36e3ec6b8d1b tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (908d51d9-2e28-4b7e-af52-f6cbb6be4f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1f676057-15f9-4dfc-b6fc-36e3ec6b8d1b tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e37850a2-f447-4e4d-a4f8-6ae74e686cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:28:43 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-1f676057-15f9-4dfc-b6fc-36e3ec6b8d1b tempest-CreateVolumesFromSnapshotTest-1904388847 None] Volume a219a651-d3b8-40c4-86fa-cd0b399b2015: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a219a651-d3b8-40c4-86fa-cd0b399b2015', 'volume_size': 1}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1f676057-15f9-4dfc-b6fc-36e3ec6b8d1b tempest-CreateVolumesFromSnapshotTest-1904388847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:28:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-05106d4c-326b-4352-821e-4bce32abec4d tempest-CreateVolumesFromSnapshotTest-1904388847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-64d04984-ef17-4e26-8581-17a9ebe18329 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:44 devstack sudo[106758]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-64d04984-ef17-4e26-8581-17a9ebe18329
Nov 04 12:28:44 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:44 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-05106d4c-326b-4352-821e-4bce32abec4d tempest-CreateVolumesFromSnapshotTest-1904388847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-64d04984-ef17-4e26-8581-17a9ebe18329" returned: 0 in 0.241s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:44 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-05106d4c-326b-4352-821e-4bce32abec4d tempest-CreateVolumesFromSnapshotTest-1904388847 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:28:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-05106d4c-326b-4352-821e-4bce32abec4d tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:28:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d00c9783-e34f-48cd-935c-0218994b9c3e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.983s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:28:44 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d00c9783-e34f-48cd-935c-0218994b9c3e tempest-CreateVolumesFromSnapshotTest-1904388847 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-801475473',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=033678ab-58d8-494c-a0a7-e5fb8aed06ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff26a61417e9478b9c6289ddeafe0959',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:28:43Z,use_quota=True,user_id='a11c0b9b28fa403f9e3f09af1d1dd7a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:28:44 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-d00c9783-e34f-48cd-935c-0218994b9c3e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Creating volume 033678ab-58d8-494c-a0a7-e5fb8aed06ae {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:28:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d00c9783-e34f-48cd-935c-0218994b9c3e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:28:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d00c9783-e34f-48cd-935c-0218994b9c3e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:28:44 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d00c9783-e34f-48cd-935c-0218994b9c3e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:28:44 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d00c9783-e34f-48cd-935c-0218994b9c3e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:28:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d00c9783-e34f-48cd-935c-0218994b9c3e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:28:44 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d00c9783-e34f-48cd-935c-0218994b9c3e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:28:44 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-d00c9783-e34f-48cd-935c-0218994b9c3e tempest-CreateVolumesFromSnapshotTest-1904388847 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:28:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d00c9783-e34f-48cd-935c-0218994b9c3e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-033678ab-58d8-494c-a0a7-e5fb8aed06ae 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-05106d4c-326b-4352-821e-4bce32abec4d tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b226d092-64b5-476b-ac23-699416b14996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64d04984-ef17-4e26-8581-17a9ebe18329', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:28:44 devstack sudo[106761]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-033678ab-58d8-494c-a0a7-e5fb8aed06ae 1073741824
Nov 04 12:28:44 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-05106d4c-326b-4352-821e-4bce32abec4d tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56691ee3-fc63-4738-8d6f-f3ce52d4441d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:28:44 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-05106d4c-326b-4352-821e-4bce32abec4d tempest-CreateVolumesFromSnapshotTest-1904388847 None] Volume volume-64d04984-ef17-4e26-8581-17a9ebe18329 (64d04984-ef17-4e26-8581-17a9ebe18329): created successfully
Nov 04 12:28:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-05106d4c-326b-4352-821e-4bce32abec4d tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56691ee3-fc63-4738-8d6f-f3ce52d4441d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:28:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-05106d4c-326b-4352-821e-4bce32abec4d tempest-CreateVolumesFromSnapshotTest-1904388847 None] Flow 'volume_create_manager' (4ab4a626-0aad-4607-a59e-5bce2fcd2606) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:28:44 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-05106d4c-326b-4352-821e-4bce32abec4d tempest-CreateVolumesFromSnapshotTest-1904388847 None] Created volume successfully.
Nov 04 12:28:44 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d00c9783-e34f-48cd-935c-0218994b9c3e tempest-CreateVolumesFromSnapshotTest-1904388847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-033678ab-58d8-494c-a0a7-e5fb8aed06ae 1073741824" returned: 0 in 0.412s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d00c9783-e34f-48cd-935c-0218994b9c3e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-033678ab-58d8-494c-a0a7-e5fb8aed06ae {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:44 devstack sudo[106767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-033678ab-58d8-494c-a0a7-e5fb8aed06ae
Nov 04 12:28:44 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:44 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d00c9783-e34f-48cd-935c-0218994b9c3e tempest-CreateVolumesFromSnapshotTest-1904388847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-033678ab-58d8-494c-a0a7-e5fb8aed06ae" returned: 0 in 0.250s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:44 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d00c9783-e34f-48cd-935c-0218994b9c3e tempest-CreateVolumesFromSnapshotTest-1904388847 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:28:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d00c9783-e34f-48cd-935c-0218994b9c3e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:28:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5272d45b-d147-42e2-b8d0-3aae1c8fbd69 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.327s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:28:44 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5272d45b-d147-42e2-b8d0-3aae1c8fbd69 tempest-CreateVolumesFromSnapshotTest-1904388847 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1710637656',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4daea30-699d-4902-80c0-80b8a3ab0c42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff26a61417e9478b9c6289ddeafe0959',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:28:43Z,use_quota=True,user_id='a11c0b9b28fa403f9e3f09af1d1dd7a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:28:44 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-5272d45b-d147-42e2-b8d0-3aae1c8fbd69 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Creating volume d4daea30-699d-4902-80c0-80b8a3ab0c42 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:28:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5272d45b-d147-42e2-b8d0-3aae1c8fbd69 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:28:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5272d45b-d147-42e2-b8d0-3aae1c8fbd69 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:28:44 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5272d45b-d147-42e2-b8d0-3aae1c8fbd69 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:28:44 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5272d45b-d147-42e2-b8d0-3aae1c8fbd69 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:28:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5272d45b-d147-42e2-b8d0-3aae1c8fbd69 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:28:44 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5272d45b-d147-42e2-b8d0-3aae1c8fbd69 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:28:44 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-5272d45b-d147-42e2-b8d0-3aae1c8fbd69 tempest-CreateVolumesFromSnapshotTest-1904388847 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:28:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5272d45b-d147-42e2-b8d0-3aae1c8fbd69 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d4daea30-699d-4902-80c0-80b8a3ab0c42 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d00c9783-e34f-48cd-935c-0218994b9c3e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12b4af0d-91d4-4030-9942-d073f1631e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-033678ab-58d8-494c-a0a7-e5fb8aed06ae', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:28:44 devstack sudo[106770]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d4daea30-699d-4902-80c0-80b8a3ab0c42 1073741824
Nov 04 12:28:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d00c9783-e34f-48cd-935c-0218994b9c3e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e173bb7b-673c-417a-a64a-7b27f22e0393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:28:44 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:44 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-d00c9783-e34f-48cd-935c-0218994b9c3e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Volume volume-033678ab-58d8-494c-a0a7-e5fb8aed06ae (033678ab-58d8-494c-a0a7-e5fb8aed06ae): created successfully
Nov 04 12:28:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d00c9783-e34f-48cd-935c-0218994b9c3e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e173bb7b-673c-417a-a64a-7b27f22e0393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:28:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d00c9783-e34f-48cd-935c-0218994b9c3e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Flow 'volume_create_manager' (66ecc5cc-ecdd-489f-8a57-298514e71b56) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:28:44 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-d00c9783-e34f-48cd-935c-0218994b9c3e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Created volume successfully.
Nov 04 12:28:45 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5272d45b-d147-42e2-b8d0-3aae1c8fbd69 tempest-CreateVolumesFromSnapshotTest-1904388847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d4daea30-699d-4902-80c0-80b8a3ab0c42 1073741824" returned: 0 in 0.417s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5272d45b-d147-42e2-b8d0-3aae1c8fbd69 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d4daea30-699d-4902-80c0-80b8a3ab0c42 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:45 devstack sudo[106775]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d4daea30-699d-4902-80c0-80b8a3ab0c42
Nov 04 12:28:45 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:45 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5272d45b-d147-42e2-b8d0-3aae1c8fbd69 tempest-CreateVolumesFromSnapshotTest-1904388847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d4daea30-699d-4902-80c0-80b8a3ab0c42" returned: 0 in 0.240s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:45 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5272d45b-d147-42e2-b8d0-3aae1c8fbd69 tempest-CreateVolumesFromSnapshotTest-1904388847 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:28:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5272d45b-d147-42e2-b8d0-3aae1c8fbd69 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:28:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1f676057-15f9-4dfc-b6fc-36e3ec6b8d1b tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.672s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:28:45 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1f676057-15f9-4dfc-b6fc-36e3ec6b8d1b tempest-CreateVolumesFromSnapshotTest-1904388847 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-709622556',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a219a651-d3b8-40c4-86fa-cd0b399b2015,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff26a61417e9478b9c6289ddeafe0959',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:28:44Z,use_quota=True,user_id='a11c0b9b28fa403f9e3f09af1d1dd7a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:28:45 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-1f676057-15f9-4dfc-b6fc-36e3ec6b8d1b tempest-CreateVolumesFromSnapshotTest-1904388847 None] Creating volume a219a651-d3b8-40c4-86fa-cd0b399b2015 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:28:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1f676057-15f9-4dfc-b6fc-36e3ec6b8d1b tempest-CreateVolumesFromSnapshotTest-1904388847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:28:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1f676057-15f9-4dfc-b6fc-36e3ec6b8d1b tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:28:45 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1f676057-15f9-4dfc-b6fc-36e3ec6b8d1b tempest-CreateVolumesFromSnapshotTest-1904388847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:28:45 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1f676057-15f9-4dfc-b6fc-36e3ec6b8d1b tempest-CreateVolumesFromSnapshotTest-1904388847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:28:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1f676057-15f9-4dfc-b6fc-36e3ec6b8d1b tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:28:45 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1f676057-15f9-4dfc-b6fc-36e3ec6b8d1b tempest-CreateVolumesFromSnapshotTest-1904388847 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:28:45 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-1f676057-15f9-4dfc-b6fc-36e3ec6b8d1b tempest-CreateVolumesFromSnapshotTest-1904388847 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:28:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1f676057-15f9-4dfc-b6fc-36e3ec6b8d1b tempest-CreateVolumesFromSnapshotTest-1904388847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a219a651-d3b8-40c4-86fa-cd0b399b2015 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:45 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5272d45b-d147-42e2-b8d0-3aae1c8fbd69 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2473a5c4-9933-43a5-9252-e5f1083e9723) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4daea30-699d-4902-80c0-80b8a3ab0c42', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:28:45 devstack sudo[106778]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a219a651-d3b8-40c4-86fa-cd0b399b2015 1073741824
Nov 04 12:28:45 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:45 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5272d45b-d147-42e2-b8d0-3aae1c8fbd69 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aff25387-53df-4b93-adae-7d47d8b489ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:28:45 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-5272d45b-d147-42e2-b8d0-3aae1c8fbd69 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Volume volume-d4daea30-699d-4902-80c0-80b8a3ab0c42 (d4daea30-699d-4902-80c0-80b8a3ab0c42): created successfully
Nov 04 12:28:45 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5272d45b-d147-42e2-b8d0-3aae1c8fbd69 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aff25387-53df-4b93-adae-7d47d8b489ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:28:45 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5272d45b-d147-42e2-b8d0-3aae1c8fbd69 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Flow 'volume_create_manager' (8591bb15-40bf-40b3-8e2d-6e618dee645f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:28:45 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-5272d45b-d147-42e2-b8d0-3aae1c8fbd69 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Created volume successfully.
Nov 04 12:28:46 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1f676057-15f9-4dfc-b6fc-36e3ec6b8d1b tempest-CreateVolumesFromSnapshotTest-1904388847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a219a651-d3b8-40c4-86fa-cd0b399b2015 1073741824" returned: 0 in 0.425s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1f676057-15f9-4dfc-b6fc-36e3ec6b8d1b tempest-CreateVolumesFromSnapshotTest-1904388847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a219a651-d3b8-40c4-86fa-cd0b399b2015 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:46 devstack sudo[106784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a219a651-d3b8-40c4-86fa-cd0b399b2015
Nov 04 12:28:46 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:46 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1f676057-15f9-4dfc-b6fc-36e3ec6b8d1b tempest-CreateVolumesFromSnapshotTest-1904388847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a219a651-d3b8-40c4-86fa-cd0b399b2015" returned: 0 in 0.241s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:46 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1f676057-15f9-4dfc-b6fc-36e3ec6b8d1b tempest-CreateVolumesFromSnapshotTest-1904388847 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:28:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1f676057-15f9-4dfc-b6fc-36e3ec6b8d1b tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:28:46 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1f676057-15f9-4dfc-b6fc-36e3ec6b8d1b tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e37850a2-f447-4e4d-a4f8-6ae74e686cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a219a651-d3b8-40c4-86fa-cd0b399b2015', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:28:46 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1f676057-15f9-4dfc-b6fc-36e3ec6b8d1b tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97ad8dc8-054e-4d17-a16d-5f798b201fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:28:46 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-1f676057-15f9-4dfc-b6fc-36e3ec6b8d1b tempest-CreateVolumesFromSnapshotTest-1904388847 None] Volume volume-a219a651-d3b8-40c4-86fa-cd0b399b2015 (a219a651-d3b8-40c4-86fa-cd0b399b2015): created successfully
Nov 04 12:28:46 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1f676057-15f9-4dfc-b6fc-36e3ec6b8d1b tempest-CreateVolumesFromSnapshotTest-1904388847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97ad8dc8-054e-4d17-a16d-5f798b201fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:28:46 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1f676057-15f9-4dfc-b6fc-36e3ec6b8d1b tempest-CreateVolumesFromSnapshotTest-1904388847 None] Flow 'volume_create_manager' (6b2b8717-b69b-4b57-a574-86252a43575a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:28:46 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-1f676057-15f9-4dfc-b6fc-36e3ec6b8d1b tempest-CreateVolumesFromSnapshotTest-1904388847 None] Created volume successfully.
Nov 04 12:28:47 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-420d7fdd-11d0-421c-a224-f4306080ec00 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Acquiring lock "cinder-a219a651-d3b8-40c4-86fa-cd0b399b2015-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:28:47 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-420d7fdd-11d0-421c-a224-f4306080ec00 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "cinder-a219a651-d3b8-40c4-86fa-cd0b399b2015-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:28:47 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-420d7fdd-11d0-421c-a224-f4306080ec00 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Acquiring lock "cinder-quobyte-a219a651-d3b8-40c4-86fa-cd0b399b2015" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:28:47 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-420d7fdd-11d0-421c-a224-f4306080ec00 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "cinder-quobyte-a219a651-d3b8-40c4-86fa-cd0b399b2015" acquired by "delete_volume" :: waited 0.016s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:28:47 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[14461b15-3671-433d-908c-80c95acca80b]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:28:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-420d7fdd-11d0-421c-a224-f4306080ec00 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a219a651-d3b8-40c4-86fa-cd0b399b2015 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:47 devstack sudo[106787]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a219a651-d3b8-40c4-86fa-cd0b399b2015
Nov 04 12:28:47 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:47 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-420d7fdd-11d0-421c-a224-f4306080ec00 tempest-CreateVolumesFromSnapshotTest-1904388847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a219a651-d3b8-40c4-86fa-cd0b399b2015" returned: 0 in 0.368s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-420d7fdd-11d0-421c-a224-f4306080ec00 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a219a651-d3b8-40c4-86fa-cd0b399b2015 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:47 devstack sudo[106792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a219a651-d3b8-40c4-86fa-cd0b399b2015
Nov 04 12:28:47 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:47 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-420d7fdd-11d0-421c-a224-f4306080ec00 tempest-CreateVolumesFromSnapshotTest-1904388847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a219a651-d3b8-40c4-86fa-cd0b399b2015" returned: 0 in 0.248s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:47 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-420d7fdd-11d0-421c-a224-f4306080ec00 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "cinder-quobyte-a219a651-d3b8-40c4-86fa-cd0b399b2015" released by "delete_volume" :: held 0.656s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:28:48 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-420d7fdd-11d0-421c-a224-f4306080ec00 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Created reservations ['4a0004b4-61aa-4502-b641-72170e801858', 'b3c11997-4eb2-453e-9b64-9010b91bcf43', '3552e0a3-8094-4ab2-9938-cd5e7b80610f', '008f29b3-70d8-4765-8d11-b15a825f6cc6'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:28:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-420d7fdd-11d0-421c-a224-f4306080ec00 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:28:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-420d7fdd-11d0-421c-a224-f4306080ec00 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:28:48 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-420d7fdd-11d0-421c-a224-f4306080ec00 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:28:48 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-420d7fdd-11d0-421c-a224-f4306080ec00 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:28:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-420d7fdd-11d0-421c-a224-f4306080ec00 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:28:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-420d7fdd-11d0-421c-a224-f4306080ec00 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:48 devstack sudo[106795]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:28:48 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:48 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-420d7fdd-11d0-421c-a224-f4306080ec00 tempest-CreateVolumesFromSnapshotTest-1904388847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.258s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:48 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-420d7fdd-11d0-421c-a224-f4306080ec00 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:28:48 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-420d7fdd-11d0-421c-a224-f4306080ec00 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Deleted volume successfully.
Nov 04 12:28:48 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-420d7fdd-11d0-421c-a224-f4306080ec00 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "cinder-a219a651-d3b8-40c4-86fa-cd0b399b2015-delete_volume" released by "delete_volume" :: held 1.122s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:28:48 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9d1a0753-104c-4a68-ae1c-5ab854ffc000 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Acquiring lock "cinder-d4daea30-699d-4902-80c0-80b8a3ab0c42-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:28:48 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9d1a0753-104c-4a68-ae1c-5ab854ffc000 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "cinder-d4daea30-699d-4902-80c0-80b8a3ab0c42-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:28:48 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9d1a0753-104c-4a68-ae1c-5ab854ffc000 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Acquiring lock "cinder-quobyte-d4daea30-699d-4902-80c0-80b8a3ab0c42" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:28:48 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9d1a0753-104c-4a68-ae1c-5ab854ffc000 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "cinder-quobyte-d4daea30-699d-4902-80c0-80b8a3ab0c42" acquired by "delete_volume" :: waited 0.016s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:28:48 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[d998345f-527c-431f-ac61-3dca8d358fe7]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:28:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9d1a0753-104c-4a68-ae1c-5ab854ffc000 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d4daea30-699d-4902-80c0-80b8a3ab0c42 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:48 devstack sudo[106798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d4daea30-699d-4902-80c0-80b8a3ab0c42
Nov 04 12:28:48 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:48 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9d1a0753-104c-4a68-ae1c-5ab854ffc000 tempest-CreateVolumesFromSnapshotTest-1904388847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d4daea30-699d-4902-80c0-80b8a3ab0c42" returned: 0 in 0.345s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9d1a0753-104c-4a68-ae1c-5ab854ffc000 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d4daea30-699d-4902-80c0-80b8a3ab0c42 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:48 devstack sudo[106803]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d4daea30-699d-4902-80c0-80b8a3ab0c42
Nov 04 12:28:48 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:49 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9d1a0753-104c-4a68-ae1c-5ab854ffc000 tempest-CreateVolumesFromSnapshotTest-1904388847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d4daea30-699d-4902-80c0-80b8a3ab0c42" returned: 0 in 0.242s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:49 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9d1a0753-104c-4a68-ae1c-5ab854ffc000 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "cinder-quobyte-d4daea30-699d-4902-80c0-80b8a3ab0c42" released by "delete_volume" :: held 0.629s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:28:49 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-9d1a0753-104c-4a68-ae1c-5ab854ffc000 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Created reservations ['6ec77036-4b4d-4b53-a3e5-a7c6bfc941b3', '4b769e98-f9a2-4b07-9d28-9e10d443da78', 'ae8510ee-7bc1-4ac2-ac98-0dd94d80f87d', 'e78ff18a-ebad-40a4-91c3-30c32fb1770b'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:28:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-9d1a0753-104c-4a68-ae1c-5ab854ffc000 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:28:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-9d1a0753-104c-4a68-ae1c-5ab854ffc000 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:28:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-9d1a0753-104c-4a68-ae1c-5ab854ffc000 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:28:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-9d1a0753-104c-4a68-ae1c-5ab854ffc000 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:28:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-9d1a0753-104c-4a68-ae1c-5ab854ffc000 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:28:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9d1a0753-104c-4a68-ae1c-5ab854ffc000 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:49 devstack sudo[106806]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:28:49 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:49 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9d1a0753-104c-4a68-ae1c-5ab854ffc000 tempest-CreateVolumesFromSnapshotTest-1904388847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.254s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:49 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-9d1a0753-104c-4a68-ae1c-5ab854ffc000 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:28:49 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-9d1a0753-104c-4a68-ae1c-5ab854ffc000 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Deleted volume successfully.
Nov 04 12:28:49 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9d1a0753-104c-4a68-ae1c-5ab854ffc000 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "cinder-d4daea30-699d-4902-80c0-80b8a3ab0c42-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:28:49 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-71b05b6c-51b9-4978-b2d9-59ab70bf906e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Acquiring lock "cinder-033678ab-58d8-494c-a0a7-e5fb8aed06ae-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:28:49 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-71b05b6c-51b9-4978-b2d9-59ab70bf906e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "cinder-033678ab-58d8-494c-a0a7-e5fb8aed06ae-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:28:49 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-71b05b6c-51b9-4978-b2d9-59ab70bf906e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Acquiring lock "cinder-quobyte-033678ab-58d8-494c-a0a7-e5fb8aed06ae" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:28:49 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-71b05b6c-51b9-4978-b2d9-59ab70bf906e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "cinder-quobyte-033678ab-58d8-494c-a0a7-e5fb8aed06ae" acquired by "delete_volume" :: waited 0.014s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:28:49 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aeee099-12d1-4768-a6b3-24bc599598bb]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:28:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-71b05b6c-51b9-4978-b2d9-59ab70bf906e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-033678ab-58d8-494c-a0a7-e5fb8aed06ae {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:49 devstack sudo[106809]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-033678ab-58d8-494c-a0a7-e5fb8aed06ae
Nov 04 12:28:49 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:49 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:28:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:28:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:28:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:28:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:28:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:28:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:49 devstack sudo[106811]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:28:49 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:49 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-71b05b6c-51b9-4978-b2d9-59ab70bf906e tempest-CreateVolumesFromSnapshotTest-1904388847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-033678ab-58d8-494c-a0a7-e5fb8aed06ae" returned: 0 in 0.344s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-71b05b6c-51b9-4978-b2d9-59ab70bf906e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-033678ab-58d8-494c-a0a7-e5fb8aed06ae {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:50 devstack sudo[106816]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-033678ab-58d8-494c-a0a7-e5fb8aed06ae
Nov 04 12:28:50 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:50 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.255s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:50 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:28:50 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager._thread_info {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:28:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread count: 28 {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 12:28:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread info: [<_MainThread(MainThread, started 137165867425920)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137165754678912)>, <Thread(Thread-3 (stat_writer), started daemon 137165754130752)>, <Thread(Rabbit-heartbeat, started daemon 137165752997504)>, <Thread(Thread-5 (_runner), started daemon 137165753227712)>, <Thread(Thread-7 (_runner), started daemon 137165751273856)>, <Thread(fd_logger, started daemon 137165755322048)>, <Thread(privsep_reader, started daemon 137165748896704)>, <Thread(tpool_thread_0, started daemon 137165742520000)>, <Thread(tpool_thread_1, started daemon 137165734127296)>, <Thread(tpool_thread_2, started daemon 137165725734592)>, <Thread(tpool_thread_3, started daemon 137165717341888)>, <Thread(tpool_thread_4, started daemon 137165708949184)>, <Thread(tpool_thread_5, started daemon 137165700556480)>, <Thread(tpool_thread_6, started daemon 137165692163776)>, <Thread(tpool_thread_7, started daemon 137165683771072)>, <Thread(tpool_thread_8, started daemon 137165675378368)>, <Thread(tpool_thread_9, started daemon 137165666985664)>, <Thread(tpool_thread_10, started daemon 137165658592960)>, <Thread(tpool_thread_11, started daemon 137165650183872)>, <Thread(tpool_thread_12, started daemon 137165641774784)>, <Thread(tpool_thread_13, started daemon 137165633365696)>, <Thread(tpool_thread_14, started daemon 137165624956608)>, <Thread(tpool_thread_15, started daemon 137165616547520)>, <Thread(tpool_thread_16, started daemon 137165608138432)>, <Thread(tpool_thread_17, started daemon 137165599729344)>, <Thread(tpool_thread_18, started daemon 137165591320256)>, <Thread(tpool_thread_19, started daemon 137165582911168)>] {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 12:28:50 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-71b05b6c-51b9-4978-b2d9-59ab70bf906e tempest-CreateVolumesFromSnapshotTest-1904388847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-033678ab-58d8-494c-a0a7-e5fb8aed06ae" returned: 0 in 0.242s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:50 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-71b05b6c-51b9-4978-b2d9-59ab70bf906e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "cinder-quobyte-033678ab-58d8-494c-a0a7-e5fb8aed06ae" released by "delete_volume" :: held 0.624s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:28:50 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-71b05b6c-51b9-4978-b2d9-59ab70bf906e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Created reservations ['bf2ad1c5-b2cc-4a3d-98f9-f1f8189434bb', '4229a775-c8f8-4778-8c3e-346b3a6ad11f', '84a393a5-3cff-4fa2-96cd-8e2bf5b56b22', 'b17a0b81-f9db-42c3-8b54-ac962423850b'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:28:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-71b05b6c-51b9-4978-b2d9-59ab70bf906e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:28:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-71b05b6c-51b9-4978-b2d9-59ab70bf906e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:28:50 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-71b05b6c-51b9-4978-b2d9-59ab70bf906e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:28:50 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-71b05b6c-51b9-4978-b2d9-59ab70bf906e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:28:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-71b05b6c-51b9-4978-b2d9-59ab70bf906e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:28:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-71b05b6c-51b9-4978-b2d9-59ab70bf906e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:50 devstack sudo[106820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:28:50 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:50 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-71b05b6c-51b9-4978-b2d9-59ab70bf906e tempest-CreateVolumesFromSnapshotTest-1904388847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.228s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:50 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-71b05b6c-51b9-4978-b2d9-59ab70bf906e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:28:50 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-71b05b6c-51b9-4978-b2d9-59ab70bf906e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Deleted volume successfully.
Nov 04 12:28:50 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-71b05b6c-51b9-4978-b2d9-59ab70bf906e tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "cinder-033678ab-58d8-494c-a0a7-e5fb8aed06ae-delete_volume" released by "delete_volume" :: held 1.025s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:28:50 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f306cd96-8bbe-4588-bed8-2aa74d1ad269 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Acquiring lock "cinder-64d04984-ef17-4e26-8581-17a9ebe18329-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:28:50 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f306cd96-8bbe-4588-bed8-2aa74d1ad269 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "cinder-64d04984-ef17-4e26-8581-17a9ebe18329-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:28:50 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f306cd96-8bbe-4588-bed8-2aa74d1ad269 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Acquiring lock "cinder-quobyte-64d04984-ef17-4e26-8581-17a9ebe18329" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:28:50 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f306cd96-8bbe-4588-bed8-2aa74d1ad269 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "cinder-quobyte-64d04984-ef17-4e26-8581-17a9ebe18329" acquired by "delete_volume" :: waited 0.014s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:28:50 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0159d9b-e923-4beb-8f18-60cb28bf1a1d]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:28:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f306cd96-8bbe-4588-bed8-2aa74d1ad269 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-64d04984-ef17-4e26-8581-17a9ebe18329 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:50 devstack sudo[106823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-64d04984-ef17-4e26-8581-17a9ebe18329
Nov 04 12:28:50 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:51 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f306cd96-8bbe-4588-bed8-2aa74d1ad269 tempest-CreateVolumesFromSnapshotTest-1904388847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-64d04984-ef17-4e26-8581-17a9ebe18329" returned: 0 in 0.346s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f306cd96-8bbe-4588-bed8-2aa74d1ad269 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-64d04984-ef17-4e26-8581-17a9ebe18329 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:51 devstack sudo[106828]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-64d04984-ef17-4e26-8581-17a9ebe18329
Nov 04 12:28:51 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:51 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f306cd96-8bbe-4588-bed8-2aa74d1ad269 tempest-CreateVolumesFromSnapshotTest-1904388847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-64d04984-ef17-4e26-8581-17a9ebe18329" returned: 0 in 0.239s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:51 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f306cd96-8bbe-4588-bed8-2aa74d1ad269 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "cinder-quobyte-64d04984-ef17-4e26-8581-17a9ebe18329" released by "delete_volume" :: held 0.622s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:28:51 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-f306cd96-8bbe-4588-bed8-2aa74d1ad269 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Created reservations ['54dccc67-c5dd-46cd-a6c2-78825cb7d97e', 'f8f9bfac-e5f7-457a-80c5-d1dde9919a65', '53eb1b91-ad3b-4c95-9369-b4ee28021b3d', '5d97506a-c5f3-4dd2-a79d-a0b2b4c85817'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:28:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f306cd96-8bbe-4588-bed8-2aa74d1ad269 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:28:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f306cd96-8bbe-4588-bed8-2aa74d1ad269 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:28:51 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f306cd96-8bbe-4588-bed8-2aa74d1ad269 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:28:51 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f306cd96-8bbe-4588-bed8-2aa74d1ad269 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:28:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f306cd96-8bbe-4588-bed8-2aa74d1ad269 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:28:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f306cd96-8bbe-4588-bed8-2aa74d1ad269 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:51 devstack sudo[106832]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:28:51 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:51 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f306cd96-8bbe-4588-bed8-2aa74d1ad269 tempest-CreateVolumesFromSnapshotTest-1904388847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.231s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:51 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-f306cd96-8bbe-4588-bed8-2aa74d1ad269 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:28:51 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-f306cd96-8bbe-4588-bed8-2aa74d1ad269 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Deleted volume successfully.
Nov 04 12:28:51 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f306cd96-8bbe-4588-bed8-2aa74d1ad269 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "cinder-64d04984-ef17-4e26-8581-17a9ebe18329-delete_volume" released by "delete_volume" :: held 1.027s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:28:51 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5f580399-f968-46b0-8e86-f6034a2f5332 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Acquiring lock "cinder-71ad3796-2e2c-4eaa-8c88-e5e6e7ff8dff-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:28:51 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5f580399-f968-46b0-8e86-f6034a2f5332 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "cinder-71ad3796-2e2c-4eaa-8c88-e5e6e7ff8dff-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:28:51 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5f580399-f968-46b0-8e86-f6034a2f5332 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Acquiring lock "cinder-quobyte-71ad3796-2e2c-4eaa-8c88-e5e6e7ff8dff" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:28:51 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5f580399-f968-46b0-8e86-f6034a2f5332 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "cinder-quobyte-71ad3796-2e2c-4eaa-8c88-e5e6e7ff8dff" acquired by "delete_volume" :: waited 0.018s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:28:51 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[11119247-c6b0-4e7d-af15-9f0010146960]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:28:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5f580399-f968-46b0-8e86-f6034a2f5332 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-71ad3796-2e2c-4eaa-8c88-e5e6e7ff8dff {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:52 devstack sudo[106835]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-71ad3796-2e2c-4eaa-8c88-e5e6e7ff8dff
Nov 04 12:28:52 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:52 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5f580399-f968-46b0-8e86-f6034a2f5332 tempest-CreateVolumesFromSnapshotTest-1904388847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-71ad3796-2e2c-4eaa-8c88-e5e6e7ff8dff" returned: 0 in 0.339s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5f580399-f968-46b0-8e86-f6034a2f5332 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-71ad3796-2e2c-4eaa-8c88-e5e6e7ff8dff {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:52 devstack sudo[106840]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-71ad3796-2e2c-4eaa-8c88-e5e6e7ff8dff
Nov 04 12:28:52 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:52 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5f580399-f968-46b0-8e86-f6034a2f5332 tempest-CreateVolumesFromSnapshotTest-1904388847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-71ad3796-2e2c-4eaa-8c88-e5e6e7ff8dff" returned: 0 in 0.244s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:52 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5f580399-f968-46b0-8e86-f6034a2f5332 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "cinder-quobyte-71ad3796-2e2c-4eaa-8c88-e5e6e7ff8dff" released by "delete_volume" :: held 0.622s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:28:52 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-5f580399-f968-46b0-8e86-f6034a2f5332 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Created reservations ['ce5d22f2-5f72-4083-a71f-6b22d7c86fa1', 'e5390981-c672-4522-9350-477cda1b16de', 'f0c7c0fc-4833-42df-990e-f5232db6eaff', 'a34df5ed-7bec-40d3-a5f8-16fe6520ebb6'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:28:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5f580399-f968-46b0-8e86-f6034a2f5332 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:28:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5f580399-f968-46b0-8e86-f6034a2f5332 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:28:52 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5f580399-f968-46b0-8e86-f6034a2f5332 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:28:52 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5f580399-f968-46b0-8e86-f6034a2f5332 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:28:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5f580399-f968-46b0-8e86-f6034a2f5332 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:28:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5f580399-f968-46b0-8e86-f6034a2f5332 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:52 devstack sudo[106843]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:28:52 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:52 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5f580399-f968-46b0-8e86-f6034a2f5332 tempest-CreateVolumesFromSnapshotTest-1904388847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.237s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:52 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-5f580399-f968-46b0-8e86-f6034a2f5332 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:28:52 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-5f580399-f968-46b0-8e86-f6034a2f5332 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Deleted volume successfully.
Nov 04 12:28:52 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5f580399-f968-46b0-8e86-f6034a2f5332 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "cinder-71ad3796-2e2c-4eaa-8c88-e5e6e7ff8dff-delete_volume" released by "delete_volume" :: held 1.047s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:28:53 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-8209f1c8-8138-4712-b75e-f3a315942898 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Acquiring lock "cinder-78ebdcd9-a508-465f-8407-bcf8e89bfd42-delete_snapshot" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:28:53 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-8209f1c8-8138-4712-b75e-f3a315942898 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "cinder-78ebdcd9-a508-465f-8407-bcf8e89bfd42-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:28:53 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-8209f1c8-8138-4712-b75e-f3a315942898 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Acquiring lock "cinder-quobyte-4899528d-8f45-4cd1-a411-4acee9e94d97" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:28:53 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-8209f1c8-8138-4712-b75e-f3a315942898 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "cinder-quobyte-4899528d-8f45-4cd1-a411-4acee9e94d97" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:28:53 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-8209f1c8-8138-4712-b75e-f3a315942898 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Acquiring lock "cinder-quobyte-78ebdcd9-a508-465f-8407-bcf8e89bfd42" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:28:53 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-8209f1c8-8138-4712-b75e-f3a315942898 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "cinder-quobyte-78ebdcd9-a508-465f-8407-bcf8e89bfd42" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:28:53 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-8209f1c8-8138-4712-b75e-f3a315942898 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Deleting offline snapshot 78ebdcd9-a508-465f-8407-bcf8e89bfd42 of volume 4899528d-8f45-4cd1-a411-4acee9e94d97 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:28:53 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-8209f1c8-8138-4712-b75e-f3a315942898 tempest-CreateVolumesFromSnapshotTest-1904388847 None] snapshot_file for this snap is: volume-4899528d-8f45-4cd1-a411-4acee9e94d97.78ebdcd9-a508-465f-8407-bcf8e89bfd42 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:28:53 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[77124849-6ba3-4cd3-9ad9-6231a390df8a]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:28:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8209f1c8-8138-4712-b75e-f3a315942898 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97.78ebdcd9-a508-465f-8407-bcf8e89bfd42 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:53 devstack sudo[106847]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97.78ebdcd9-a508-465f-8407-bcf8e89bfd42
Nov 04 12:28:53 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:53 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8209f1c8-8138-4712-b75e-f3a315942898 tempest-CreateVolumesFromSnapshotTest-1904388847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97.78ebdcd9-a508-465f-8407-bcf8e89bfd42" returned: 0 in 0.344s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:53 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-8209f1c8-8138-4712-b75e-f3a315942898 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4899528d-8f45-4cd1-a411-4acee9e94d97(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:28:53 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d2cdd35-4269-49a2-b129-e9168fa47e6a]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:28:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8209f1c8-8138-4712-b75e-f3a315942898 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:53 devstack sudo[106852]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97
Nov 04 12:28:53 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:53 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8209f1c8-8138-4712-b75e-f3a315942898 tempest-CreateVolumesFromSnapshotTest-1904388847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97" returned: 0 in 0.343s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8209f1c8-8138-4712-b75e-f3a315942898 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97.78ebdcd9-a508-465f-8407-bcf8e89bfd42 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:53 devstack sudo[106857]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97.78ebdcd9-a508-465f-8407-bcf8e89bfd42
Nov 04 12:28:53 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:54 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8209f1c8-8138-4712-b75e-f3a315942898 tempest-CreateVolumesFromSnapshotTest-1904388847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97.78ebdcd9-a508-465f-8407-bcf8e89bfd42" returned: 0 in 0.319s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8209f1c8-8138-4712-b75e-f3a315942898 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97.78ebdcd9-a508-465f-8407-bcf8e89bfd42 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:54 devstack sudo[106862]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97.78ebdcd9-a508-465f-8407-bcf8e89bfd42
Nov 04 12:28:54 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:54 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8209f1c8-8138-4712-b75e-f3a315942898 tempest-CreateVolumesFromSnapshotTest-1904388847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97.78ebdcd9-a508-465f-8407-bcf8e89bfd42" returned: 0 in 0.237s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:54 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-8209f1c8-8138-4712-b75e-f3a315942898 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "cinder-quobyte-78ebdcd9-a508-465f-8407-bcf8e89bfd42" released by "_delete_snapshot" :: held 1.342s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:28:54 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-8209f1c8-8138-4712-b75e-f3a315942898 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "cinder-quobyte-4899528d-8f45-4cd1-a411-4acee9e94d97" released by "delete_snapshot" :: held 1.363s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:28:54 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-8209f1c8-8138-4712-b75e-f3a315942898 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Created reservations ['36861ea1-d64d-4727-9439-1970bf4097dc', 'c109d455-1b01-4b58-a708-ad56f898cd13', '8b769fac-aa35-4145-9fd7-31caf692814a', '5a7b453f-d569-4dc0-813a-fd0faf25cf5c'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:28:54 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-8209f1c8-8138-4712-b75e-f3a315942898 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Delete snapshot completed successfully.
Nov 04 12:28:54 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-8209f1c8-8138-4712-b75e-f3a315942898 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "cinder-78ebdcd9-a508-465f-8407-bcf8e89bfd42-delete_snapshot" released by "delete_snapshot" :: held 1.480s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:28:55 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3f03699c-c5fa-4216-b0fb-617a604f74a6 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Acquiring lock "cinder-4899528d-8f45-4cd1-a411-4acee9e94d97-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:28:55 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3f03699c-c5fa-4216-b0fb-617a604f74a6 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "cinder-4899528d-8f45-4cd1-a411-4acee9e94d97-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:28:55 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3f03699c-c5fa-4216-b0fb-617a604f74a6 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Acquiring lock "cinder-quobyte-4899528d-8f45-4cd1-a411-4acee9e94d97" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:28:55 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3f03699c-c5fa-4216-b0fb-617a604f74a6 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "cinder-quobyte-4899528d-8f45-4cd1-a411-4acee9e94d97" acquired by "delete_volume" :: waited 0.013s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:28:55 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[080b0396-e953-4d8e-b2e9-c0c10245a04f]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:28:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3f03699c-c5fa-4216-b0fb-617a604f74a6 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:55 devstack sudo[106865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97
Nov 04 12:28:55 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:55 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3f03699c-c5fa-4216-b0fb-617a604f74a6 tempest-CreateVolumesFromSnapshotTest-1904388847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97" returned: 0 in 0.343s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3f03699c-c5fa-4216-b0fb-617a604f74a6 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:55 devstack sudo[106870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97
Nov 04 12:28:55 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:55 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3f03699c-c5fa-4216-b0fb-617a604f74a6 tempest-CreateVolumesFromSnapshotTest-1904388847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4899528d-8f45-4cd1-a411-4acee9e94d97" returned: 0 in 0.238s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:55 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3f03699c-c5fa-4216-b0fb-617a604f74a6 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "cinder-quobyte-4899528d-8f45-4cd1-a411-4acee9e94d97" released by "delete_volume" :: held 0.636s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:28:55 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-3f03699c-c5fa-4216-b0fb-617a604f74a6 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Created reservations ['77e79740-7723-4792-9357-260874c56950', 'de2d85f0-76e0-44ef-878f-d463897fc3ba', '2de6c2b4-8c8b-46fe-914e-055b8b759cb5', '300fcd1d-3503-4ee8-b1a7-797af5fb20aa'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:28:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3f03699c-c5fa-4216-b0fb-617a604f74a6 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:28:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3f03699c-c5fa-4216-b0fb-617a604f74a6 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:28:55 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3f03699c-c5fa-4216-b0fb-617a604f74a6 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:28:55 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3f03699c-c5fa-4216-b0fb-617a604f74a6 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:28:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3f03699c-c5fa-4216-b0fb-617a604f74a6 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:28:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3f03699c-c5fa-4216-b0fb-617a604f74a6 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:55 devstack sudo[106875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:28:55 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:56 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3f03699c-c5fa-4216-b0fb-617a604f74a6 tempest-CreateVolumesFromSnapshotTest-1904388847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.227s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:56 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-3f03699c-c5fa-4216-b0fb-617a604f74a6 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:28:56 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-3f03699c-c5fa-4216-b0fb-617a604f74a6 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Deleted volume successfully.
Nov 04 12:28:56 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3f03699c-c5fa-4216-b0fb-617a604f74a6 tempest-CreateVolumesFromSnapshotTest-1904388847 None] Lock "cinder-4899528d-8f45-4cd1-a411-4acee9e94d97-delete_volume" released by "delete_volume" :: held 1.040s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:28:58 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6a0e565-6a14-4df9-9e4c-13fd5a994fac tempest-VolumeDependencyTests-1018108725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:28:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d6a0e565-6a14-4df9-9e4c-13fd5a994fac tempest-VolumeDependencyTests-1018108725 None] Flow 'volume_create_manager' (5552d292-267f-4d0c-8467-166256535e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:28:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d6a0e565-6a14-4df9-9e4c-13fd5a994fac tempest-VolumeDependencyTests-1018108725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efac63d0-69d0-4e16-8f53-b749c4d97f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:28:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d6a0e565-6a14-4df9-9e4c-13fd5a994fac tempest-VolumeDependencyTests-1018108725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efac63d0-69d0-4e16-8f53-b749c4d97f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1119569859',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3adb1cb3-d076-479d-9d45-d3edda93ea6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b1817266eb04eec936929f4e8efac58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:28:59Z,use_quota=True,user_id='36acea3d4430438da781233a7f5e1089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:28:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d6a0e565-6a14-4df9-9e4c-13fd5a994fac tempest-VolumeDependencyTests-1018108725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67b5ea4e-efa1-4a2f-8a78-e6e9082cc41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:28:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d6a0e565-6a14-4df9-9e4c-13fd5a994fac tempest-VolumeDependencyTests-1018108725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67b5ea4e-efa1-4a2f-8a78-e6e9082cc41a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:28:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d6a0e565-6a14-4df9-9e4c-13fd5a994fac tempest-VolumeDependencyTests-1018108725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc649a5-2b7c-4794-a48e-2ae21822330b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:28:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d6a0e565-6a14-4df9-9e4c-13fd5a994fac tempest-VolumeDependencyTests-1018108725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc649a5-2b7c-4794-a48e-2ae21822330b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3adb1cb3-d076-479d-9d45-d3edda93ea6c', 'volume_name': 'volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:28:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d6a0e565-6a14-4df9-9e4c-13fd5a994fac tempest-VolumeDependencyTests-1018108725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3d3cf84-4677-4115-bd8e-fda3b9f9d8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:28:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d6a0e565-6a14-4df9-9e4c-13fd5a994fac tempest-VolumeDependencyTests-1018108725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3d3cf84-4677-4115-bd8e-fda3b9f9d8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:28:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d6a0e565-6a14-4df9-9e4c-13fd5a994fac tempest-VolumeDependencyTests-1018108725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a111709f-1c44-4ea5-9357-4099be230ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:28:58 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-d6a0e565-6a14-4df9-9e4c-13fd5a994fac tempest-VolumeDependencyTests-1018108725 None] Volume 3adb1cb3-d076-479d-9d45-d3edda93ea6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c', 'volume_size': 1}
Nov 04 12:28:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d6a0e565-6a14-4df9-9e4c-13fd5a994fac tempest-VolumeDependencyTests-1018108725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:28:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d6a0e565-6a14-4df9-9e4c-13fd5a994fac tempest-VolumeDependencyTests-1018108725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:28:58 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d6a0e565-6a14-4df9-9e4c-13fd5a994fac tempest-VolumeDependencyTests-1018108725 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:28:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1119569859',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3adb1cb3-d076-479d-9d45-d3edda93ea6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b1817266eb04eec936929f4e8efac58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:28:59Z,use_quota=True,user_id='36acea3d4430438da781233a7f5e1089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:28:58 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-d6a0e565-6a14-4df9-9e4c-13fd5a994fac tempest-VolumeDependencyTests-1018108725 None] Creating volume 3adb1cb3-d076-479d-9d45-d3edda93ea6c {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:28:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d6a0e565-6a14-4df9-9e4c-13fd5a994fac tempest-VolumeDependencyTests-1018108725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:28:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d6a0e565-6a14-4df9-9e4c-13fd5a994fac tempest-VolumeDependencyTests-1018108725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:28:58 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d6a0e565-6a14-4df9-9e4c-13fd5a994fac tempest-VolumeDependencyTests-1018108725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:28:58 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d6a0e565-6a14-4df9-9e4c-13fd5a994fac tempest-VolumeDependencyTests-1018108725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:28:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d6a0e565-6a14-4df9-9e4c-13fd5a994fac tempest-VolumeDependencyTests-1018108725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:28:58 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d6a0e565-6a14-4df9-9e4c-13fd5a994fac tempest-VolumeDependencyTests-1018108725 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:28:58 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-d6a0e565-6a14-4df9-9e4c-13fd5a994fac tempest-VolumeDependencyTests-1018108725 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:28:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d6a0e565-6a14-4df9-9e4c-13fd5a994fac tempest-VolumeDependencyTests-1018108725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:58 devstack sudo[106878]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c 1073741824
Nov 04 12:28:58 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:59 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d6a0e565-6a14-4df9-9e4c-13fd5a994fac tempest-VolumeDependencyTests-1018108725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c 1073741824" returned: 0 in 0.395s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d6a0e565-6a14-4df9-9e4c-13fd5a994fac tempest-VolumeDependencyTests-1018108725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:28:59 devstack sudo[106883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c
Nov 04 12:28:59 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:28:59 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root
Nov 04 12:28:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d6a0e565-6a14-4df9-9e4c-13fd5a994fac tempest-VolumeDependencyTests-1018108725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c" returned: 0 in 0.231s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:28:59 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d6a0e565-6a14-4df9-9e4c-13fd5a994fac tempest-VolumeDependencyTests-1018108725 None] <== create_volume: return (666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:28:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d6a0e565-6a14-4df9-9e4c-13fd5a994fac tempest-VolumeDependencyTests-1018108725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.668s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:28:59 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d6a0e565-6a14-4df9-9e4c-13fd5a994fac tempest-VolumeDependencyTests-1018108725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a111709f-1c44-4ea5-9357-4099be230ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:28:59 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d6a0e565-6a14-4df9-9e4c-13fd5a994fac tempest-VolumeDependencyTests-1018108725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5474d77-d192-4ad8-99c6-fe54092d2414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:28:59 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-d6a0e565-6a14-4df9-9e4c-13fd5a994fac tempest-VolumeDependencyTests-1018108725 None] Volume volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c (3adb1cb3-d076-479d-9d45-d3edda93ea6c): created successfully
Nov 04 12:28:59 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d6a0e565-6a14-4df9-9e4c-13fd5a994fac tempest-VolumeDependencyTests-1018108725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5474d77-d192-4ad8-99c6-fe54092d2414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:28:59 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d6a0e565-6a14-4df9-9e4c-13fd5a994fac tempest-VolumeDependencyTests-1018108725 None] Flow 'volume_create_manager' (5552d292-267f-4d0c-8467-166256535e05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:28:59 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-d6a0e565-6a14-4df9-9e4c-13fd5a994fac tempest-VolumeDependencyTests-1018108725 None] Created volume successfully.
Nov 04 12:29:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2072498b-633a-4e94-a7ee-4fd9fd187360 tempest-VolumeDependencyTests-1018108725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2072498b-633a-4e94-a7ee-4fd9fd187360 tempest-VolumeDependencyTests-1018108725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:00 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-2072498b-633a-4e94-a7ee-4fd9fd187360 tempest-VolumeDependencyTests-1018108725 None] Creating offline snapshot d31fca2a-c2a6-4e62-a40d-f2bf9209eb0e of volume 3adb1cb3-d076-479d-9d45-d3edda93ea6c {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:29:00 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4ebd94e-3ed5-4951-bd19-7126776f8b41]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:29:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2072498b-633a-4e94-a7ee-4fd9fd187360 tempest-VolumeDependencyTests-1018108725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:00 devstack sudo[106886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c
Nov 04 12:29:00 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:00 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2072498b-633a-4e94-a7ee-4fd9fd187360 tempest-VolumeDependencyTests-1018108725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c" returned: 0 in 0.346s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2072498b-633a-4e94-a7ee-4fd9fd187360 tempest-VolumeDependencyTests-1018108725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c.d31fca2a-c2a6-4e62-a40d-f2bf9209eb0e 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:00 devstack sudo[106891]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c.d31fca2a-c2a6-4e62-a40d-f2bf9209eb0e 1G
Nov 04 12:29:00 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:00 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2072498b-633a-4e94-a7ee-4fd9fd187360 tempest-VolumeDependencyTests-1018108725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c.d31fca2a-c2a6-4e62-a40d-f2bf9209eb0e 1G" returned: 0 in 0.367s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2072498b-633a-4e94-a7ee-4fd9fd187360 tempest-VolumeDependencyTests-1018108725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c.d31fca2a-c2a6-4e62-a40d-f2bf9209eb0e {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:00 devstack sudo[106896]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c.d31fca2a-c2a6-4e62-a40d-f2bf9209eb0e
Nov 04 12:29:00 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:01 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2072498b-633a-4e94-a7ee-4fd9fd187360 tempest-VolumeDependencyTests-1018108725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c.d31fca2a-c2a6-4e62-a40d-f2bf9209eb0e" returned: 0 in 0.283s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:01 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-2072498b-633a-4e94-a7ee-4fd9fd187360 tempest-VolumeDependencyTests-1018108725 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c.d31fca2a-c2a6-4e62-a40d-f2bf9209eb0e is being set with open permissions: ugo+rw
Nov 04 12:29:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2072498b-633a-4e94-a7ee-4fd9fd187360 tempest-VolumeDependencyTests-1018108725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c.d31fca2a-c2a6-4e62-a40d-f2bf9209eb0e {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:01 devstack sudo[106901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c.d31fca2a-c2a6-4e62-a40d-f2bf9209eb0e
Nov 04 12:29:01 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:01 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2072498b-633a-4e94-a7ee-4fd9fd187360 tempest-VolumeDependencyTests-1018108725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c.d31fca2a-c2a6-4e62-a40d-f2bf9209eb0e" returned: 0 in 0.225s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2072498b-633a-4e94-a7ee-4fd9fd187360 tempest-VolumeDependencyTests-1018108725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:01 devstack sudo[106904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c.info
Nov 04 12:29:01 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:01 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2072498b-633a-4e94-a7ee-4fd9fd187360 tempest-VolumeDependencyTests-1018108725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c.info" returned: 0 in 0.241s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:01 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-2072498b-633a-4e94-a7ee-4fd9fd187360 tempest-VolumeDependencyTests-1018108725 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c.info is being set with open permissions: ugo+rw
Nov 04 12:29:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2072498b-633a-4e94-a7ee-4fd9fd187360 tempest-VolumeDependencyTests-1018108725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:01 devstack sudo[106908]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c.info
Nov 04 12:29:01 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:01 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2072498b-633a-4e94-a7ee-4fd9fd187360 tempest-VolumeDependencyTests-1018108725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c.info" returned: 0 in 0.228s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2072498b-633a-4e94-a7ee-4fd9fd187360 tempest-VolumeDependencyTests-1018108725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.776s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:01 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-2072498b-633a-4e94-a7ee-4fd9fd187360 tempest-VolumeDependencyTests-1018108725 None] Create snapshot completed successfully
Nov 04 12:29:02 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:29:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Flow 'volume_create_manager' (74405a08-3a0f-4218-953d-29b0e5d45beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:29:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b59b8c3-8b0d-456d-94c4-18a90e38ee53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b59b8c3-8b0d-456d-94c4-18a90e38ee53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:29:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-387961794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad4e43b2-f371-4c70-b397-d5509cbe5295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b1817266eb04eec936929f4e8efac58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d31fca2a-c2a6-4e62-a40d-f2bf9209eb0e,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:03Z,use_quota=True,user_id='36acea3d4430438da781233a7f5e1089',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad4bb82f-a68d-4afe-9834-b48e4daf13a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad4bb82f-a68d-4afe-9834-b48e4daf13a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18cf22f4-f7fc-49d1-bb63-5a4c7b2aa788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18cf22f4-f7fc-49d1-bb63-5a4c7b2aa788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ad4e43b2-f371-4c70-b397-d5509cbe5295', 'volume_name': 'volume-ad4e43b2-f371-4c70-b397-d5509cbe5295', 'volume_size': 1, 'snapshot_id': 'd31fca2a-c2a6-4e62-a40d-f2bf9209eb0e'}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (511ccea4-e2f7-4bf5-8c30-b6cf9d7cc338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (511ccea4-e2f7-4bf5-8c30-b6cf9d7cc338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5037771d-8f1e-43d1-b3fe-e3c17377cd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:02 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Volume ad4e43b2-f371-4c70-b397-d5509cbe5295: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ad4e43b2-f371-4c70-b397-d5509cbe5295', 'volume_size': 1, 'snapshot_id': 'd31fca2a-c2a6-4e62-a40d-f2bf9209eb0e'}
Nov 04 12:29:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:02 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Acquiring lock "cinder-quobyte-d31fca2a-c2a6-4e62-a40d-f2bf9209eb0e-ad4e43b2-f371-4c70-b397-d5509cbe5295" by "_create_volume_from_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:29:02 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Lock "cinder-quobyte-d31fca2a-c2a6-4e62-a40d-f2bf9209eb0e-ad4e43b2-f371-4c70-b397-d5509cbe5295" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:29:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Creating volume ad4e43b2-f371-4c70-b397-d5509cbe5295 from snapshot d31fca2a-c2a6-4e62-a40d-f2bf9209eb0e {{(pid=87169) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 04 12:29:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:29:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:29:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:29:02 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Acquiring lock "cinder-quobyte-ad4e43b2-f371-4c70-b397-d5509cbe5295" by "_copy_volume_from_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:29:02 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Lock "cinder-quobyte-ad4e43b2-f371-4c70-b397-d5509cbe5295" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:29:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] snapshot: d31fca2a-c2a6-4e62-a40d-f2bf9209eb0e, volume: ad4e43b2-f371-4c70-b397-d5509cbe5295,  {{(pid=87169) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 04 12:29:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:29:02 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:29:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:02 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[7424e55d-b07e-47ec-8143-1e8ce005f0ee]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:29:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c.d31fca2a-c2a6-4e62-a40d-f2bf9209eb0e {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:02 devstack sudo[106911]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c.d31fca2a-c2a6-4e62-a40d-f2bf9209eb0e
Nov 04 12:29:02 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:03 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c.d31fca2a-c2a6-4e62-a40d-f2bf9209eb0e" returned: 0 in 0.343s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:03 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:29:03 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[5731214f-01b8-4b16-b9b5-9f56a2297b3e]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:29:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:03 devstack sudo[106916]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c
Nov 04 12:29:03 devstack sudo[106916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:03 devstack sudo[106916]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c" returned: 0 in 0.356s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:03 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c {{(pid=87169) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 04 12:29:03 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Creating direct copy from snapshot {{(pid=87169) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 04 12:29:03 devstack cinder-volume[87169]: DEBUG cinder.utils [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Path /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ad4e43b2-f371-4c70-b397-d5509cbe5295 not found in is_blk_device check {{(pid=87169) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 04 12:29:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ad4e43b2-f371-4c70-b397-d5509cbe5295 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:03 devstack sudo[106921]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ad4e43b2-f371-4c70-b397-d5509cbe5295
Nov 04 12:29:03 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:09 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ad4e43b2-f371-4c70-b397-d5509cbe5295" returned: 0 in 5.817s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:09 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Image conversion details: src /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c, size 1024.00 MB, duration 5.82 sec, destination /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ad4e43b2-f371-4c70-b397-d5509cbe5295 {{(pid=87169) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 12:29:09 devstack cinder-volume[87169]: INFO cinder.image.image_utils [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Converted 1024.00 MB image at 175.98 MB/s
Nov 04 12:29:09 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ad4e43b2-f371-4c70-b397-d5509cbe5295 is being set with open permissions: ugo+rw
Nov 04 12:29:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ad4e43b2-f371-4c70-b397-d5509cbe5295 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:09 devstack sudo[106934]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ad4e43b2-f371-4c70-b397-d5509cbe5295
Nov 04 12:29:09 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:09 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ad4e43b2-f371-4c70-b397-d5509cbe5295" returned: 0 in 0.234s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:09 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Lock "cinder-quobyte-ad4e43b2-f371-4c70-b397-d5509cbe5295" released by "_copy_volume_from_snapshot" :: held 6.828s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:29:09 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Lock "cinder-quobyte-d31fca2a-c2a6-4e62-a40d-f2bf9209eb0e-ad4e43b2-f371-4c70-b397-d5509cbe5295" released by "_create_volume_from_snapshot" :: held 6.886s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:29:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.901s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5037771d-8f1e-43d1-b3fe-e3c17377cd4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad4e43b2-f371-4c70-b397-d5509cbe5295', 'volume_size': 1, 'snapshot_id': 'd31fca2a-c2a6-4e62-a40d-f2bf9209eb0e'}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bd285dd-c23b-4ec1-a955-fcddc979ad77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:09 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Volume volume-ad4e43b2-f371-4c70-b397-d5509cbe5295 (ad4e43b2-f371-4c70-b397-d5509cbe5295): created successfully
Nov 04 12:29:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bd285dd-c23b-4ec1-a955-fcddc979ad77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Flow 'volume_create_manager' (74405a08-3a0f-4218-953d-29b0e5d45beb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:29:09 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-289dba2b-f821-4583-94e5-8afdb0ae3366 tempest-VolumeDependencyTests-1018108725 None] Created volume successfully.
Nov 04 12:29:10 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f3922453-acb4-4eda-907b-4d1dcf2e6eda tempest-VolumeDependencyTests-1018108725 None] Acquiring lock "cinder-d31fca2a-c2a6-4e62-a40d-f2bf9209eb0e-delete_snapshot" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:29:10 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f3922453-acb4-4eda-907b-4d1dcf2e6eda tempest-VolumeDependencyTests-1018108725 None] Lock "cinder-d31fca2a-c2a6-4e62-a40d-f2bf9209eb0e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:29:10 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f3922453-acb4-4eda-907b-4d1dcf2e6eda tempest-VolumeDependencyTests-1018108725 None] Acquiring lock "cinder-quobyte-3adb1cb3-d076-479d-9d45-d3edda93ea6c" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:29:10 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f3922453-acb4-4eda-907b-4d1dcf2e6eda tempest-VolumeDependencyTests-1018108725 None] Lock "cinder-quobyte-3adb1cb3-d076-479d-9d45-d3edda93ea6c" acquired by "delete_snapshot" :: waited 0.012s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:29:10 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f3922453-acb4-4eda-907b-4d1dcf2e6eda tempest-VolumeDependencyTests-1018108725 None] Acquiring lock "cinder-quobyte-d31fca2a-c2a6-4e62-a40d-f2bf9209eb0e" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:29:10 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f3922453-acb4-4eda-907b-4d1dcf2e6eda tempest-VolumeDependencyTests-1018108725 None] Lock "cinder-quobyte-d31fca2a-c2a6-4e62-a40d-f2bf9209eb0e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:29:10 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-f3922453-acb4-4eda-907b-4d1dcf2e6eda tempest-VolumeDependencyTests-1018108725 None] Deleting offline snapshot d31fca2a-c2a6-4e62-a40d-f2bf9209eb0e of volume 3adb1cb3-d076-479d-9d45-d3edda93ea6c {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:29:10 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-f3922453-acb4-4eda-907b-4d1dcf2e6eda tempest-VolumeDependencyTests-1018108725 None] snapshot_file for this snap is: volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c.d31fca2a-c2a6-4e62-a40d-f2bf9209eb0e {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:29:10 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ace9f1-21ad-4c5d-ac10-bbbb27d7dbce]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:29:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f3922453-acb4-4eda-907b-4d1dcf2e6eda tempest-VolumeDependencyTests-1018108725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c.d31fca2a-c2a6-4e62-a40d-f2bf9209eb0e {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:10 devstack sudo[106937]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c.d31fca2a-c2a6-4e62-a40d-f2bf9209eb0e
Nov 04 12:29:10 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:10 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f3922453-acb4-4eda-907b-4d1dcf2e6eda tempest-VolumeDependencyTests-1018108725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c.d31fca2a-c2a6-4e62-a40d-f2bf9209eb0e" returned: 0 in 0.348s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:10 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-f3922453-acb4-4eda-907b-4d1dcf2e6eda tempest-VolumeDependencyTests-1018108725 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:29:10 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a88d3a1-d874-4e3a-8526-8e29c4cae559]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:29:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f3922453-acb4-4eda-907b-4d1dcf2e6eda tempest-VolumeDependencyTests-1018108725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:10 devstack sudo[106942]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c
Nov 04 12:29:10 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:11 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f3922453-acb4-4eda-907b-4d1dcf2e6eda tempest-VolumeDependencyTests-1018108725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c" returned: 0 in 0.523s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f3922453-acb4-4eda-907b-4d1dcf2e6eda tempest-VolumeDependencyTests-1018108725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c.d31fca2a-c2a6-4e62-a40d-f2bf9209eb0e {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:11 devstack sudo[106947]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c.d31fca2a-c2a6-4e62-a40d-f2bf9209eb0e
Nov 04 12:29:11 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:11 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f3922453-acb4-4eda-907b-4d1dcf2e6eda tempest-VolumeDependencyTests-1018108725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c.d31fca2a-c2a6-4e62-a40d-f2bf9209eb0e" returned: 0 in 0.316s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f3922453-acb4-4eda-907b-4d1dcf2e6eda tempest-VolumeDependencyTests-1018108725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c.d31fca2a-c2a6-4e62-a40d-f2bf9209eb0e {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:11 devstack sudo[106954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c.d31fca2a-c2a6-4e62-a40d-f2bf9209eb0e
Nov 04 12:29:11 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:11 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f3922453-acb4-4eda-907b-4d1dcf2e6eda tempest-VolumeDependencyTests-1018108725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c.d31fca2a-c2a6-4e62-a40d-f2bf9209eb0e" returned: 0 in 0.255s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:11 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f3922453-acb4-4eda-907b-4d1dcf2e6eda tempest-VolumeDependencyTests-1018108725 None] Lock "cinder-quobyte-d31fca2a-c2a6-4e62-a40d-f2bf9209eb0e" released by "_delete_snapshot" :: held 1.544s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:29:11 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f3922453-acb4-4eda-907b-4d1dcf2e6eda tempest-VolumeDependencyTests-1018108725 None] Lock "cinder-quobyte-3adb1cb3-d076-479d-9d45-d3edda93ea6c" released by "delete_snapshot" :: held 1.566s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:29:11 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-f3922453-acb4-4eda-907b-4d1dcf2e6eda tempest-VolumeDependencyTests-1018108725 None] Created reservations ['f1d1f0a2-ff3c-4e1e-af15-4788c62b264a', '6dacc68c-9bd5-43ed-98bb-dfee2f37b4a7', '27decf9d-d2be-4a73-8ec7-c76d4c00a8c5', 'baa8525a-079f-4782-b2b0-712310141c5f'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:29:11 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-f3922453-acb4-4eda-907b-4d1dcf2e6eda tempest-VolumeDependencyTests-1018108725 None] Delete snapshot completed successfully.
Nov 04 12:29:11 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f3922453-acb4-4eda-907b-4d1dcf2e6eda tempest-VolumeDependencyTests-1018108725 None] Lock "cinder-d31fca2a-c2a6-4e62-a40d-f2bf9209eb0e-delete_snapshot" released by "delete_snapshot" :: held 1.708s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:29:12 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-8940f65d-8efb-4f9e-9426-2113867217df tempest-VolumeDependencyTests-1018108725 None] Acquiring lock "cinder-3adb1cb3-d076-479d-9d45-d3edda93ea6c-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:29:12 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-8940f65d-8efb-4f9e-9426-2113867217df tempest-VolumeDependencyTests-1018108725 None] Lock "cinder-3adb1cb3-d076-479d-9d45-d3edda93ea6c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:29:12 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-8940f65d-8efb-4f9e-9426-2113867217df tempest-VolumeDependencyTests-1018108725 None] Acquiring lock "cinder-quobyte-3adb1cb3-d076-479d-9d45-d3edda93ea6c" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:29:12 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-8940f65d-8efb-4f9e-9426-2113867217df tempest-VolumeDependencyTests-1018108725 None] Lock "cinder-quobyte-3adb1cb3-d076-479d-9d45-d3edda93ea6c" acquired by "delete_volume" :: waited 0.014s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:29:12 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d09b0c9-19b3-4db9-be83-b9f0ea54e55a]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:29:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8940f65d-8efb-4f9e-9426-2113867217df tempest-VolumeDependencyTests-1018108725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:12 devstack sudo[106959]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c
Nov 04 12:29:12 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:12 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8940f65d-8efb-4f9e-9426-2113867217df tempest-VolumeDependencyTests-1018108725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c" returned: 0 in 0.354s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8940f65d-8efb-4f9e-9426-2113867217df tempest-VolumeDependencyTests-1018108725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:12 devstack sudo[106964]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c
Nov 04 12:29:12 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:13 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8940f65d-8efb-4f9e-9426-2113867217df tempest-VolumeDependencyTests-1018108725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3adb1cb3-d076-479d-9d45-d3edda93ea6c" returned: 0 in 0.245s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:13 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-8940f65d-8efb-4f9e-9426-2113867217df tempest-VolumeDependencyTests-1018108725 None] Lock "cinder-quobyte-3adb1cb3-d076-479d-9d45-d3edda93ea6c" released by "delete_volume" :: held 0.665s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:29:13 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-8940f65d-8efb-4f9e-9426-2113867217df tempest-VolumeDependencyTests-1018108725 None] Created reservations ['d82a13ac-5338-4040-838c-838db913baa3', '52c051a4-c349-4642-9b84-318e710f5452', '451ad73c-e0e1-4dfa-92a7-73adb5982bb3', '783c6d6f-b0a1-4b03-bd80-02379c4cd380'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:29:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8940f65d-8efb-4f9e-9426-2113867217df tempest-VolumeDependencyTests-1018108725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8940f65d-8efb-4f9e-9426-2113867217df tempest-VolumeDependencyTests-1018108725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:13 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-8940f65d-8efb-4f9e-9426-2113867217df tempest-VolumeDependencyTests-1018108725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:29:13 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-8940f65d-8efb-4f9e-9426-2113867217df tempest-VolumeDependencyTests-1018108725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:29:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8940f65d-8efb-4f9e-9426-2113867217df tempest-VolumeDependencyTests-1018108725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8940f65d-8efb-4f9e-9426-2113867217df tempest-VolumeDependencyTests-1018108725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:13 devstack sudo[106967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:29:13 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:13 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8940f65d-8efb-4f9e-9426-2113867217df tempest-VolumeDependencyTests-1018108725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.245s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:13 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-8940f65d-8efb-4f9e-9426-2113867217df tempest-VolumeDependencyTests-1018108725 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:29:13 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-8940f65d-8efb-4f9e-9426-2113867217df tempest-VolumeDependencyTests-1018108725 None] Deleted volume successfully.
Nov 04 12:29:13 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-8940f65d-8efb-4f9e-9426-2113867217df tempest-VolumeDependencyTests-1018108725 None] Lock "cinder-3adb1cb3-d076-479d-9d45-d3edda93ea6c-delete_volume" released by "delete_volume" :: held 1.097s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:29:13 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-28408b48-85c3-4399-a506-a0be20fb6ccc tempest-VolumeDependencyTests-1018108725 None] Acquiring lock "cinder-ad4e43b2-f371-4c70-b397-d5509cbe5295-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:29:13 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-28408b48-85c3-4399-a506-a0be20fb6ccc tempest-VolumeDependencyTests-1018108725 None] Lock "cinder-ad4e43b2-f371-4c70-b397-d5509cbe5295-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:29:13 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-28408b48-85c3-4399-a506-a0be20fb6ccc tempest-VolumeDependencyTests-1018108725 None] Acquiring lock "cinder-quobyte-ad4e43b2-f371-4c70-b397-d5509cbe5295" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:29:13 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-28408b48-85c3-4399-a506-a0be20fb6ccc tempest-VolumeDependencyTests-1018108725 None] Lock "cinder-quobyte-ad4e43b2-f371-4c70-b397-d5509cbe5295" acquired by "delete_volume" :: waited 0.016s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:29:13 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1741550-d293-46a3-9954-e628c7e3fd8a]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:29:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-28408b48-85c3-4399-a506-a0be20fb6ccc tempest-VolumeDependencyTests-1018108725 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ad4e43b2-f371-4c70-b397-d5509cbe5295 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:13 devstack sudo[106970]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ad4e43b2-f371-4c70-b397-d5509cbe5295
Nov 04 12:29:13 devstack sudo[106970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:13 devstack sudo[106970]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-28408b48-85c3-4399-a506-a0be20fb6ccc tempest-VolumeDependencyTests-1018108725 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ad4e43b2-f371-4c70-b397-d5509cbe5295" returned: 0 in 0.354s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-28408b48-85c3-4399-a506-a0be20fb6ccc tempest-VolumeDependencyTests-1018108725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ad4e43b2-f371-4c70-b397-d5509cbe5295 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:13 devstack sudo[106975]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ad4e43b2-f371-4c70-b397-d5509cbe5295
Nov 04 12:29:13 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:14 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-28408b48-85c3-4399-a506-a0be20fb6ccc tempest-VolumeDependencyTests-1018108725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ad4e43b2-f371-4c70-b397-d5509cbe5295" returned: 0 in 0.244s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:14 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-28408b48-85c3-4399-a506-a0be20fb6ccc tempest-VolumeDependencyTests-1018108725 None] Lock "cinder-quobyte-ad4e43b2-f371-4c70-b397-d5509cbe5295" released by "delete_volume" :: held 0.639s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:29:14 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-28408b48-85c3-4399-a506-a0be20fb6ccc tempest-VolumeDependencyTests-1018108725 None] Created reservations ['58dbeaa1-d5cd-4fdb-a1a6-f5cfb694af65', 'b6a981bb-3d90-4018-ba42-6ef2b424eefc', 'ed8552c5-de64-4328-a67d-3ef78b774113', 'f85fb756-70ee-431d-b9c1-0cb8d6a8df8c'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:29:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-28408b48-85c3-4399-a506-a0be20fb6ccc tempest-VolumeDependencyTests-1018108725 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-28408b48-85c3-4399-a506-a0be20fb6ccc tempest-VolumeDependencyTests-1018108725 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:14 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-28408b48-85c3-4399-a506-a0be20fb6ccc tempest-VolumeDependencyTests-1018108725 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:29:14 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-28408b48-85c3-4399-a506-a0be20fb6ccc tempest-VolumeDependencyTests-1018108725 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:29:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-28408b48-85c3-4399-a506-a0be20fb6ccc tempest-VolumeDependencyTests-1018108725 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-28408b48-85c3-4399-a506-a0be20fb6ccc tempest-VolumeDependencyTests-1018108725 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:14 devstack sudo[106978]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:29:14 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:14 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-28408b48-85c3-4399-a506-a0be20fb6ccc tempest-VolumeDependencyTests-1018108725 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.240s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:14 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-28408b48-85c3-4399-a506-a0be20fb6ccc tempest-VolumeDependencyTests-1018108725 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:29:14 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-28408b48-85c3-4399-a506-a0be20fb6ccc tempest-VolumeDependencyTests-1018108725 None] Deleted volume successfully.
Nov 04 12:29:14 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-28408b48-85c3-4399-a506-a0be20fb6ccc tempest-VolumeDependencyTests-1018108725 None] Lock "cinder-ad4e43b2-f371-4c70-b397-d5509cbe5295-delete_volume" released by "delete_volume" :: held 1.134s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:29:24 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=76,cinder:UPDATE=100,cinder:DELETE=8,cinder:INSERT=25 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:29:24 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=75,cinder:UPDATE=104,cinder:INSERT=25,cinder:DELETE=10 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:29:30 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f288100-2271-4354-a40a-c39d18fb9e48 tempest-CreateVolumesFromImageTest-383500336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:29:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5f288100-2271-4354-a40a-c39d18fb9e48 tempest-CreateVolumesFromImageTest-383500336 None] Flow 'volume_create_manager' (af611103-1ba3-4e14-959d-f10973cf2635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:29:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5f288100-2271-4354-a40a-c39d18fb9e48 tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c300724f-bc03-409f-8ace-9e5b11e1f38c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5f288100-2271-4354-a40a-c39d18fb9e48 tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c300724f-bc03-409f-8ace-9e5b11e1f38c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-650152533',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f68ae101-2a48-4725-92d7-8eb3569fe9d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dc5d15453d54e3b8f7122c33d002373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:30Z,use_quota=True,user_id='5122cd45e05649bc92c4c6c4f59d7044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5f288100-2271-4354-a40a-c39d18fb9e48 tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (983d9881-dff3-4da6-b7a0-41f54d40ca95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5f288100-2271-4354-a40a-c39d18fb9e48 tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (983d9881-dff3-4da6-b7a0-41f54d40ca95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5f288100-2271-4354-a40a-c39d18fb9e48 tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e915e572-9e47-4235-ba5c-d1b4cba63047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5f288100-2271-4354-a40a-c39d18fb9e48 tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e915e572-9e47-4235-ba5c-d1b4cba63047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f68ae101-2a48-4725-92d7-8eb3569fe9d0', 'volume_name': 'volume-f68ae101-2a48-4725-92d7-8eb3569fe9d0', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5f288100-2271-4354-a40a-c39d18fb9e48 tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1665146f-3847-4435-ad3d-1213c9c4aa65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5f288100-2271-4354-a40a-c39d18fb9e48 tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1665146f-3847-4435-ad3d-1213c9c4aa65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5f288100-2271-4354-a40a-c39d18fb9e48 tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bb6f7b3-36e8-4ee0-a441-8c34a0f43862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:30 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-5f288100-2271-4354-a40a-c39d18fb9e48 tempest-CreateVolumesFromImageTest-383500336 None] Volume f68ae101-2a48-4725-92d7-8eb3569fe9d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f68ae101-2a48-4725-92d7-8eb3569fe9d0', 'volume_size': 1}
Nov 04 12:29:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5f288100-2271-4354-a40a-c39d18fb9e48 tempest-CreateVolumesFromImageTest-383500336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5f288100-2271-4354-a40a-c39d18fb9e48 tempest-CreateVolumesFromImageTest-383500336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:30 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5f288100-2271-4354-a40a-c39d18fb9e48 tempest-CreateVolumesFromImageTest-383500336 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-650152533',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f68ae101-2a48-4725-92d7-8eb3569fe9d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dc5d15453d54e3b8f7122c33d002373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:30Z,use_quota=True,user_id='5122cd45e05649bc92c4c6c4f59d7044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:29:30 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-5f288100-2271-4354-a40a-c39d18fb9e48 tempest-CreateVolumesFromImageTest-383500336 None] Creating volume f68ae101-2a48-4725-92d7-8eb3569fe9d0 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:29:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5f288100-2271-4354-a40a-c39d18fb9e48 tempest-CreateVolumesFromImageTest-383500336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5f288100-2271-4354-a40a-c39d18fb9e48 tempest-CreateVolumesFromImageTest-383500336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:30 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5f288100-2271-4354-a40a-c39d18fb9e48 tempest-CreateVolumesFromImageTest-383500336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:29:30 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5f288100-2271-4354-a40a-c39d18fb9e48 tempest-CreateVolumesFromImageTest-383500336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:29:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5f288100-2271-4354-a40a-c39d18fb9e48 tempest-CreateVolumesFromImageTest-383500336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:30 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5f288100-2271-4354-a40a-c39d18fb9e48 tempest-CreateVolumesFromImageTest-383500336 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:29:30 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-5f288100-2271-4354-a40a-c39d18fb9e48 tempest-CreateVolumesFromImageTest-383500336 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:29:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5f288100-2271-4354-a40a-c39d18fb9e48 tempest-CreateVolumesFromImageTest-383500336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f68ae101-2a48-4725-92d7-8eb3569fe9d0 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:30 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c17eed2-04b5-4a7c-a022-54c2dbf6f020 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:29:30 devstack sudo[107020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f68ae101-2a48-4725-92d7-8eb3569fe9d0 1073741824
Nov 04 12:29:30 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5c17eed2-04b5-4a7c-a022-54c2dbf6f020 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Flow 'volume_create_manager' (9f3adff4-7a5f-41b3-836b-9b6e30c92a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:29:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5c17eed2-04b5-4a7c-a022-54c2dbf6f020 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c308fd3-883c-4fe9-a79a-107a0ce9b55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5c17eed2-04b5-4a7c-a022-54c2dbf6f020 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c308fd3-883c-4fe9-a79a-107a0ce9b55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-364531799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f08a3f0-ba1c-4e08-be81-259b3a20ecdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4bd7e2af9846e1ac25525998457444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:31Z,use_quota=True,user_id='d7ee65def192460f91e684a26a271088',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5c17eed2-04b5-4a7c-a022-54c2dbf6f020 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f58a418b-ce56-4b9f-bf66-aaa64ee5052f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5c17eed2-04b5-4a7c-a022-54c2dbf6f020 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f58a418b-ce56-4b9f-bf66-aaa64ee5052f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5c17eed2-04b5-4a7c-a022-54c2dbf6f020 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2348f7f3-22d6-421b-9dcf-537b9a1a7200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5c17eed2-04b5-4a7c-a022-54c2dbf6f020 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2348f7f3-22d6-421b-9dcf-537b9a1a7200) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f08a3f0-ba1c-4e08-be81-259b3a20ecdf', 'volume_name': 'volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5c17eed2-04b5-4a7c-a022-54c2dbf6f020 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31d62654-d9dd-48cf-9883-cac0bf3ff3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5c17eed2-04b5-4a7c-a022-54c2dbf6f020 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31d62654-d9dd-48cf-9883-cac0bf3ff3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5c17eed2-04b5-4a7c-a022-54c2dbf6f020 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8413850c-6ce8-41f4-9302-5f1cac441edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:30 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-5c17eed2-04b5-4a7c-a022-54c2dbf6f020 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Volume 1f08a3f0-ba1c-4e08-be81-259b3a20ecdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf', 'volume_size': 1}
Nov 04 12:29:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5c17eed2-04b5-4a7c-a022-54c2dbf6f020 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:30 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eadf303-f4d4-4762-b5ad-5a138afc8564 tempest-CreateVolumesFromImageTest-383500336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:29:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2eadf303-f4d4-4762-b5ad-5a138afc8564 tempest-CreateVolumesFromImageTest-383500336 None] Flow 'volume_create_manager' (11866ee0-6e17-4016-8a5e-2105f9ddf6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:29:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2eadf303-f4d4-4762-b5ad-5a138afc8564 tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0afe1cb3-d789-4b7d-b250-5a49c9560b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2eadf303-f4d4-4762-b5ad-5a138afc8564 tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0afe1cb3-d789-4b7d-b250-5a49c9560b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-14817721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37bc8aa1-c3b4-4797-baf6-dbdfe086c014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dc5d15453d54e3b8f7122c33d002373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:31Z,use_quota=True,user_id='5122cd45e05649bc92c4c6c4f59d7044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2eadf303-f4d4-4762-b5ad-5a138afc8564 tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2598d0d3-c5bd-4ab0-8f16-39c307f2a0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2eadf303-f4d4-4762-b5ad-5a138afc8564 tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2598d0d3-c5bd-4ab0-8f16-39c307f2a0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2eadf303-f4d4-4762-b5ad-5a138afc8564 tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d52f403-2abf-4b81-a112-f63f56032084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2eadf303-f4d4-4762-b5ad-5a138afc8564 tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d52f403-2abf-4b81-a112-f63f56032084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37bc8aa1-c3b4-4797-baf6-dbdfe086c014', 'volume_name': 'volume-37bc8aa1-c3b4-4797-baf6-dbdfe086c014', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2eadf303-f4d4-4762-b5ad-5a138afc8564 tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdac161f-22bc-4f7d-93b7-300b78a6bec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2eadf303-f4d4-4762-b5ad-5a138afc8564 tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdac161f-22bc-4f7d-93b7-300b78a6bec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2eadf303-f4d4-4762-b5ad-5a138afc8564 tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ff62af8-542c-47ee-a240-d6ef29a3eb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:31 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-2eadf303-f4d4-4762-b5ad-5a138afc8564 tempest-CreateVolumesFromImageTest-383500336 None] Volume 37bc8aa1-c3b4-4797-baf6-dbdfe086c014: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37bc8aa1-c3b4-4797-baf6-dbdfe086c014', 'volume_size': 1}
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2eadf303-f4d4-4762-b5ad-5a138afc8564 tempest-CreateVolumesFromImageTest-383500336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b853849-8cf0-47dc-ae77-993ed445dcde tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3b853849-8cf0-47dc-ae77-993ed445dcde tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Flow 'volume_create_manager' (95fd3c23-e858-4779-8b5c-e3acfe6a0ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3b853849-8cf0-47dc-ae77-993ed445dcde tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b2298ff-f8e8-441b-8e25-c0b057f433a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3b853849-8cf0-47dc-ae77-993ed445dcde tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b2298ff-f8e8-441b-8e25-c0b057f433a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1444137662',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92dc9a97-4e37-4d3d-830c-b6d3cc493e45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc7ca8745a8245d591931242f0a34cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:31Z,use_quota=True,user_id='ac51764edd3a4e81b3001b41efc416dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3b853849-8cf0-47dc-ae77-993ed445dcde tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2ddc08f-8463-4ad0-8604-e94fcd42c77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3b853849-8cf0-47dc-ae77-993ed445dcde tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2ddc08f-8463-4ad0-8604-e94fcd42c77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3b853849-8cf0-47dc-ae77-993ed445dcde tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc632e73-97fd-43aa-bcca-c91315fffc10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3b853849-8cf0-47dc-ae77-993ed445dcde tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc632e73-97fd-43aa-bcca-c91315fffc10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92dc9a97-4e37-4d3d-830c-b6d3cc493e45', 'volume_name': 'volume-92dc9a97-4e37-4d3d-830c-b6d3cc493e45', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3b853849-8cf0-47dc-ae77-993ed445dcde tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdf8c0e9-d886-4587-b0ab-4b3fb50d14d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3b853849-8cf0-47dc-ae77-993ed445dcde tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdf8c0e9-d886-4587-b0ab-4b3fb50d14d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3b853849-8cf0-47dc-ae77-993ed445dcde tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b50c584-4ab5-4788-8420-82b26b00b179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:31 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-3b853849-8cf0-47dc-ae77-993ed445dcde tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Volume 92dc9a97-4e37-4d3d-830c-b6d3cc493e45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92dc9a97-4e37-4d3d-830c-b6d3cc493e45', 'volume_size': 1}
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3b853849-8cf0-47dc-ae77-993ed445dcde tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:31 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5f288100-2271-4354-a40a-c39d18fb9e48 tempest-CreateVolumesFromImageTest-383500336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f68ae101-2a48-4725-92d7-8eb3569fe9d0 1073741824" returned: 0 in 0.681s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5f288100-2271-4354-a40a-c39d18fb9e48 tempest-CreateVolumesFromImageTest-383500336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f68ae101-2a48-4725-92d7-8eb3569fe9d0 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:31 devstack sudo[107027]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f68ae101-2a48-4725-92d7-8eb3569fe9d0
Nov 04 12:29:31 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-4316eef7-a5ea-4865-b660-a10c2be62a57 tempest-CreateVolumesFromImageTest-383500336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-4316eef7-a5ea-4865-b660-a10c2be62a57 tempest-CreateVolumesFromImageTest-383500336 None] Flow 'volume_create_manager' (afe8d895-4e15-4758-b1f5-04ffee72f021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-4316eef7-a5ea-4865-b660-a10c2be62a57 tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1abc89c4-5eb9-4f57-a4bf-e68ffa9538a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-4316eef7-a5ea-4865-b660-a10c2be62a57 tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1abc89c4-5eb9-4f57-a4bf-e68ffa9538a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1412929254',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ecaacff-20ad-40c5-a1d3-72bc86f9890e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dc5d15453d54e3b8f7122c33d002373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:32Z,use_quota=True,user_id='5122cd45e05649bc92c4c6c4f59d7044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-4316eef7-a5ea-4865-b660-a10c2be62a57 tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b902202-1f23-4eca-860b-f3f8f5ab14da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-4316eef7-a5ea-4865-b660-a10c2be62a57 tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b902202-1f23-4eca-860b-f3f8f5ab14da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-4316eef7-a5ea-4865-b660-a10c2be62a57 tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac7ef96d-303b-40e2-9bdf-24994e8c6b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-4316eef7-a5ea-4865-b660-a10c2be62a57 tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac7ef96d-303b-40e2-9bdf-24994e8c6b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ecaacff-20ad-40c5-a1d3-72bc86f9890e', 'volume_name': 'volume-7ecaacff-20ad-40c5-a1d3-72bc86f9890e', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-4316eef7-a5ea-4865-b660-a10c2be62a57 tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d34d3b6a-6323-4d2a-9b83-cb37f80d2b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-4316eef7-a5ea-4865-b660-a10c2be62a57 tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d34d3b6a-6323-4d2a-9b83-cb37f80d2b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-4316eef7-a5ea-4865-b660-a10c2be62a57 tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e95029eb-b51f-4173-bad0-7bd9d83fb2dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:31 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-4316eef7-a5ea-4865-b660-a10c2be62a57 tempest-CreateVolumesFromImageTest-383500336 None] Volume 7ecaacff-20ad-40c5-a1d3-72bc86f9890e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ecaacff-20ad-40c5-a1d3-72bc86f9890e', 'volume_size': 1}
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-4316eef7-a5ea-4865-b660-a10c2be62a57 tempest-CreateVolumesFromImageTest-383500336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:31 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5f288100-2271-4354-a40a-c39d18fb9e48 tempest-CreateVolumesFromImageTest-383500336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f68ae101-2a48-4725-92d7-8eb3569fe9d0" returned: 0 in 0.350s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5f288100-2271-4354-a40a-c39d18fb9e48 tempest-CreateVolumesFromImageTest-383500336 None] <== create_volume: return (1089ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5f288100-2271-4354-a40a-c39d18fb9e48 tempest-CreateVolumesFromImageTest-383500336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5c17eed2-04b5-4a7c-a022-54c2dbf6f020 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.910s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5c17eed2-04b5-4a7c-a022-54c2dbf6f020 tempest-CreateVolumesFromSnapshotTest-2032084862 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-364531799',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f08a3f0-ba1c-4e08-be81-259b3a20ecdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4bd7e2af9846e1ac25525998457444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:31Z,use_quota=True,user_id='d7ee65def192460f91e684a26a271088',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-5c17eed2-04b5-4a7c-a022-54c2dbf6f020 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Creating volume 1f08a3f0-ba1c-4e08-be81-259b3a20ecdf {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5c17eed2-04b5-4a7c-a022-54c2dbf6f020 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5c17eed2-04b5-4a7c-a022-54c2dbf6f020 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5c17eed2-04b5-4a7c-a022-54c2dbf6f020 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5c17eed2-04b5-4a7c-a022-54c2dbf6f020 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5c17eed2-04b5-4a7c-a022-54c2dbf6f020 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5c17eed2-04b5-4a7c-a022-54c2dbf6f020 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:29:31 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-5c17eed2-04b5-4a7c-a022-54c2dbf6f020 tempest-CreateVolumesFromSnapshotTest-2032084862 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5c17eed2-04b5-4a7c-a022-54c2dbf6f020 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5f288100-2271-4354-a40a-c39d18fb9e48 tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6bb6f7b3-36e8-4ee0-a441-8c34a0f43862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f68ae101-2a48-4725-92d7-8eb3569fe9d0', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:31 devstack sudo[107030]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf 1073741824
Nov 04 12:29:31 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5f288100-2271-4354-a40a-c39d18fb9e48 tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8072d95f-7bef-41d8-a030-7b3cc4f00226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:31 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-5f288100-2271-4354-a40a-c39d18fb9e48 tempest-CreateVolumesFromImageTest-383500336 None] Volume volume-f68ae101-2a48-4725-92d7-8eb3569fe9d0 (f68ae101-2a48-4725-92d7-8eb3569fe9d0): created successfully
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5f288100-2271-4354-a40a-c39d18fb9e48 tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8072d95f-7bef-41d8-a030-7b3cc4f00226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5f288100-2271-4354-a40a-c39d18fb9e48 tempest-CreateVolumesFromImageTest-383500336 None] Flow 'volume_create_manager' (af611103-1ba3-4e14-959d-f10973cf2635) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:29:31 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-5f288100-2271-4354-a40a-c39d18fb9e48 tempest-CreateVolumesFromImageTest-383500336 None] Created volume successfully.
Nov 04 12:29:32 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-3baa7c92-32d7-4cab-9b75-726643948d1b tempest-CreateVolumesFromImageTest-383500336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:29:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3baa7c92-32d7-4cab-9b75-726643948d1b tempest-CreateVolumesFromImageTest-383500336 None] Flow 'volume_create_manager' (7ea81339-6293-463f-9316-d6f8aca74ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:29:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3baa7c92-32d7-4cab-9b75-726643948d1b tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0dc39fc-abff-47a1-a283-4e9d1a40c05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3baa7c92-32d7-4cab-9b75-726643948d1b tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0dc39fc-abff-47a1-a283-4e9d1a40c05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-303363736',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80b34548-95fd-46f7-af61-24e96b9d331c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dc5d15453d54e3b8f7122c33d002373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:32Z,use_quota=True,user_id='5122cd45e05649bc92c4c6c4f59d7044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3baa7c92-32d7-4cab-9b75-726643948d1b tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (243d2814-b657-45f3-b4b7-b2065647262d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3baa7c92-32d7-4cab-9b75-726643948d1b tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (243d2814-b657-45f3-b4b7-b2065647262d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3baa7c92-32d7-4cab-9b75-726643948d1b tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82fec967-5015-44a3-bd0a-59979b123ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3baa7c92-32d7-4cab-9b75-726643948d1b tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82fec967-5015-44a3-bd0a-59979b123ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80b34548-95fd-46f7-af61-24e96b9d331c', 'volume_name': 'volume-80b34548-95fd-46f7-af61-24e96b9d331c', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3baa7c92-32d7-4cab-9b75-726643948d1b tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da864326-6b06-445d-af83-ac7ac7fd87b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3baa7c92-32d7-4cab-9b75-726643948d1b tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da864326-6b06-445d-af83-ac7ac7fd87b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3baa7c92-32d7-4cab-9b75-726643948d1b tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff7dd40a-4c42-401c-a1f5-ff6870082b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:32 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-3baa7c92-32d7-4cab-9b75-726643948d1b tempest-CreateVolumesFromImageTest-383500336 None] Volume 80b34548-95fd-46f7-af61-24e96b9d331c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80b34548-95fd-46f7-af61-24e96b9d331c', 'volume_size': 1}
Nov 04 12:29:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3baa7c92-32d7-4cab-9b75-726643948d1b tempest-CreateVolumesFromImageTest-383500336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:32 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5c17eed2-04b5-4a7c-a022-54c2dbf6f020 tempest-CreateVolumesFromSnapshotTest-2032084862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf 1073741824" returned: 0 in 0.543s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5c17eed2-04b5-4a7c-a022-54c2dbf6f020 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:32 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e2b711a-9548-4190-9549-1f9c5eb4291b tempest-CreateVolumesFromImageTest-383500336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:29:32 devstack sudo[107036]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf
Nov 04 12:29:32 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6e2b711a-9548-4190-9549-1f9c5eb4291b tempest-CreateVolumesFromImageTest-383500336 None] Flow 'volume_create_manager' (ee1d3358-f217-4547-89f0-0eb9c4a5ee42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:29:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6e2b711a-9548-4190-9549-1f9c5eb4291b tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5097147c-e35d-49f6-95fc-f1b62fb3cd0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6e2b711a-9548-4190-9549-1f9c5eb4291b tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5097147c-e35d-49f6-95fc-f1b62fb3cd0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-99127794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=162480d3-4062-4f61-a7c1-173ed5c03081,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dc5d15453d54e3b8f7122c33d002373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:32Z,use_quota=True,user_id='5122cd45e05649bc92c4c6c4f59d7044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6e2b711a-9548-4190-9549-1f9c5eb4291b tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1f0ee00-c588-4f9c-84d2-b624545f1258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6e2b711a-9548-4190-9549-1f9c5eb4291b tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1f0ee00-c588-4f9c-84d2-b624545f1258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6e2b711a-9548-4190-9549-1f9c5eb4291b tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47157743-fd7a-4ea9-8338-2c36a6591e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6e2b711a-9548-4190-9549-1f9c5eb4291b tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47157743-fd7a-4ea9-8338-2c36a6591e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '162480d3-4062-4f61-a7c1-173ed5c03081', 'volume_name': 'volume-162480d3-4062-4f61-a7c1-173ed5c03081', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6e2b711a-9548-4190-9549-1f9c5eb4291b tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f9c569d-634b-4128-8327-45afc833ec86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6e2b711a-9548-4190-9549-1f9c5eb4291b tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f9c569d-634b-4128-8327-45afc833ec86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6e2b711a-9548-4190-9549-1f9c5eb4291b tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (438f1181-bacc-487d-aa1f-c43d1706ce36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:32 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-6e2b711a-9548-4190-9549-1f9c5eb4291b tempest-CreateVolumesFromImageTest-383500336 None] Volume 162480d3-4062-4f61-a7c1-173ed5c03081: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-162480d3-4062-4f61-a7c1-173ed5c03081', 'volume_size': 1}
Nov 04 12:29:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-6e2b711a-9548-4190-9549-1f9c5eb4291b tempest-CreateVolumesFromImageTest-383500336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:32 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5c17eed2-04b5-4a7c-a022-54c2dbf6f020 tempest-CreateVolumesFromSnapshotTest-2032084862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf" returned: 0 in 0.252s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:32 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5c17eed2-04b5-4a7c-a022-54c2dbf6f020 tempest-CreateVolumesFromSnapshotTest-2032084862 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:29:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5c17eed2-04b5-4a7c-a022-54c2dbf6f020 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2eadf303-f4d4-4762-b5ad-5a138afc8564 tempest-CreateVolumesFromImageTest-383500336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.621s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:32 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-2eadf303-f4d4-4762-b5ad-5a138afc8564 tempest-CreateVolumesFromImageTest-383500336 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-14817721',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37bc8aa1-c3b4-4797-baf6-dbdfe086c014,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dc5d15453d54e3b8f7122c33d002373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:31Z,use_quota=True,user_id='5122cd45e05649bc92c4c6c4f59d7044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:29:32 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-2eadf303-f4d4-4762-b5ad-5a138afc8564 tempest-CreateVolumesFromImageTest-383500336 None] Creating volume 37bc8aa1-c3b4-4797-baf6-dbdfe086c014 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:29:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2eadf303-f4d4-4762-b5ad-5a138afc8564 tempest-CreateVolumesFromImageTest-383500336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2eadf303-f4d4-4762-b5ad-5a138afc8564 tempest-CreateVolumesFromImageTest-383500336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:32 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-2eadf303-f4d4-4762-b5ad-5a138afc8564 tempest-CreateVolumesFromImageTest-383500336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:29:32 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-2eadf303-f4d4-4762-b5ad-5a138afc8564 tempest-CreateVolumesFromImageTest-383500336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:29:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2eadf303-f4d4-4762-b5ad-5a138afc8564 tempest-CreateVolumesFromImageTest-383500336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:32 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-2eadf303-f4d4-4762-b5ad-5a138afc8564 tempest-CreateVolumesFromImageTest-383500336 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:29:32 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-2eadf303-f4d4-4762-b5ad-5a138afc8564 tempest-CreateVolumesFromImageTest-383500336 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:29:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2eadf303-f4d4-4762-b5ad-5a138afc8564 tempest-CreateVolumesFromImageTest-383500336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37bc8aa1-c3b4-4797-baf6-dbdfe086c014 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:32 devstack sudo[107042]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37bc8aa1-c3b4-4797-baf6-dbdfe086c014 1073741824
Nov 04 12:29:32 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5c17eed2-04b5-4a7c-a022-54c2dbf6f020 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8413850c-6ce8-41f4-9302-5f1cac441edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5c17eed2-04b5-4a7c-a022-54c2dbf6f020 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77ee1425-2367-465e-b286-b6fb0e7d0fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:32 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-5c17eed2-04b5-4a7c-a022-54c2dbf6f020 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Volume volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf (1f08a3f0-ba1c-4e08-be81-259b3a20ecdf): created successfully
Nov 04 12:29:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5c17eed2-04b5-4a7c-a022-54c2dbf6f020 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77ee1425-2367-465e-b286-b6fb0e7d0fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5c17eed2-04b5-4a7c-a022-54c2dbf6f020 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Flow 'volume_create_manager' (9f3adff4-7a5f-41b3-836b-9b6e30c92a89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:29:32 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-5c17eed2-04b5-4a7c-a022-54c2dbf6f020 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Created volume successfully.
Nov 04 12:29:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-4c719bd0-6c7f-4249-ab54-045e1f427130 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:33 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2eadf303-f4d4-4762-b5ad-5a138afc8564 tempest-CreateVolumesFromImageTest-383500336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37bc8aa1-c3b4-4797-baf6-dbdfe086c014 1073741824" returned: 0 in 0.582s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2eadf303-f4d4-4762-b5ad-5a138afc8564 tempest-CreateVolumesFromImageTest-383500336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37bc8aa1-c3b4-4797-baf6-dbdfe086c014 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:33 devstack sudo[107051]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37bc8aa1-c3b4-4797-baf6-dbdfe086c014
Nov 04 12:29:33 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:33 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2eadf303-f4d4-4762-b5ad-5a138afc8564 tempest-CreateVolumesFromImageTest-383500336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37bc8aa1-c3b4-4797-baf6-dbdfe086c014" returned: 0 in 0.249s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:33 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-2eadf303-f4d4-4762-b5ad-5a138afc8564 tempest-CreateVolumesFromImageTest-383500336 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:29:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2eadf303-f4d4-4762-b5ad-5a138afc8564 tempest-CreateVolumesFromImageTest-383500336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3b853849-8cf0-47dc-ae77-993ed445dcde tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.192s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:33 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3b853849-8cf0-47dc-ae77-993ed445dcde tempest-CreateVolumesFromSourceVolumeTest-147450298 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1444137662',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92dc9a97-4e37-4d3d-830c-b6d3cc493e45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc7ca8745a8245d591931242f0a34cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:31Z,use_quota=True,user_id='ac51764edd3a4e81b3001b41efc416dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:29:33 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-3b853849-8cf0-47dc-ae77-993ed445dcde tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Creating volume 92dc9a97-4e37-4d3d-830c-b6d3cc493e45 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:29:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3b853849-8cf0-47dc-ae77-993ed445dcde tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3b853849-8cf0-47dc-ae77-993ed445dcde tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:33 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3b853849-8cf0-47dc-ae77-993ed445dcde tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:29:33 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3b853849-8cf0-47dc-ae77-993ed445dcde tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:29:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3b853849-8cf0-47dc-ae77-993ed445dcde tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:33 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3b853849-8cf0-47dc-ae77-993ed445dcde tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:29:33 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-3b853849-8cf0-47dc-ae77-993ed445dcde tempest-CreateVolumesFromSourceVolumeTest-147450298 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:29:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3b853849-8cf0-47dc-ae77-993ed445dcde tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-92dc9a97-4e37-4d3d-830c-b6d3cc493e45 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:33 devstack sudo[107054]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-92dc9a97-4e37-4d3d-830c-b6d3cc493e45 1073741824
Nov 04 12:29:33 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:33 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2eadf303-f4d4-4762-b5ad-5a138afc8564 tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ff62af8-542c-47ee-a240-d6ef29a3eb52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37bc8aa1-c3b4-4797-baf6-dbdfe086c014', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:33 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2eadf303-f4d4-4762-b5ad-5a138afc8564 tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f332e9c-218d-47c4-9f01-8112e7039fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:33 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-2eadf303-f4d4-4762-b5ad-5a138afc8564 tempest-CreateVolumesFromImageTest-383500336 None] Volume volume-37bc8aa1-c3b4-4797-baf6-dbdfe086c014 (37bc8aa1-c3b4-4797-baf6-dbdfe086c014): created successfully
Nov 04 12:29:33 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2eadf303-f4d4-4762-b5ad-5a138afc8564 tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f332e9c-218d-47c4-9f01-8112e7039fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:33 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2eadf303-f4d4-4762-b5ad-5a138afc8564 tempest-CreateVolumesFromImageTest-383500336 None] Flow 'volume_create_manager' (11866ee0-6e17-4016-8a5e-2105f9ddf6d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:29:33 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-2eadf303-f4d4-4762-b5ad-5a138afc8564 tempest-CreateVolumesFromImageTest-383500336 None] Created volume successfully.
Nov 04 12:29:34 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3b853849-8cf0-47dc-ae77-993ed445dcde tempest-CreateVolumesFromSourceVolumeTest-147450298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-92dc9a97-4e37-4d3d-830c-b6d3cc493e45 1073741824" returned: 0 in 0.453s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3b853849-8cf0-47dc-ae77-993ed445dcde tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-92dc9a97-4e37-4d3d-830c-b6d3cc493e45 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:34 devstack sudo[107059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-92dc9a97-4e37-4d3d-830c-b6d3cc493e45
Nov 04 12:29:34 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:34 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3b853849-8cf0-47dc-ae77-993ed445dcde tempest-CreateVolumesFromSourceVolumeTest-147450298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-92dc9a97-4e37-4d3d-830c-b6d3cc493e45" returned: 0 in 0.243s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:34 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3b853849-8cf0-47dc-ae77-993ed445dcde tempest-CreateVolumesFromSourceVolumeTest-147450298 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:29:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3b853849-8cf0-47dc-ae77-993ed445dcde tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-4316eef7-a5ea-4865-b660-a10c2be62a57 tempest-CreateVolumesFromImageTest-383500336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.645s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:34 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-4316eef7-a5ea-4865-b660-a10c2be62a57 tempest-CreateVolumesFromImageTest-383500336 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1412929254',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ecaacff-20ad-40c5-a1d3-72bc86f9890e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dc5d15453d54e3b8f7122c33d002373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:32Z,use_quota=True,user_id='5122cd45e05649bc92c4c6c4f59d7044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:29:34 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-4316eef7-a5ea-4865-b660-a10c2be62a57 tempest-CreateVolumesFromImageTest-383500336 None] Creating volume 7ecaacff-20ad-40c5-a1d3-72bc86f9890e {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:29:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-4316eef7-a5ea-4865-b660-a10c2be62a57 tempest-CreateVolumesFromImageTest-383500336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-4316eef7-a5ea-4865-b660-a10c2be62a57 tempest-CreateVolumesFromImageTest-383500336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:34 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-4316eef7-a5ea-4865-b660-a10c2be62a57 tempest-CreateVolumesFromImageTest-383500336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:29:34 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-4316eef7-a5ea-4865-b660-a10c2be62a57 tempest-CreateVolumesFromImageTest-383500336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:29:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-4316eef7-a5ea-4865-b660-a10c2be62a57 tempest-CreateVolumesFromImageTest-383500336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:34 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-4316eef7-a5ea-4865-b660-a10c2be62a57 tempest-CreateVolumesFromImageTest-383500336 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:29:34 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-4316eef7-a5ea-4865-b660-a10c2be62a57 tempest-CreateVolumesFromImageTest-383500336 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:29:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4316eef7-a5ea-4865-b660-a10c2be62a57 tempest-CreateVolumesFromImageTest-383500336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-7ecaacff-20ad-40c5-a1d3-72bc86f9890e 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:34 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3b853849-8cf0-47dc-ae77-993ed445dcde tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b50c584-4ab5-4788-8420-82b26b00b179) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92dc9a97-4e37-4d3d-830c-b6d3cc493e45', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:34 devstack sudo[107062]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-7ecaacff-20ad-40c5-a1d3-72bc86f9890e 1073741824
Nov 04 12:29:34 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:34 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3b853849-8cf0-47dc-ae77-993ed445dcde tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9379b9ed-e885-4565-8526-78f121d98cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:34 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-3b853849-8cf0-47dc-ae77-993ed445dcde tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Volume volume-92dc9a97-4e37-4d3d-830c-b6d3cc493e45 (92dc9a97-4e37-4d3d-830c-b6d3cc493e45): created successfully
Nov 04 12:29:34 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3b853849-8cf0-47dc-ae77-993ed445dcde tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9379b9ed-e885-4565-8526-78f121d98cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:34 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3b853849-8cf0-47dc-ae77-993ed445dcde tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Flow 'volume_create_manager' (95fd3c23-e858-4779-8b5c-e3acfe6a0ffc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:29:34 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-3b853849-8cf0-47dc-ae77-993ed445dcde tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Created volume successfully.
Nov 04 12:29:34 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4316eef7-a5ea-4865-b660-a10c2be62a57 tempest-CreateVolumesFromImageTest-383500336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-7ecaacff-20ad-40c5-a1d3-72bc86f9890e 1073741824" returned: 0 in 0.535s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4316eef7-a5ea-4865-b660-a10c2be62a57 tempest-CreateVolumesFromImageTest-383500336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-7ecaacff-20ad-40c5-a1d3-72bc86f9890e {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:34 devstack sudo[107068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-7ecaacff-20ad-40c5-a1d3-72bc86f9890e
Nov 04 12:29:34 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:34 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Flow 'volume_create_manager' (95a3a0c5-2103-4cb8-b557-d5d6b9696a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b898b624-ad95-43ff-9640-711b2789e126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b898b624-ad95-43ff-9640-711b2789e126) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de13b40b-ab46-4c42-b4d6-dff16d46c78b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bab1f7ad94f4911bfa9f1c13a2a22c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:35Z,use_quota=True,user_id='06a09cda8c044d92b741703bce764a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(392d673b-6a52-4ec7-83ea-7d67b94d15e0),volume_type_id=392d673b-6a52-4ec7-83ea-7d67b94d15e0)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6959f97f-9bb6-4fad-9d3d-ae71faa4ea29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6959f97f-9bb6-4fad-9d3d-ae71faa4ea29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e917fc5-8db6-4f5b-b54e-5d12a9a263c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG cinder.image.glance [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Creating Keystone auth plugin from conf {{(pid=87169) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 04 12:29:35 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4316eef7-a5ea-4865-b660-a10c2be62a57 tempest-CreateVolumesFromImageTest-383500336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-7ecaacff-20ad-40c5-a1d3-72bc86f9890e" returned: 0 in 0.274s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-4316eef7-a5ea-4865-b660-a10c2be62a57 tempest-CreateVolumesFromImageTest-383500336 None] <== create_volume: return (864ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-4316eef7-a5ea-4865-b660-a10c2be62a57 tempest-CreateVolumesFromImageTest-383500336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3baa7c92-32d7-4cab-9b75-726643948d1b tempest-CreateVolumesFromImageTest-383500336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.069s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3baa7c92-32d7-4cab-9b75-726643948d1b tempest-CreateVolumesFromImageTest-383500336 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-303363736',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80b34548-95fd-46f7-af61-24e96b9d331c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dc5d15453d54e3b8f7122c33d002373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:32Z,use_quota=True,user_id='5122cd45e05649bc92c4c6c4f59d7044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-3baa7c92-32d7-4cab-9b75-726643948d1b tempest-CreateVolumesFromImageTest-383500336 None] Creating volume 80b34548-95fd-46f7-af61-24e96b9d331c {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3baa7c92-32d7-4cab-9b75-726643948d1b tempest-CreateVolumesFromImageTest-383500336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3baa7c92-32d7-4cab-9b75-726643948d1b tempest-CreateVolumesFromImageTest-383500336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3baa7c92-32d7-4cab-9b75-726643948d1b tempest-CreateVolumesFromImageTest-383500336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3baa7c92-32d7-4cab-9b75-726643948d1b tempest-CreateVolumesFromImageTest-383500336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3baa7c92-32d7-4cab-9b75-726643948d1b tempest-CreateVolumesFromImageTest-383500336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3baa7c92-32d7-4cab-9b75-726643948d1b tempest-CreateVolumesFromImageTest-383500336 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:29:35 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-3baa7c92-32d7-4cab-9b75-726643948d1b tempest-CreateVolumesFromImageTest-383500336 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3baa7c92-32d7-4cab-9b75-726643948d1b tempest-CreateVolumesFromImageTest-383500336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-80b34548-95fd-46f7-af61-24e96b9d331c 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:35 devstack sudo[107071]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-80b34548-95fd-46f7-af61-24e96b9d331c 1073741824
Nov 04 12:29:35 devstack sudo[107071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-4316eef7-a5ea-4865-b660-a10c2be62a57 tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e95029eb-b51f-4173-bad0-7bd9d83fb2dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ecaacff-20ad-40c5-a1d3-72bc86f9890e', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-4316eef7-a5ea-4865-b660-a10c2be62a57 tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f36aadd-32b6-4c2d-8418-561a068e935e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:35 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-4316eef7-a5ea-4865-b660-a10c2be62a57 tempest-CreateVolumesFromImageTest-383500336 None] Volume volume-7ecaacff-20ad-40c5-a1d3-72bc86f9890e (7ecaacff-20ad-40c5-a1d3-72bc86f9890e): created successfully
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-4316eef7-a5ea-4865-b660-a10c2be62a57 tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f36aadd-32b6-4c2d-8418-561a068e935e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-4316eef7-a5ea-4865-b660-a10c2be62a57 tempest-CreateVolumesFromImageTest-383500336 None] Flow 'volume_create_manager' (afe8d895-4e15-4758-b1f5-04ffee72f021) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-49d3602c-47dd-4d63-b2a3-0f9e00704255 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-49d3602c-47dd-4d63-b2a3-0f9e00704255 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Flow 'volume_create_manager' (8b5061b9-2aa4-429c-8ed2-aa0c8ae72940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-49d3602c-47dd-4d63-b2a3-0f9e00704255 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b22e908a-04dc-4219-88f3-9a3b9e2308ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:35 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-4316eef7-a5ea-4865-b660-a10c2be62a57 tempest-CreateVolumesFromImageTest-383500336 None] Created volume successfully.
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-49d3602c-47dd-4d63-b2a3-0f9e00704255 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b22e908a-04dc-4219-88f3-9a3b9e2308ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1318332170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5813259-8c43-41d6-979d-12d098ce6c55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc7ca8745a8245d591931242f0a34cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:35Z,use_quota=True,user_id='ac51764edd3a4e81b3001b41efc416dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-49d3602c-47dd-4d63-b2a3-0f9e00704255 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ecefcbe-d98c-40b3-b2c0-8322ff43a0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-49d3602c-47dd-4d63-b2a3-0f9e00704255 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ecefcbe-d98c-40b3-b2c0-8322ff43a0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-49d3602c-47dd-4d63-b2a3-0f9e00704255 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2db8d04e-04bc-4735-bc24-c31fb56cdb3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-49d3602c-47dd-4d63-b2a3-0f9e00704255 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2db8d04e-04bc-4735-bc24-c31fb56cdb3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5813259-8c43-41d6-979d-12d098ce6c55', 'volume_name': 'volume-e5813259-8c43-41d6-979d-12d098ce6c55', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-49d3602c-47dd-4d63-b2a3-0f9e00704255 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d2227a9-377a-4ae3-aa4f-7437067ca551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-49d3602c-47dd-4d63-b2a3-0f9e00704255 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d2227a9-377a-4ae3-aa4f-7437067ca551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-49d3602c-47dd-4d63-b2a3-0f9e00704255 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ced4b25-9c0b-435e-8574-789c6f0cd4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:35 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-49d3602c-47dd-4d63-b2a3-0f9e00704255 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Volume e5813259-8c43-41d6-979d-12d098ce6c55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5813259-8c43-41d6-979d-12d098ce6c55', 'volume_size': 1}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-49d3602c-47dd-4d63-b2a3-0f9e00704255 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e917fc5-8db6-4f5b-b54e-5d12a9a263c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'de13b40b-ab46-4c42-b4d6-dff16d46c78b', 'volume_name': 'volume-de13b40b-ab46-4c42-b4d6-dff16d46c78b', 'volume_size': 1, 'image_id': 'ebfde8ed-5aa6-4420-89de-c708d8b2352a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ebfde8ed-5aa6-4420-89de-c708d8b2352a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e2f5d3f9ca580fb571536e1aa14f8007', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6bab1f7ad94f4911bfa9f1c13a2a22c7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f7b20815c0e9f2041fd21f66bd95f1a789fcecafe5f7a9300ce7fbc88496d7f075955483144af2b0ef7d57050c34048bd31cf0db7cb142e03a4257e57a1ff3ce', 'id': 'ebfde8ed-5aa6-4420-89de-c708d8b2352a', 'created_at': datetime.datetime(2026, 11, 4, 11, 29, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 29, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ebfde8ed-5aa6-4420-89de-c708d8b2352a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cc0592dc740>}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57d64f72-d8af-4849-9fd4-6046da168a8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57d64f72-d8af-4849-9fd4-6046da168a8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3b71e22-975c-43c3-9d2c-50dc9c85f6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:35 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Volume de13b40b-ab46-4c42-b4d6-dff16d46c78b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-de13b40b-ab46-4c42-b4d6-dff16d46c78b', 'volume_size': 1, 'image_id': 'ebfde8ed-5aa6-4420-89de-c708d8b2352a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ebfde8ed-5aa6-4420-89de-c708d8b2352a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e2f5d3f9ca580fb571536e1aa14f8007', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6bab1f7ad94f4911bfa9f1c13a2a22c7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f7b20815c0e9f2041fd21f66bd95f1a789fcecafe5f7a9300ce7fbc88496d7f075955483144af2b0ef7d57050c34048bd31cf0db7cb142e03a4257e57a1ff3ce', 'id': 'ebfde8ed-5aa6-4420-89de-c708d8b2352a', 'created_at': datetime.datetime(2026, 11, 4, 11, 29, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 29, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ebfde8ed-5aa6-4420-89de-c708d8b2352a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cc0592dc740>}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Trying to clone de13b40b-ab46-4c42-b4d6-dff16d46c78b from image ebfde8ed-5aa6-4420-89de-c708d8b2352a at location (None, [{'url': 'file:///opt/stack/data/glance/images/ebfde8ed-5aa6-4420-89de-c708d8b2352a', 'metadata': {}}]). {{(pid=87169) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5415ffd-fb26-490a-a511-392067cb66e7 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c5415ffd-fb26-490a-a511-392067cb66e7 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Flow 'volume_create_manager' (c7003f1d-db45-4393-9437-c892a5ada23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c5415ffd-fb26-490a-a511-392067cb66e7 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a493573-8c6a-4c9e-8f4c-b358537ff5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ebfde8ed-5aa6-4420-89de-c708d8b2352a_i78ak0nodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87169) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 04 12:29:35 devstack cinder-volume[87169]: INFO cinder.image.image_utils [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Image download 0.00 MB at 0.00 MB/s
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c5415ffd-fb26-490a-a511-392067cb66e7 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a493573-8c6a-4c9e-8f4c-b358537ff5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-452901264',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7b027ce-097f-4a86-8e60-b84782e65143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc7ca8745a8245d591931242f0a34cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:36Z,use_quota=True,user_id='ac51764edd3a4e81b3001b41efc416dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c5415ffd-fb26-490a-a511-392067cb66e7 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99a32f77-2e2c-4ea2-a426-0c07c7012e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c5415ffd-fb26-490a-a511-392067cb66e7 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99a32f77-2e2c-4ea2-a426-0c07c7012e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c5415ffd-fb26-490a-a511-392067cb66e7 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d3b446f-1d25-4e6f-814b-d6fce14eb015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c5415ffd-fb26-490a-a511-392067cb66e7 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d3b446f-1d25-4e6f-814b-d6fce14eb015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7b027ce-097f-4a86-8e60-b84782e65143', 'volume_name': 'volume-a7b027ce-097f-4a86-8e60-b84782e65143', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:35 devstack sudo[107071]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c5415ffd-fb26-490a-a511-392067cb66e7 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae6caac2-bed8-4719-8896-b943f4e34e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c5415ffd-fb26-490a-a511-392067cb66e7 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae6caac2-bed8-4719-8896-b943f4e34e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c5415ffd-fb26-490a-a511-392067cb66e7 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cb55e0c-a383-4640-8d51-4e3331549a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:35 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-c5415ffd-fb26-490a-a511-392067cb66e7 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Volume a7b027ce-097f-4a86-8e60-b84782e65143: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7b027ce-097f-4a86-8e60-b84782e65143', 'volume_size': 1}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c5415ffd-fb26-490a-a511-392067cb66e7 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3baa7c92-32d7-4cab-9b75-726643948d1b tempest-CreateVolumesFromImageTest-383500336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-80b34548-95fd-46f7-af61-24e96b9d331c 1073741824" returned: 0 in 0.667s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99d37ce-ff87-405f-8883-d7f5212395c0]: (4, 'raw') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ebfde8ed-5aa6-4420-89de-c708d8b2352a_i78ak0nodevstack@QuobyteHD {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3baa7c92-32d7-4cab-9b75-726643948d1b tempest-CreateVolumesFromImageTest-383500336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-80b34548-95fd-46f7-af61-24e96b9d331c {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:35 devstack sudo[107078]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-80b34548-95fd-46f7-af61-24e96b9d331c
Nov 04 12:29:35 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:36 devstack sudo[107077]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ebfde8ed-5aa6-4420-89de-c708d8b2352a_i78ak0nodevstack@QuobyteHD
Nov 04 12:29:36 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-5aa3f42f-8efb-4a5a-adec-5ff06c03a35d tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5aa3f42f-8efb-4a5a-adec-5ff06c03a35d tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Flow 'volume_create_manager' (ca3b7671-4734-4a6c-b210-bbd33f511901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5aa3f42f-8efb-4a5a-adec-5ff06c03a35d tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7625a7ef-1a9b-4100-b1fb-946971d9ac37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5aa3f42f-8efb-4a5a-adec-5ff06c03a35d tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7625a7ef-1a9b-4100-b1fb-946971d9ac37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1499198669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8032ad7c-98e7-4fb2-b68c-93799559766e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc7ca8745a8245d591931242f0a34cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:36Z,use_quota=True,user_id='ac51764edd3a4e81b3001b41efc416dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5aa3f42f-8efb-4a5a-adec-5ff06c03a35d tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (920aaf43-9b5b-4a52-ac3f-9de9507cbb4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5aa3f42f-8efb-4a5a-adec-5ff06c03a35d tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (920aaf43-9b5b-4a52-ac3f-9de9507cbb4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5aa3f42f-8efb-4a5a-adec-5ff06c03a35d tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f7b802d-5743-4039-be1c-0ce3030b722b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5aa3f42f-8efb-4a5a-adec-5ff06c03a35d tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f7b802d-5743-4039-be1c-0ce3030b722b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8032ad7c-98e7-4fb2-b68c-93799559766e', 'volume_name': 'volume-8032ad7c-98e7-4fb2-b68c-93799559766e', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5aa3f42f-8efb-4a5a-adec-5ff06c03a35d tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfab8acd-ed83-4100-8936-0259132a700b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5aa3f42f-8efb-4a5a-adec-5ff06c03a35d tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfab8acd-ed83-4100-8936-0259132a700b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5aa3f42f-8efb-4a5a-adec-5ff06c03a35d tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2a5951a-b8c1-4a42-bff6-53db98d904e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:36 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-5aa3f42f-8efb-4a5a-adec-5ff06c03a35d tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Volume 8032ad7c-98e7-4fb2-b68c-93799559766e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8032ad7c-98e7-4fb2-b68c-93799559766e', 'volume_size': 1}
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5aa3f42f-8efb-4a5a-adec-5ff06c03a35d tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:36 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3baa7c92-32d7-4cab-9b75-726643948d1b tempest-CreateVolumesFromImageTest-383500336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-80b34548-95fd-46f7-af61-24e96b9d331c" returned: 0 in 0.312s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3baa7c92-32d7-4cab-9b75-726643948d1b tempest-CreateVolumesFromImageTest-383500336 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3baa7c92-32d7-4cab-9b75-726643948d1b tempest-CreateVolumesFromImageTest-383500336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-6e2b711a-9548-4190-9549-1f9c5eb4291b tempest-CreateVolumesFromImageTest-383500336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.684s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-6e2b711a-9548-4190-9549-1f9c5eb4291b tempest-CreateVolumesFromImageTest-383500336 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:29:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-99127794',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=162480d3-4062-4f61-a7c1-173ed5c03081,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dc5d15453d54e3b8f7122c33d002373',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:32Z,use_quota=True,user_id='5122cd45e05649bc92c4c6c4f59d7044',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-6e2b711a-9548-4190-9549-1f9c5eb4291b tempest-CreateVolumesFromImageTest-383500336 None] Creating volume 162480d3-4062-4f61-a7c1-173ed5c03081 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-6e2b711a-9548-4190-9549-1f9c5eb4291b tempest-CreateVolumesFromImageTest-383500336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-6e2b711a-9548-4190-9549-1f9c5eb4291b tempest-CreateVolumesFromImageTest-383500336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-6e2b711a-9548-4190-9549-1f9c5eb4291b tempest-CreateVolumesFromImageTest-383500336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-6e2b711a-9548-4190-9549-1f9c5eb4291b tempest-CreateVolumesFromImageTest-383500336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-6e2b711a-9548-4190-9549-1f9c5eb4291b tempest-CreateVolumesFromImageTest-383500336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-6e2b711a-9548-4190-9549-1f9c5eb4291b tempest-CreateVolumesFromImageTest-383500336 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:29:36 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-6e2b711a-9548-4190-9549-1f9c5eb4291b tempest-CreateVolumesFromImageTest-383500336 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6e2b711a-9548-4190-9549-1f9c5eb4291b tempest-CreateVolumesFromImageTest-383500336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-162480d3-4062-4f61-a7c1-173ed5c03081 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3baa7c92-32d7-4cab-9b75-726643948d1b tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff7dd40a-4c42-401c-a1f5-ff6870082b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80b34548-95fd-46f7-af61-24e96b9d331c', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:36 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:36 devstack sudo[107084]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-162480d3-4062-4f61-a7c1-173ed5c03081 1073741824
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3baa7c92-32d7-4cab-9b75-726643948d1b tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a325d5-7832-4dde-b95f-e8ca8c70d8b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:36 devstack sudo[107084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ebfde8ed-5aa6-4420-89de-c708d8b2352a_i78ak0nodevstack@QuobyteHD" returned: 0 in 0.384s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebfde8ed-5aa6-4420-89de-c708d8b2352a_i78ak0nodevstack@QuobyteHD {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:36 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-3baa7c92-32d7-4cab-9b75-726643948d1b tempest-CreateVolumesFromImageTest-383500336 None] Volume volume-80b34548-95fd-46f7-af61-24e96b9d331c (80b34548-95fd-46f7-af61-24e96b9d331c): created successfully
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3baa7c92-32d7-4cab-9b75-726643948d1b tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49a325d5-7832-4dde-b95f-e8ca8c70d8b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3baa7c92-32d7-4cab-9b75-726643948d1b tempest-CreateVolumesFromImageTest-383500336 None] Flow 'volume_create_manager' (7ea81339-6293-463f-9316-d6f8aca74ff8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:29:36 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-3baa7c92-32d7-4cab-9b75-726643948d1b tempest-CreateVolumesFromImageTest-383500336 None] Created volume successfully.
Nov 04 12:29:36 devstack sudo[107086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebfde8ed-5aa6-4420-89de-c708d8b2352a_i78ak0nodevstack@QuobyteHD
Nov 04 12:29:36 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-42b213f6-45f9-4476-a3a5-63bb7dc45daf tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-42b213f6-45f9-4476-a3a5-63bb7dc45daf tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Flow 'volume_create_manager' (c0971e52-15cd-4529-9e0a-29b843d64ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-42b213f6-45f9-4476-a3a5-63bb7dc45daf tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee956b0f-147d-44f8-acf7-72649ccfcc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-42b213f6-45f9-4476-a3a5-63bb7dc45daf tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee956b0f-147d-44f8-acf7-72649ccfcc5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-445445085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6812048b-f5b7-4ae8-bed9-7b1b082da21b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc7ca8745a8245d591931242f0a34cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:36Z,use_quota=True,user_id='ac51764edd3a4e81b3001b41efc416dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-42b213f6-45f9-4476-a3a5-63bb7dc45daf tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a588f58-8641-4fd6-9d68-882581cf6c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-42b213f6-45f9-4476-a3a5-63bb7dc45daf tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a588f58-8641-4fd6-9d68-882581cf6c5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-42b213f6-45f9-4476-a3a5-63bb7dc45daf tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a09af617-a530-4548-83b9-6f6a560876be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-42b213f6-45f9-4476-a3a5-63bb7dc45daf tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a09af617-a530-4548-83b9-6f6a560876be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6812048b-f5b7-4ae8-bed9-7b1b082da21b', 'volume_name': 'volume-6812048b-f5b7-4ae8-bed9-7b1b082da21b', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-42b213f6-45f9-4476-a3a5-63bb7dc45daf tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8df45e6-55ff-438c-953f-9f783ffac14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-42b213f6-45f9-4476-a3a5-63bb7dc45daf tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8df45e6-55ff-438c-953f-9f783ffac14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-42b213f6-45f9-4476-a3a5-63bb7dc45daf tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc984d34-7c48-4c7f-bf90-b6ff7a780f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:36 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-42b213f6-45f9-4476-a3a5-63bb7dc45daf tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Volume 6812048b-f5b7-4ae8-bed9-7b1b082da21b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6812048b-f5b7-4ae8-bed9-7b1b082da21b', 'volume_size': 1}
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-42b213f6-45f9-4476-a3a5-63bb7dc45daf tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:36 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebfde8ed-5aa6-4420-89de-c708d8b2352a_i78ak0nodevstack@QuobyteHD" returned: 1 in 0.428s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebfde8ed-5aa6-4420-89de-c708d8b2352a_i78ak0nodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Temporary image ebfde8ed-5aa6-4420-89de-c708d8b2352a is fetched for user 06a09cda8c044d92b741703bce764a1f. {{(pid=87169) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0408519-902f-4aea-b4f7-ae2e8812a99b]: (4, 'raw') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ebfde8ed-5aa6-4420-89de-c708d8b2352a_i78ak0nodevstack@QuobyteHD {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:36 devstack sudo[107084]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6e2b711a-9548-4190-9549-1f9c5eb4291b tempest-CreateVolumesFromImageTest-383500336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-162480d3-4062-4f61-a7c1-173ed5c03081 1073741824" returned: 0 in 0.635s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6e2b711a-9548-4190-9549-1f9c5eb4291b tempest-CreateVolumesFromImageTest-383500336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-162480d3-4062-4f61-a7c1-173ed5c03081 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:36 devstack sudo[107096]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-162480d3-4062-4f61-a7c1-173ed5c03081
Nov 04 12:29:36 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:36 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ca18828-ccdc-45ab-bffb-78a1026c8767 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:29:36 devstack sudo[107095]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ebfde8ed-5aa6-4420-89de-c708d8b2352a_i78ak0nodevstack@QuobyteHD
Nov 04 12:29:36 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8ca18828-ccdc-45ab-bffb-78a1026c8767 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Flow 'volume_create_manager' (beaac800-b329-4d67-8d66-9efc49452845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:29:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8ca18828-ccdc-45ab-bffb-78a1026c8767 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccb5ef9d-3f38-4d02-9210-57f773eb3217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8ca18828-ccdc-45ab-bffb-78a1026c8767 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccb5ef9d-3f38-4d02-9210-57f773eb3217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:29:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1073283423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d82238e0-9e76-470a-8c56-a3326608726d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc7ca8745a8245d591931242f0a34cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:37Z,use_quota=True,user_id='ac51764edd3a4e81b3001b41efc416dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8ca18828-ccdc-45ab-bffb-78a1026c8767 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (923237ef-90c7-461b-ab75-1739d34e436e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8ca18828-ccdc-45ab-bffb-78a1026c8767 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (923237ef-90c7-461b-ab75-1739d34e436e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8ca18828-ccdc-45ab-bffb-78a1026c8767 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9feb912-9191-43c0-b850-1cd77ac28e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8ca18828-ccdc-45ab-bffb-78a1026c8767 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9feb912-9191-43c0-b850-1cd77ac28e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd82238e0-9e76-470a-8c56-a3326608726d', 'volume_name': 'volume-d82238e0-9e76-470a-8c56-a3326608726d', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8ca18828-ccdc-45ab-bffb-78a1026c8767 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5be6770b-ce6b-467d-99bb-5c33cc1e5b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8ca18828-ccdc-45ab-bffb-78a1026c8767 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5be6770b-ce6b-467d-99bb-5c33cc1e5b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8ca18828-ccdc-45ab-bffb-78a1026c8767 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1689b71-49f4-4c6b-acbb-5612ec77e7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:37 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-8ca18828-ccdc-45ab-bffb-78a1026c8767 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Volume d82238e0-9e76-470a-8c56-a3326608726d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d82238e0-9e76-470a-8c56-a3326608726d', 'volume_size': 1}
Nov 04 12:29:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8ca18828-ccdc-45ab-bffb-78a1026c8767 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:37 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6e2b711a-9548-4190-9549-1f9c5eb4291b tempest-CreateVolumesFromImageTest-383500336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-162480d3-4062-4f61-a7c1-173ed5c03081" returned: 0 in 0.267s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:37 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-6e2b711a-9548-4190-9549-1f9c5eb4291b tempest-CreateVolumesFromImageTest-383500336 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:29:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-6e2b711a-9548-4190-9549-1f9c5eb4291b tempest-CreateVolumesFromImageTest-383500336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:37 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-4c719bd0-6c7f-4249-ab54-045e1f427130 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.949s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6e2b711a-9548-4190-9549-1f9c5eb4291b tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (438f1181-bacc-487d-aa1f-c43d1706ce36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-162480d3-4062-4f61-a7c1-173ed5c03081', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6e2b711a-9548-4190-9549-1f9c5eb4291b tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7155e6b-004b-4ac0-9e48-130602c09a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ebfde8ed-5aa6-4420-89de-c708d8b2352a_i78ak0nodevstack@QuobyteHD" returned: 0 in 0.435s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebfde8ed-5aa6-4420-89de-c708d8b2352a_i78ak0nodevstack@QuobyteHD {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:37 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-4c719bd0-6c7f-4249-ab54-045e1f427130 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Creating offline snapshot ea4a9246-9d7f-4790-8d8e-a3708f5936ed of volume 1f08a3f0-ba1c-4e08-be81-259b3a20ecdf {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:29:37 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-6e2b711a-9548-4190-9549-1f9c5eb4291b tempest-CreateVolumesFromImageTest-383500336 None] Volume volume-162480d3-4062-4f61-a7c1-173ed5c03081 (162480d3-4062-4f61-a7c1-173ed5c03081): created successfully
Nov 04 12:29:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6e2b711a-9548-4190-9549-1f9c5eb4291b tempest-CreateVolumesFromImageTest-383500336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7155e6b-004b-4ac0-9e48-130602c09a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-6e2b711a-9548-4190-9549-1f9c5eb4291b tempest-CreateVolumesFromImageTest-383500336 None] Flow 'volume_create_manager' (ee1d3358-f217-4547-89f0-0eb9c4a5ee42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:29:37 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40c1c2c-5c49-4fb8-9cf5-a614f7be2e10]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:29:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4c719bd0-6c7f-4249-ab54-045e1f427130 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:37 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-6e2b711a-9548-4190-9549-1f9c5eb4291b tempest-CreateVolumesFromImageTest-383500336 None] Created volume successfully.
Nov 04 12:29:37 devstack sudo[107102]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebfde8ed-5aa6-4420-89de-c708d8b2352a_i78ak0nodevstack@QuobyteHD
Nov 04 12:29:37 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:37 devstack sudo[107103]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf
Nov 04 12:29:37 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:37 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebfde8ed-5aa6-4420-89de-c708d8b2352a_i78ak0nodevstack@QuobyteHD" returned: 1 in 0.345s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebfde8ed-5aa6-4420-89de-c708d8b2352a_i78ak0nodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 12:29:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:37 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4c719bd0-6c7f-4249-ab54-045e1f427130 tempest-CreateVolumesFromSnapshotTest-2032084862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf" returned: 0 in 0.365s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4c719bd0-6c7f-4249-ab54-045e1f427130 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf.ea4a9246-9d7f-4790-8d8e-a3708f5936ed 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:37 devstack sudo[107112]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf.ea4a9246-9d7f-4790-8d8e-a3708f5936ed 1G
Nov 04 12:29:37 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:38 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4c719bd0-6c7f-4249-ab54-045e1f427130 tempest-CreateVolumesFromSnapshotTest-2032084862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf.ea4a9246-9d7f-4790-8d8e-a3708f5936ed 1G" returned: 0 in 0.418s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4c719bd0-6c7f-4249-ab54-045e1f427130 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf.ea4a9246-9d7f-4790-8d8e-a3708f5936ed {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:38 devstack sudo[107117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf.ea4a9246-9d7f-4790-8d8e-a3708f5936ed
Nov 04 12:29:38 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:38 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fbdd92e8-ce37-4d9c-96cb-e96d200c7262 tempest-CreateVolumesFromImageTest-383500336 None] Acquiring lock "cinder-162480d3-4062-4f61-a7c1-173ed5c03081-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:29:38 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fbdd92e8-ce37-4d9c-96cb-e96d200c7262 tempest-CreateVolumesFromImageTest-383500336 None] Lock "cinder-162480d3-4062-4f61-a7c1-173ed5c03081-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:29:38 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fbdd92e8-ce37-4d9c-96cb-e96d200c7262 tempest-CreateVolumesFromImageTest-383500336 None] Acquiring lock "cinder-quobyte-162480d3-4062-4f61-a7c1-173ed5c03081" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:29:38 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fbdd92e8-ce37-4d9c-96cb-e96d200c7262 tempest-CreateVolumesFromImageTest-383500336 None] Lock "cinder-quobyte-162480d3-4062-4f61-a7c1-173ed5c03081" acquired by "delete_volume" :: waited 0.014s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:29:38 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebdf658-20c7-4cd6-bd45-dc03667c3115]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:29:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fbdd92e8-ce37-4d9c-96cb-e96d200c7262 tempest-CreateVolumesFromImageTest-383500336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-162480d3-4062-4f61-a7c1-173ed5c03081 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:38 devstack sudo[107119]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-162480d3-4062-4f61-a7c1-173ed5c03081
Nov 04 12:29:38 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:38 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4c719bd0-6c7f-4249-ab54-045e1f427130 tempest-CreateVolumesFromSnapshotTest-2032084862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf.ea4a9246-9d7f-4790-8d8e-a3708f5936ed" returned: 0 in 0.318s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:38 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-4c719bd0-6c7f-4249-ab54-045e1f427130 tempest-CreateVolumesFromSnapshotTest-2032084862 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf.ea4a9246-9d7f-4790-8d8e-a3708f5936ed is being set with open permissions: ugo+rw
Nov 04 12:29:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4c719bd0-6c7f-4249-ab54-045e1f427130 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf.ea4a9246-9d7f-4790-8d8e-a3708f5936ed {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:38 devstack sudo[107124]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf.ea4a9246-9d7f-4790-8d8e-a3708f5936ed
Nov 04 12:29:38 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:38 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fbdd92e8-ce37-4d9c-96cb-e96d200c7262 tempest-CreateVolumesFromImageTest-383500336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-162480d3-4062-4f61-a7c1-173ed5c03081" returned: 0 in 0.380s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fbdd92e8-ce37-4d9c-96cb-e96d200c7262 tempest-CreateVolumesFromImageTest-383500336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-162480d3-4062-4f61-a7c1-173ed5c03081 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:38 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4c719bd0-6c7f-4249-ab54-045e1f427130 tempest-CreateVolumesFromSnapshotTest-2032084862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf.ea4a9246-9d7f-4790-8d8e-a3708f5936ed" returned: 0 in 0.266s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:38 devstack sudo[107144]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-162480d3-4062-4f61-a7c1-173ed5c03081
Nov 04 12:29:38 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4c719bd0-6c7f-4249-ab54-045e1f427130 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:38 devstack sudo[107166]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf.info
Nov 04 12:29:38 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:38 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fbdd92e8-ce37-4d9c-96cb-e96d200c7262 tempest-CreateVolumesFromImageTest-383500336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-162480d3-4062-4f61-a7c1-173ed5c03081" returned: 0 in 0.331s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:38 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fbdd92e8-ce37-4d9c-96cb-e96d200c7262 tempest-CreateVolumesFromImageTest-383500336 None] Lock "cinder-quobyte-162480d3-4062-4f61-a7c1-173ed5c03081" released by "delete_volume" :: held 0.761s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:29:38 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4c719bd0-6c7f-4249-ab54-045e1f427130 tempest-CreateVolumesFromSnapshotTest-2032084862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf.info" returned: 0 in 0.290s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:39 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-4c719bd0-6c7f-4249-ab54-045e1f427130 tempest-CreateVolumesFromSnapshotTest-2032084862 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf.info is being set with open permissions: ugo+rw
Nov 04 12:29:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4c719bd0-6c7f-4249-ab54-045e1f427130 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:39 devstack sudo[107172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf.info
Nov 04 12:29:39 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:39 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-fbdd92e8-ce37-4d9c-96cb-e96d200c7262 tempest-CreateVolumesFromImageTest-383500336 None] Created reservations ['0f4c0015-aba3-4656-972b-a3774650c55d', '4ef72cd3-e5f3-447d-a6c7-5de5700e6340', 'c0069935-9624-4a08-8eec-f800c76ab14f', 'b5003418-8f59-43d3-9627-5e5ad0f638aa'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:29:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-fbdd92e8-ce37-4d9c-96cb-e96d200c7262 tempest-CreateVolumesFromImageTest-383500336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-fbdd92e8-ce37-4d9c-96cb-e96d200c7262 tempest-CreateVolumesFromImageTest-383500336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:39 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-fbdd92e8-ce37-4d9c-96cb-e96d200c7262 tempest-CreateVolumesFromImageTest-383500336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:29:39 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-fbdd92e8-ce37-4d9c-96cb-e96d200c7262 tempest-CreateVolumesFromImageTest-383500336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:29:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-fbdd92e8-ce37-4d9c-96cb-e96d200c7262 tempest-CreateVolumesFromImageTest-383500336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fbdd92e8-ce37-4d9c-96cb-e96d200c7262 tempest-CreateVolumesFromImageTest-383500336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:39 devstack sudo[107174]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:29:39 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:39 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4c719bd0-6c7f-4249-ab54-045e1f427130 tempest-CreateVolumesFromSnapshotTest-2032084862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf.info" returned: 0 in 0.241s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-4c719bd0-6c7f-4249-ab54-045e1f427130 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.044s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-49d3602c-47dd-4d63-b2a3-0f9e00704255 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.844s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:39 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-49d3602c-47dd-4d63-b2a3-0f9e00704255 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1318332170',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5813259-8c43-41d6-979d-12d098ce6c55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc7ca8745a8245d591931242f0a34cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:35Z,use_quota=True,user_id='ac51764edd3a4e81b3001b41efc416dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:29:39 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-49d3602c-47dd-4d63-b2a3-0f9e00704255 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Creating volume e5813259-8c43-41d6-979d-12d098ce6c55 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:29:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-49d3602c-47dd-4d63-b2a3-0f9e00704255 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-49d3602c-47dd-4d63-b2a3-0f9e00704255 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:39 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-49d3602c-47dd-4d63-b2a3-0f9e00704255 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:29:39 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-49d3602c-47dd-4d63-b2a3-0f9e00704255 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:29:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-49d3602c-47dd-4d63-b2a3-0f9e00704255 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:39 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-49d3602c-47dd-4d63-b2a3-0f9e00704255 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:29:39 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-49d3602c-47dd-4d63-b2a3-0f9e00704255 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:29:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-49d3602c-47dd-4d63-b2a3-0f9e00704255 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e5813259-8c43-41d6-979d-12d098ce6c55 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:39 devstack sudo[107177]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e5813259-8c43-41d6-979d-12d098ce6c55 1073741824
Nov 04 12:29:39 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:39 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-4c719bd0-6c7f-4249-ab54-045e1f427130 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Create snapshot completed successfully
Nov 04 12:29:39 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-730a8d9d-e0ea-467a-8474-81656cbc52a2 tempest-CreateVolumesFromImageTest-383500336 None] Acquiring lock "cinder-80b34548-95fd-46f7-af61-24e96b9d331c-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:29:39 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-730a8d9d-e0ea-467a-8474-81656cbc52a2 tempest-CreateVolumesFromImageTest-383500336 None] Lock "cinder-80b34548-95fd-46f7-af61-24e96b9d331c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:29:39 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-730a8d9d-e0ea-467a-8474-81656cbc52a2 tempest-CreateVolumesFromImageTest-383500336 None] Acquiring lock "cinder-quobyte-80b34548-95fd-46f7-af61-24e96b9d331c" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:29:39 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-730a8d9d-e0ea-467a-8474-81656cbc52a2 tempest-CreateVolumesFromImageTest-383500336 None] Lock "cinder-quobyte-80b34548-95fd-46f7-af61-24e96b9d331c" acquired by "delete_volume" :: waited 0.016s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:29:39 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fbdd92e8-ce37-4d9c-96cb-e96d200c7262 tempest-CreateVolumesFromImageTest-383500336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.306s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:39 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-fbdd92e8-ce37-4d9c-96cb-e96d200c7262 tempest-CreateVolumesFromImageTest-383500336 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:29:39 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-fbdd92e8-ce37-4d9c-96cb-e96d200c7262 tempest-CreateVolumesFromImageTest-383500336 None] Deleted volume successfully.
Nov 04 12:29:39 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[03fd8fc6-9a2b-4b15-a028-6b8d97260355]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:29:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-730a8d9d-e0ea-467a-8474-81656cbc52a2 tempest-CreateVolumesFromImageTest-383500336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-80b34548-95fd-46f7-af61-24e96b9d331c {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:39 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fbdd92e8-ce37-4d9c-96cb-e96d200c7262 tempest-CreateVolumesFromImageTest-383500336 None] Lock "cinder-162480d3-4062-4f61-a7c1-173ed5c03081-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:29:39 devstack sudo[107180]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-80b34548-95fd-46f7-af61-24e96b9d331c
Nov 04 12:29:39 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:39 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-49d3602c-47dd-4d63-b2a3-0f9e00704255 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e5813259-8c43-41d6-979d-12d098ce6c55 1073741824" returned: 0 in 0.478s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-49d3602c-47dd-4d63-b2a3-0f9e00704255 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e5813259-8c43-41d6-979d-12d098ce6c55 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:39 devstack sudo[107188]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e5813259-8c43-41d6-979d-12d098ce6c55
Nov 04 12:29:39 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:39 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-730a8d9d-e0ea-467a-8474-81656cbc52a2 tempest-CreateVolumesFromImageTest-383500336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-80b34548-95fd-46f7-af61-24e96b9d331c" returned: 0 in 0.423s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-730a8d9d-e0ea-467a-8474-81656cbc52a2 tempest-CreateVolumesFromImageTest-383500336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-80b34548-95fd-46f7-af61-24e96b9d331c {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:39 devstack sudo[107190]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-80b34548-95fd-46f7-af61-24e96b9d331c
Nov 04 12:29:39 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-645e4bd5-8418-447d-a7a2-9564d691f98e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:29:40 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-645e4bd5-8418-447d-a7a2-9564d691f98e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Flow 'volume_create_manager' (f2158eb5-7d88-45eb-bd72-9f617c9d9980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-645e4bd5-8418-447d-a7a2-9564d691f98e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcb64b40-99b2-44bd-b378-d759cb495130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-49d3602c-47dd-4d63-b2a3-0f9e00704255 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e5813259-8c43-41d6-979d-12d098ce6c55" returned: 0 in 0.322s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-49d3602c-47dd-4d63-b2a3-0f9e00704255 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-49d3602c-47dd-4d63-b2a3-0f9e00704255 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c5415ffd-fb26-490a-a511-392067cb66e7 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.259s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c5415ffd-fb26-490a-a511-392067cb66e7 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-452901264',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7b027ce-097f-4a86-8e60-b84782e65143,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc7ca8745a8245d591931242f0a34cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:36Z,use_quota=True,user_id='ac51764edd3a4e81b3001b41efc416dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-c5415ffd-fb26-490a-a511-392067cb66e7 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Creating volume a7b027ce-097f-4a86-8e60-b84782e65143 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c5415ffd-fb26-490a-a511-392067cb66e7 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c5415ffd-fb26-490a-a511-392067cb66e7 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c5415ffd-fb26-490a-a511-392067cb66e7 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c5415ffd-fb26-490a-a511-392067cb66e7 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c5415ffd-fb26-490a-a511-392067cb66e7 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c5415ffd-fb26-490a-a511-392067cb66e7 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:29:40 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-c5415ffd-fb26-490a-a511-392067cb66e7 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c5415ffd-fb26-490a-a511-392067cb66e7 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a7b027ce-097f-4a86-8e60-b84782e65143 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-645e4bd5-8418-447d-a7a2-9564d691f98e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcb64b40-99b2-44bd-b378-d759cb495130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1339686437',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a325bb1-89ba-4877-98fe-85bc253b65c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4bd7e2af9846e1ac25525998457444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:40Z,use_quota=True,user_id='d7ee65def192460f91e684a26a271088',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:40 devstack sudo[107193]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a7b027ce-097f-4a86-8e60-b84782e65143 1073741824
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-645e4bd5-8418-447d-a7a2-9564d691f98e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1dc5999-27cd-4872-94ba-e3d4b1df83cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:40 devstack sudo[107193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-645e4bd5-8418-447d-a7a2-9564d691f98e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1dc5999-27cd-4872-94ba-e3d4b1df83cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-645e4bd5-8418-447d-a7a2-9564d691f98e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeba4543-8865-4530-b29c-0e4404d55664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-645e4bd5-8418-447d-a7a2-9564d691f98e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeba4543-8865-4530-b29c-0e4404d55664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a325bb1-89ba-4877-98fe-85bc253b65c0', 'volume_name': 'volume-3a325bb1-89ba-4877-98fe-85bc253b65c0', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-645e4bd5-8418-447d-a7a2-9564d691f98e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3384a3e-d5b9-4d7d-85d8-fb01ab32d075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-645e4bd5-8418-447d-a7a2-9564d691f98e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3384a3e-d5b9-4d7d-85d8-fb01ab32d075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-645e4bd5-8418-447d-a7a2-9564d691f98e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b1fcc95-016e-4811-86d8-aff373c520d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:40 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-645e4bd5-8418-447d-a7a2-9564d691f98e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Volume 3a325bb1-89ba-4877-98fe-85bc253b65c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a325bb1-89ba-4877-98fe-85bc253b65c0', 'volume_size': 1}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-645e4bd5-8418-447d-a7a2-9564d691f98e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-49d3602c-47dd-4d63-b2a3-0f9e00704255 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ced4b25-9c0b-435e-8574-789c6f0cd4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5813259-8c43-41d6-979d-12d098ce6c55', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:40 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-49d3602c-47dd-4d63-b2a3-0f9e00704255 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3994247-9c4c-4bdd-9d0f-9053242953ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-730a8d9d-e0ea-467a-8474-81656cbc52a2 tempest-CreateVolumesFromImageTest-383500336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-80b34548-95fd-46f7-af61-24e96b9d331c" returned: 0 in 0.412s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-730a8d9d-e0ea-467a-8474-81656cbc52a2 tempest-CreateVolumesFromImageTest-383500336 None] Lock "cinder-quobyte-80b34548-95fd-46f7-af61-24e96b9d331c" released by "delete_volume" :: held 0.885s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:29:40 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-49d3602c-47dd-4d63-b2a3-0f9e00704255 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Volume volume-e5813259-8c43-41d6-979d-12d098ce6c55 (e5813259-8c43-41d6-979d-12d098ce6c55): created successfully
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-49d3602c-47dd-4d63-b2a3-0f9e00704255 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f3994247-9c4c-4bdd-9d0f-9053242953ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-49d3602c-47dd-4d63-b2a3-0f9e00704255 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Flow 'volume_create_manager' (8b5061b9-2aa4-429c-8ed2-aa0c8ae72940) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:29:40 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-49d3602c-47dd-4d63-b2a3-0f9e00704255 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Created volume successfully.
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-730a8d9d-e0ea-467a-8474-81656cbc52a2 tempest-CreateVolumesFromImageTest-383500336 None] Created reservations ['3a10c805-38c9-4bdf-8457-3a590b855c2a', 'ab1d8f31-1ff9-4cc2-b05e-780880ad8494', 'ae12bcb3-a09c-4105-a061-133cf1cd6956', 'e7b1561a-1550-4ad1-bbe6-783fc454ed0e'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-730a8d9d-e0ea-467a-8474-81656cbc52a2 tempest-CreateVolumesFromImageTest-383500336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-730a8d9d-e0ea-467a-8474-81656cbc52a2 tempest-CreateVolumesFromImageTest-383500336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-730a8d9d-e0ea-467a-8474-81656cbc52a2 tempest-CreateVolumesFromImageTest-383500336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-730a8d9d-e0ea-467a-8474-81656cbc52a2 tempest-CreateVolumesFromImageTest-383500336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-730a8d9d-e0ea-467a-8474-81656cbc52a2 tempest-CreateVolumesFromImageTest-383500336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-730a8d9d-e0ea-467a-8474-81656cbc52a2 tempest-CreateVolumesFromImageTest-383500336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:40 devstack sudo[107199]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:29:40 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5646b992-18cf-430a-b281-97c6bfc66ae5 tempest-CreateVolumesFromImageTest-383500336 None] Acquiring lock "cinder-7ecaacff-20ad-40c5-a1d3-72bc86f9890e-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5646b992-18cf-430a-b281-97c6bfc66ae5 tempest-CreateVolumesFromImageTest-383500336 None] Lock "cinder-7ecaacff-20ad-40c5-a1d3-72bc86f9890e-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f837125-81d1-4a03-8610-f0a55a60d474 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2f837125-81d1-4a03-8610-f0a55a60d474 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Flow 'volume_create_manager' (449670c8-44f8-4475-86d3-805eb05e2e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2f837125-81d1-4a03-8610-f0a55a60d474 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cb88d92-6092-4e69-bbab-e9ebe3eb74c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:40 devstack sudo[107193]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2f837125-81d1-4a03-8610-f0a55a60d474 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cb88d92-6092-4e69-bbab-e9ebe3eb74c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1032415527',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a9576fc-2d7d-46eb-ba4d-08af75b946d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4bd7e2af9846e1ac25525998457444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:41Z,use_quota=True,user_id='d7ee65def192460f91e684a26a271088',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2f837125-81d1-4a03-8610-f0a55a60d474 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cedb8d71-dc9a-42e7-94cb-05738cfd30e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2f837125-81d1-4a03-8610-f0a55a60d474 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cedb8d71-dc9a-42e7-94cb-05738cfd30e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2f837125-81d1-4a03-8610-f0a55a60d474 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bcc45af-07e1-40bb-991b-f987a52af77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2f837125-81d1-4a03-8610-f0a55a60d474 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bcc45af-07e1-40bb-991b-f987a52af77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a9576fc-2d7d-46eb-ba4d-08af75b946d6', 'volume_name': 'volume-7a9576fc-2d7d-46eb-ba4d-08af75b946d6', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2f837125-81d1-4a03-8610-f0a55a60d474 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47a04ccc-359c-4112-8ff5-758c964957e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2f837125-81d1-4a03-8610-f0a55a60d474 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47a04ccc-359c-4112-8ff5-758c964957e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2f837125-81d1-4a03-8610-f0a55a60d474 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68041ae4-398f-4700-a0c4-958dc1e8da38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:40 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-2f837125-81d1-4a03-8610-f0a55a60d474 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Volume 7a9576fc-2d7d-46eb-ba4d-08af75b946d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a9576fc-2d7d-46eb-ba4d-08af75b946d6', 'volume_size': 1}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2f837125-81d1-4a03-8610-f0a55a60d474 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5646b992-18cf-430a-b281-97c6bfc66ae5 tempest-CreateVolumesFromImageTest-383500336 None] Acquiring lock "cinder-quobyte-7ecaacff-20ad-40c5-a1d3-72bc86f9890e" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c5415ffd-fb26-490a-a511-392067cb66e7 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a7b027ce-097f-4a86-8e60-b84782e65143 1073741824" returned: 0 in 0.646s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5646b992-18cf-430a-b281-97c6bfc66ae5 tempest-CreateVolumesFromImageTest-383500336 None] Lock "cinder-quobyte-7ecaacff-20ad-40c5-a1d3-72bc86f9890e" acquired by "delete_volume" :: waited 0.027s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:29:40 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-730a8d9d-e0ea-467a-8474-81656cbc52a2 tempest-CreateVolumesFromImageTest-383500336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.387s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-730a8d9d-e0ea-467a-8474-81656cbc52a2 tempest-CreateVolumesFromImageTest-383500336 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8706f8a-9245-4b09-bf2d-0438b5cb2d84]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c5415ffd-fb26-490a-a511-392067cb66e7 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a7b027ce-097f-4a86-8e60-b84782e65143 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5646b992-18cf-430a-b281-97c6bfc66ae5 tempest-CreateVolumesFromImageTest-383500336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-7ecaacff-20ad-40c5-a1d3-72bc86f9890e {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:40 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-730a8d9d-e0ea-467a-8474-81656cbc52a2 tempest-CreateVolumesFromImageTest-383500336 None] Deleted volume successfully.
Nov 04 12:29:40 devstack sudo[107203]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a7b027ce-097f-4a86-8e60-b84782e65143
Nov 04 12:29:40 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:40 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-730a8d9d-e0ea-467a-8474-81656cbc52a2 tempest-CreateVolumesFromImageTest-383500336 None] Lock "cinder-80b34548-95fd-46f7-af61-24e96b9d331c-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:29:41 devstack sudo[107204]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-7ecaacff-20ad-40c5-a1d3-72bc86f9890e
Nov 04 12:29:41 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cf43503-0d5e-4344-af08-fb2134953d06 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7cf43503-0d5e-4344-af08-fb2134953d06 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Flow 'volume_create_manager' (3964fbd9-a5b0-45be-a491-62c5d21c85d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7cf43503-0d5e-4344-af08-fb2134953d06 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d61f7436-0c79-4bc8-897e-3e517a157cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7cf43503-0d5e-4344-af08-fb2134953d06 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d61f7436-0c79-4bc8-897e-3e517a157cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-150811820',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72141e77-2ffe-4a62-b17e-3c16648574d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4bd7e2af9846e1ac25525998457444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:41Z,use_quota=True,user_id='d7ee65def192460f91e684a26a271088',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7cf43503-0d5e-4344-af08-fb2134953d06 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e695eb0-f325-4048-92fb-b5bb8d5597eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7cf43503-0d5e-4344-af08-fb2134953d06 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e695eb0-f325-4048-92fb-b5bb8d5597eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7cf43503-0d5e-4344-af08-fb2134953d06 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26323389-07d4-4575-9b39-27c3b4023adf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7cf43503-0d5e-4344-af08-fb2134953d06 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26323389-07d4-4575-9b39-27c3b4023adf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72141e77-2ffe-4a62-b17e-3c16648574d4', 'volume_name': 'volume-72141e77-2ffe-4a62-b17e-3c16648574d4', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7cf43503-0d5e-4344-af08-fb2134953d06 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (256ee9ab-2377-4a1d-87b9-520f680eabe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7cf43503-0d5e-4344-af08-fb2134953d06 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (256ee9ab-2377-4a1d-87b9-520f680eabe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7cf43503-0d5e-4344-af08-fb2134953d06 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8747a81e-b15f-4412-92f1-6a4df69cc77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:41 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-7cf43503-0d5e-4344-af08-fb2134953d06 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Volume 72141e77-2ffe-4a62-b17e-3c16648574d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72141e77-2ffe-4a62-b17e-3c16648574d4', 'volume_size': 1}
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7cf43503-0d5e-4344-af08-fb2134953d06 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:41 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c5415ffd-fb26-490a-a511-392067cb66e7 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a7b027ce-097f-4a86-8e60-b84782e65143" returned: 0 in 0.349s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c5415ffd-fb26-490a-a511-392067cb66e7 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c5415ffd-fb26-490a-a511-392067cb66e7 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5aa3f42f-8efb-4a5a-adec-5ff06c03a35d tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5aa3f42f-8efb-4a5a-adec-5ff06c03a35d tempest-CreateVolumesFromSourceVolumeTest-147450298 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1499198669',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8032ad7c-98e7-4fb2-b68c-93799559766e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc7ca8745a8245d591931242f0a34cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:36Z,use_quota=True,user_id='ac51764edd3a4e81b3001b41efc416dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-5aa3f42f-8efb-4a5a-adec-5ff06c03a35d tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Creating volume 8032ad7c-98e7-4fb2-b68c-93799559766e {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5aa3f42f-8efb-4a5a-adec-5ff06c03a35d tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5aa3f42f-8efb-4a5a-adec-5ff06c03a35d tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5aa3f42f-8efb-4a5a-adec-5ff06c03a35d tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5aa3f42f-8efb-4a5a-adec-5ff06c03a35d tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5aa3f42f-8efb-4a5a-adec-5ff06c03a35d tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5aa3f42f-8efb-4a5a-adec-5ff06c03a35d tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:29:41 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-5aa3f42f-8efb-4a5a-adec-5ff06c03a35d tempest-CreateVolumesFromSourceVolumeTest-147450298 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5aa3f42f-8efb-4a5a-adec-5ff06c03a35d tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8032ad7c-98e7-4fb2-b68c-93799559766e 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c5415ffd-fb26-490a-a511-392067cb66e7 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cb55e0c-a383-4640-8d51-4e3331549a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7b027ce-097f-4a86-8e60-b84782e65143', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:41 devstack sudo[107210]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8032ad7c-98e7-4fb2-b68c-93799559766e 1073741824
Nov 04 12:29:41 devstack sudo[107210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c5415ffd-fb26-490a-a511-392067cb66e7 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b44627e6-d79a-4b76-85f9-9720e3ef6b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:41 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-c5415ffd-fb26-490a-a511-392067cb66e7 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Volume volume-a7b027ce-097f-4a86-8e60-b84782e65143 (a7b027ce-097f-4a86-8e60-b84782e65143): created successfully
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c5415ffd-fb26-490a-a511-392067cb66e7 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b44627e6-d79a-4b76-85f9-9720e3ef6b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-c5415ffd-fb26-490a-a511-392067cb66e7 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Flow 'volume_create_manager' (c7003f1d-db45-4393-9437-c892a5ada23b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:29:41 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-c5415ffd-fb26-490a-a511-392067cb66e7 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Created volume successfully.
Nov 04 12:29:41 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5646b992-18cf-430a-b281-97c6bfc66ae5 tempest-CreateVolumesFromImageTest-383500336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-7ecaacff-20ad-40c5-a1d3-72bc86f9890e" returned: 0 in 0.524s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5646b992-18cf-430a-b281-97c6bfc66ae5 tempest-CreateVolumesFromImageTest-383500336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-7ecaacff-20ad-40c5-a1d3-72bc86f9890e {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:41 devstack sudo[107213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-7ecaacff-20ad-40c5-a1d3-72bc86f9890e
Nov 04 12:29:41 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-40cd11e5-c7f2-45c4-9d29-f0ecc20bc912 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-40cd11e5-c7f2-45c4-9d29-f0ecc20bc912 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Flow 'volume_create_manager' (dec5e47c-3534-4f26-b11f-23fd589d3df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-40cd11e5-c7f2-45c4-9d29-f0ecc20bc912 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de16f1c0-ece0-41a2-aae7-d3ce01b571f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-40cd11e5-c7f2-45c4-9d29-f0ecc20bc912 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de16f1c0-ece0-41a2-aae7-d3ce01b571f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-97386391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e8f47f4-b73d-4fb1-a7f6-26cceafcf29e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4bd7e2af9846e1ac25525998457444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:42Z,use_quota=True,user_id='d7ee65def192460f91e684a26a271088',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-40cd11e5-c7f2-45c4-9d29-f0ecc20bc912 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d9ce61d-9a26-4ed3-be47-f149899bc24e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-40cd11e5-c7f2-45c4-9d29-f0ecc20bc912 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d9ce61d-9a26-4ed3-be47-f149899bc24e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-40cd11e5-c7f2-45c4-9d29-f0ecc20bc912 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a91b620c-87e1-47b7-8aa4-db5752bfc4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-40cd11e5-c7f2-45c4-9d29-f0ecc20bc912 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a91b620c-87e1-47b7-8aa4-db5752bfc4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e8f47f4-b73d-4fb1-a7f6-26cceafcf29e', 'volume_name': 'volume-9e8f47f4-b73d-4fb1-a7f6-26cceafcf29e', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-40cd11e5-c7f2-45c4-9d29-f0ecc20bc912 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b82bfef-3271-4605-bb48-bbfa0494de03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-40cd11e5-c7f2-45c4-9d29-f0ecc20bc912 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b82bfef-3271-4605-bb48-bbfa0494de03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-40cd11e5-c7f2-45c4-9d29-f0ecc20bc912 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c265e122-0bd3-4712-b40d-90e8105b8a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:41 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-40cd11e5-c7f2-45c4-9d29-f0ecc20bc912 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Volume 9e8f47f4-b73d-4fb1-a7f6-26cceafcf29e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e8f47f4-b73d-4fb1-a7f6-26cceafcf29e', 'volume_size': 1}
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-40cd11e5-c7f2-45c4-9d29-f0ecc20bc912 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:41 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5646b992-18cf-430a-b281-97c6bfc66ae5 tempest-CreateVolumesFromImageTest-383500336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-7ecaacff-20ad-40c5-a1d3-72bc86f9890e" returned: 0 in 0.378s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5646b992-18cf-430a-b281-97c6bfc66ae5 tempest-CreateVolumesFromImageTest-383500336 None] Lock "cinder-quobyte-7ecaacff-20ad-40c5-a1d3-72bc86f9890e" released by "delete_volume" :: held 0.996s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:29:41 devstack sudo[107210]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5aa3f42f-8efb-4a5a-adec-5ff06c03a35d tempest-CreateVolumesFromSourceVolumeTest-147450298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8032ad7c-98e7-4fb2-b68c-93799559766e 1073741824" returned: 0 in 0.589s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5aa3f42f-8efb-4a5a-adec-5ff06c03a35d tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8032ad7c-98e7-4fb2-b68c-93799559766e {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:41 devstack sudo[107221]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8032ad7c-98e7-4fb2-b68c-93799559766e
Nov 04 12:29:41 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-5646b992-18cf-430a-b281-97c6bfc66ae5 tempest-CreateVolumesFromImageTest-383500336 None] Created reservations ['58d4a636-304b-46ad-b5f8-2da433ea6f51', '5a30329a-3678-4e46-9883-42135ab8a807', 'a2c44634-7413-46ca-aced-f9357f13bbb0', 'ad83254b-653f-44bb-9663-352770a9f3ba'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5646b992-18cf-430a-b281-97c6bfc66ae5 tempest-CreateVolumesFromImageTest-383500336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5646b992-18cf-430a-b281-97c6bfc66ae5 tempest-CreateVolumesFromImageTest-383500336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:41 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5646b992-18cf-430a-b281-97c6bfc66ae5 tempest-CreateVolumesFromImageTest-383500336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5646b992-18cf-430a-b281-97c6bfc66ae5 tempest-CreateVolumesFromImageTest-383500336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5646b992-18cf-430a-b281-97c6bfc66ae5 tempest-CreateVolumesFromImageTest-383500336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5646b992-18cf-430a-b281-97c6bfc66ae5 tempest-CreateVolumesFromImageTest-383500336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-66058e89-4e17-4f38-9be8-986bce800869 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:29:42 devstack sudo[107223]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:29:42 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-66058e89-4e17-4f38-9be8-986bce800869 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Flow 'volume_create_manager' (794e4771-524f-4c66-8ea2-aeda7633918c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-66058e89-4e17-4f38-9be8-986bce800869 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d5d18e4-6d4e-425c-a1b4-c18dd1731365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-66058e89-4e17-4f38-9be8-986bce800869 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d5d18e4-6d4e-425c-a1b4-c18dd1731365) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1210833810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a60204fb-8bde-45b0-8b20-4f210e2a16d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4bd7e2af9846e1ac25525998457444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:42Z,use_quota=True,user_id='d7ee65def192460f91e684a26a271088',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-66058e89-4e17-4f38-9be8-986bce800869 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cec28082-8970-4e08-8be2-fa40cef74fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-66058e89-4e17-4f38-9be8-986bce800869 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cec28082-8970-4e08-8be2-fa40cef74fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-66058e89-4e17-4f38-9be8-986bce800869 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fad4bed-3579-4982-9faa-1c701869ecb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-66058e89-4e17-4f38-9be8-986bce800869 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fad4bed-3579-4982-9faa-1c701869ecb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a60204fb-8bde-45b0-8b20-4f210e2a16d2', 'volume_name': 'volume-a60204fb-8bde-45b0-8b20-4f210e2a16d2', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-66058e89-4e17-4f38-9be8-986bce800869 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3d134df-8c54-4700-8f8c-1e7dc6bd722f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-66058e89-4e17-4f38-9be8-986bce800869 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3d134df-8c54-4700-8f8c-1e7dc6bd722f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-66058e89-4e17-4f38-9be8-986bce800869 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (601a3f2a-b474-415f-8844-a0453259f0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:42 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-66058e89-4e17-4f38-9be8-986bce800869 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Volume a60204fb-8bde-45b0-8b20-4f210e2a16d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a60204fb-8bde-45b0-8b20-4f210e2a16d2', 'volume_size': 1}
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-66058e89-4e17-4f38-9be8-986bce800869 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:42 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5aa3f42f-8efb-4a5a-adec-5ff06c03a35d tempest-CreateVolumesFromSourceVolumeTest-147450298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8032ad7c-98e7-4fb2-b68c-93799559766e" returned: 0 in 0.253s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5aa3f42f-8efb-4a5a-adec-5ff06c03a35d tempest-CreateVolumesFromSourceVolumeTest-147450298 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5aa3f42f-8efb-4a5a-adec-5ff06c03a35d tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-42b213f6-45f9-4476-a3a5-63bb7dc45daf tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.473s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-42b213f6-45f9-4476-a3a5-63bb7dc45daf tempest-CreateVolumesFromSourceVolumeTest-147450298 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:29:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-445445085',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6812048b-f5b7-4ae8-bed9-7b1b082da21b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc7ca8745a8245d591931242f0a34cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:36Z,use_quota=True,user_id='ac51764edd3a4e81b3001b41efc416dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-42b213f6-45f9-4476-a3a5-63bb7dc45daf tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Creating volume 6812048b-f5b7-4ae8-bed9-7b1b082da21b {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-42b213f6-45f9-4476-a3a5-63bb7dc45daf tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-42b213f6-45f9-4476-a3a5-63bb7dc45daf tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-42b213f6-45f9-4476-a3a5-63bb7dc45daf tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-42b213f6-45f9-4476-a3a5-63bb7dc45daf tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-42b213f6-45f9-4476-a3a5-63bb7dc45daf tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-42b213f6-45f9-4476-a3a5-63bb7dc45daf tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:29:42 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-42b213f6-45f9-4476-a3a5-63bb7dc45daf tempest-CreateVolumesFromSourceVolumeTest-147450298 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-42b213f6-45f9-4476-a3a5-63bb7dc45daf tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6812048b-f5b7-4ae8-bed9-7b1b082da21b 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5aa3f42f-8efb-4a5a-adec-5ff06c03a35d tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2a5951a-b8c1-4a42-bff6-53db98d904e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8032ad7c-98e7-4fb2-b68c-93799559766e', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:42 devstack sudo[107226]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6812048b-f5b7-4ae8-bed9-7b1b082da21b 1073741824
Nov 04 12:29:42 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5aa3f42f-8efb-4a5a-adec-5ff06c03a35d tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (508db931-e7c0-426a-a9d5-008392c17d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:42 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-5aa3f42f-8efb-4a5a-adec-5ff06c03a35d tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Volume volume-8032ad7c-98e7-4fb2-b68c-93799559766e (8032ad7c-98e7-4fb2-b68c-93799559766e): created successfully
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5aa3f42f-8efb-4a5a-adec-5ff06c03a35d tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (508db931-e7c0-426a-a9d5-008392c17d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5aa3f42f-8efb-4a5a-adec-5ff06c03a35d tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Flow 'volume_create_manager' (ca3b7671-4734-4a6c-b210-bbd33f511901) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:29:42 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-5aa3f42f-8efb-4a5a-adec-5ff06c03a35d tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Created volume successfully.
Nov 04 12:29:42 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5646b992-18cf-430a-b281-97c6bfc66ae5 tempest-CreateVolumesFromImageTest-383500336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.257s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-5646b992-18cf-430a-b281-97c6bfc66ae5 tempest-CreateVolumesFromImageTest-383500336 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:29:42 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-5646b992-18cf-430a-b281-97c6bfc66ae5 tempest-CreateVolumesFromImageTest-383500336 None] Deleted volume successfully.
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5646b992-18cf-430a-b281-97c6bfc66ae5 tempest-CreateVolumesFromImageTest-383500336 None] Lock "cinder-7ecaacff-20ad-40c5-a1d3-72bc86f9890e-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:29:42 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-42b213f6-45f9-4476-a3a5-63bb7dc45daf tempest-CreateVolumesFromSourceVolumeTest-147450298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6812048b-f5b7-4ae8-bed9-7b1b082da21b 1073741824" returned: 0 in 0.444s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-42b213f6-45f9-4476-a3a5-63bb7dc45daf tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6812048b-f5b7-4ae8-bed9-7b1b082da21b {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:42 devstack sudo[107233]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6812048b-f5b7-4ae8-bed9-7b1b082da21b
Nov 04 12:29:42 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9303fe3e-2102-44cc-957e-579b4fcdc7d9 tempest-CreateVolumesFromImageTest-383500336 None] Acquiring lock "cinder-37bc8aa1-c3b4-4797-baf6-dbdfe086c014-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9303fe3e-2102-44cc-957e-579b4fcdc7d9 tempest-CreateVolumesFromImageTest-383500336 None] Lock "cinder-37bc8aa1-c3b4-4797-baf6-dbdfe086c014-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:29:42 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-42b213f6-45f9-4476-a3a5-63bb7dc45daf tempest-CreateVolumesFromSourceVolumeTest-147450298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6812048b-f5b7-4ae8-bed9-7b1b082da21b" returned: 0 in 0.258s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-42b213f6-45f9-4476-a3a5-63bb7dc45daf tempest-CreateVolumesFromSourceVolumeTest-147450298 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-42b213f6-45f9-4476-a3a5-63bb7dc45daf tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8ca18828-ccdc-45ab-bffb-78a1026c8767 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.803s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-8ca18828-ccdc-45ab-bffb-78a1026c8767 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:29:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1073283423',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d82238e0-9e76-470a-8c56-a3326608726d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc7ca8745a8245d591931242f0a34cf8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:37Z,use_quota=True,user_id='ac51764edd3a4e81b3001b41efc416dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-8ca18828-ccdc-45ab-bffb-78a1026c8767 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Creating volume d82238e0-9e76-470a-8c56-a3326608726d {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8ca18828-ccdc-45ab-bffb-78a1026c8767 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8ca18828-ccdc-45ab-bffb-78a1026c8767 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-8ca18828-ccdc-45ab-bffb-78a1026c8767 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-8ca18828-ccdc-45ab-bffb-78a1026c8767 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8ca18828-ccdc-45ab-bffb-78a1026c8767 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-8ca18828-ccdc-45ab-bffb-78a1026c8767 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:29:42 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-8ca18828-ccdc-45ab-bffb-78a1026c8767 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8ca18828-ccdc-45ab-bffb-78a1026c8767 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d82238e0-9e76-470a-8c56-a3326608726d 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:42 devstack sudo[107236]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d82238e0-9e76-470a-8c56-a3326608726d 1073741824
Nov 04 12:29:42 devstack sudo[107236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-42b213f6-45f9-4476-a3a5-63bb7dc45daf tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc984d34-7c48-4c7f-bf90-b6ff7a780f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6812048b-f5b7-4ae8-bed9-7b1b082da21b', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-42b213f6-45f9-4476-a3a5-63bb7dc45daf tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5c784df-b94a-4a3d-8d18-10f5d90e1b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9303fe3e-2102-44cc-957e-579b4fcdc7d9 tempest-CreateVolumesFromImageTest-383500336 None] Acquiring lock "cinder-quobyte-37bc8aa1-c3b4-4797-baf6-dbdfe086c014" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:29:42 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-42b213f6-45f9-4476-a3a5-63bb7dc45daf tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Volume volume-6812048b-f5b7-4ae8-bed9-7b1b082da21b (6812048b-f5b7-4ae8-bed9-7b1b082da21b): created successfully
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-42b213f6-45f9-4476-a3a5-63bb7dc45daf tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5c784df-b94a-4a3d-8d18-10f5d90e1b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-42b213f6-45f9-4476-a3a5-63bb7dc45daf tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Flow 'volume_create_manager' (c0971e52-15cd-4529-9e0a-29b843d64ca8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:29:42 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9303fe3e-2102-44cc-957e-579b4fcdc7d9 tempest-CreateVolumesFromImageTest-383500336 None] Lock "cinder-quobyte-37bc8aa1-c3b4-4797-baf6-dbdfe086c014" acquired by "delete_volume" :: waited 0.033s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:29:43 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-42b213f6-45f9-4476-a3a5-63bb7dc45daf tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Created volume successfully.
Nov 04 12:29:43 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[122e7fba-c20d-4b33-89ed-8a8db55819bf]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:29:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9303fe3e-2102-44cc-957e-579b4fcdc7d9 tempest-CreateVolumesFromImageTest-383500336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37bc8aa1-c3b4-4797-baf6-dbdfe086c014 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:43 devstack sudo[107238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37bc8aa1-c3b4-4797-baf6-dbdfe086c014
Nov 04 12:29:43 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:43 devstack sudo[107236]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8ca18828-ccdc-45ab-bffb-78a1026c8767 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d82238e0-9e76-470a-8c56-a3326608726d 1073741824" returned: 0 in 0.443s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8ca18828-ccdc-45ab-bffb-78a1026c8767 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d82238e0-9e76-470a-8c56-a3326608726d {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:43 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9303fe3e-2102-44cc-957e-579b4fcdc7d9 tempest-CreateVolumesFromImageTest-383500336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37bc8aa1-c3b4-4797-baf6-dbdfe086c014" returned: 0 in 0.385s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9303fe3e-2102-44cc-957e-579b4fcdc7d9 tempest-CreateVolumesFromImageTest-383500336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37bc8aa1-c3b4-4797-baf6-dbdfe086c014 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:43 devstack sudo[107246]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d82238e0-9e76-470a-8c56-a3326608726d
Nov 04 12:29:43 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:43 devstack sudo[107248]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37bc8aa1-c3b4-4797-baf6-dbdfe086c014
Nov 04 12:29:43 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:43 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8ca18828-ccdc-45ab-bffb-78a1026c8767 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d82238e0-9e76-470a-8c56-a3326608726d" returned: 0 in 0.258s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:43 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-8ca18828-ccdc-45ab-bffb-78a1026c8767 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:29:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8ca18828-ccdc-45ab-bffb-78a1026c8767 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.045s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:43 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:29:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de13b40b-ab46-4c42-b4d6-dff16d46c78b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bab1f7ad94f4911bfa9f1c13a2a22c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:35Z,use_quota=True,user_id='06a09cda8c044d92b741703bce764a1f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(392d673b-6a52-4ec7-83ea-7d67b94d15e0),volume_type_id=392d673b-6a52-4ec7-83ea-7d67b94d15e0)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:29:43 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Creating volume de13b40b-ab46-4c42-b4d6-dff16d46c78b {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:29:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:43 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:29:43 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:29:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:43 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:29:43 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:29:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-de13b40b-ab46-4c42-b4d6-dff16d46c78b 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:43 devstack sudo[107252]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-de13b40b-ab46-4c42-b4d6-dff16d46c78b 1073741824
Nov 04 12:29:43 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8ca18828-ccdc-45ab-bffb-78a1026c8767 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1689b71-49f4-4c6b-acbb-5612ec77e7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d82238e0-9e76-470a-8c56-a3326608726d', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:43 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8ca18828-ccdc-45ab-bffb-78a1026c8767 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9644923-1a63-4dd0-9b70-9f27706c9e3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9303fe3e-2102-44cc-957e-579b4fcdc7d9 tempest-CreateVolumesFromImageTest-383500336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-37bc8aa1-c3b4-4797-baf6-dbdfe086c014" returned: 0 in 0.288s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:43 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9303fe3e-2102-44cc-957e-579b4fcdc7d9 tempest-CreateVolumesFromImageTest-383500336 None] Lock "cinder-quobyte-37bc8aa1-c3b4-4797-baf6-dbdfe086c014" released by "delete_volume" :: held 0.733s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:29:43 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-8ca18828-ccdc-45ab-bffb-78a1026c8767 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Volume volume-d82238e0-9e76-470a-8c56-a3326608726d (d82238e0-9e76-470a-8c56-a3326608726d): created successfully
Nov 04 12:29:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8ca18828-ccdc-45ab-bffb-78a1026c8767 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9644923-1a63-4dd0-9b70-9f27706c9e3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:43 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-8ca18828-ccdc-45ab-bffb-78a1026c8767 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Flow 'volume_create_manager' (beaac800-b329-4d67-8d66-9efc49452845) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:29:43 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-8ca18828-ccdc-45ab-bffb-78a1026c8767 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Created volume successfully.
Nov 04 12:29:43 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-9303fe3e-2102-44cc-957e-579b4fcdc7d9 tempest-CreateVolumesFromImageTest-383500336 None] Created reservations ['919271fd-bd6f-42a1-b84b-9b09c1d20932', 'dc2aafd4-485f-4087-b772-927ea39038c4', '04fcf06a-dc04-4d03-bf0d-25c9953929ab', 'dcaa8205-1ef3-4f7c-bd8b-f87cce2f6343'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:29:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-9303fe3e-2102-44cc-957e-579b4fcdc7d9 tempest-CreateVolumesFromImageTest-383500336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-9303fe3e-2102-44cc-957e-579b4fcdc7d9 tempest-CreateVolumesFromImageTest-383500336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:43 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-9303fe3e-2102-44cc-957e-579b4fcdc7d9 tempest-CreateVolumesFromImageTest-383500336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:29:43 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-9303fe3e-2102-44cc-957e-579b4fcdc7d9 tempest-CreateVolumesFromImageTest-383500336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:29:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-9303fe3e-2102-44cc-957e-579b4fcdc7d9 tempest-CreateVolumesFromImageTest-383500336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9303fe3e-2102-44cc-957e-579b4fcdc7d9 tempest-CreateVolumesFromImageTest-383500336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:43 devstack sudo[107256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:29:43 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:44 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-96786918-f6bd-4112-b474-2d8223fae4a2 tempest-CreateVolumesFromImageTest-383500336 None] Acquiring lock "cinder-f68ae101-2a48-4725-92d7-8eb3569fe9d0-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:29:44 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-96786918-f6bd-4112-b474-2d8223fae4a2 tempest-CreateVolumesFromImageTest-383500336 None] Lock "cinder-f68ae101-2a48-4725-92d7-8eb3569fe9d0-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:29:44 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-96786918-f6bd-4112-b474-2d8223fae4a2 tempest-CreateVolumesFromImageTest-383500336 None] Acquiring lock "cinder-quobyte-f68ae101-2a48-4725-92d7-8eb3569fe9d0" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:29:44 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-96786918-f6bd-4112-b474-2d8223fae4a2 tempest-CreateVolumesFromImageTest-383500336 None] Lock "cinder-quobyte-f68ae101-2a48-4725-92d7-8eb3569fe9d0" acquired by "delete_volume" :: waited 0.015s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:29:44 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e6d595-6b5d-4fc8-a32e-b6974127f40d]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:29:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-96786918-f6bd-4112-b474-2d8223fae4a2 tempest-CreateVolumesFromImageTest-383500336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f68ae101-2a48-4725-92d7-8eb3569fe9d0 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:44 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9303fe3e-2102-44cc-957e-579b4fcdc7d9 tempest-CreateVolumesFromImageTest-383500336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.303s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:44 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-9303fe3e-2102-44cc-957e-579b4fcdc7d9 tempest-CreateVolumesFromImageTest-383500336 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:29:44 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-9303fe3e-2102-44cc-957e-579b4fcdc7d9 tempest-CreateVolumesFromImageTest-383500336 None] Deleted volume successfully.
Nov 04 12:29:44 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-de13b40b-ab46-4c42-b4d6-dff16d46c78b 1073741824" returned: 0 in 0.547s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:44 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9303fe3e-2102-44cc-957e-579b4fcdc7d9 tempest-CreateVolumesFromImageTest-383500336 None] Lock "cinder-37bc8aa1-c3b4-4797-baf6-dbdfe086c014-delete_volume" released by "delete_volume" :: held 1.355s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:29:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-de13b40b-ab46-4c42-b4d6-dff16d46c78b {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:44 devstack sudo[107262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-de13b40b-ab46-4c42-b4d6-dff16d46c78b
Nov 04 12:29:44 devstack sudo[107261]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f68ae101-2a48-4725-92d7-8eb3569fe9d0
Nov 04 12:29:44 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:44 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:44 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-de13b40b-ab46-4c42-b4d6-dff16d46c78b" returned: 0 in 0.245s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:44 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:29:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.837s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-645e4bd5-8418-447d-a7a2-9564d691f98e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.248s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:44 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-645e4bd5-8418-447d-a7a2-9564d691f98e tempest-CreateVolumesFromSnapshotTest-2032084862 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1339686437',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a325bb1-89ba-4877-98fe-85bc253b65c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4bd7e2af9846e1ac25525998457444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:40Z,use_quota=True,user_id='d7ee65def192460f91e684a26a271088',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:29:44 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-645e4bd5-8418-447d-a7a2-9564d691f98e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Creating volume 3a325bb1-89ba-4877-98fe-85bc253b65c0 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:29:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-645e4bd5-8418-447d-a7a2-9564d691f98e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-645e4bd5-8418-447d-a7a2-9564d691f98e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:44 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-645e4bd5-8418-447d-a7a2-9564d691f98e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:29:44 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-645e4bd5-8418-447d-a7a2-9564d691f98e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:29:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-645e4bd5-8418-447d-a7a2-9564d691f98e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:44 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-645e4bd5-8418-447d-a7a2-9564d691f98e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:29:44 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-645e4bd5-8418-447d-a7a2-9564d691f98e tempest-CreateVolumesFromSnapshotTest-2032084862 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:29:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-645e4bd5-8418-447d-a7a2-9564d691f98e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3a325bb1-89ba-4877-98fe-85bc253b65c0 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:44 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-96786918-f6bd-4112-b474-2d8223fae4a2 tempest-CreateVolumesFromImageTest-383500336 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f68ae101-2a48-4725-92d7-8eb3569fe9d0" returned: 0 in 0.365s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-96786918-f6bd-4112-b474-2d8223fae4a2 tempest-CreateVolumesFromImageTest-383500336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f68ae101-2a48-4725-92d7-8eb3569fe9d0 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:44 devstack sudo[107269]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3a325bb1-89ba-4877-98fe-85bc253b65c0 1073741824
Nov 04 12:29:44 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:44 devstack sudo[107270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f68ae101-2a48-4725-92d7-8eb3569fe9d0
Nov 04 12:29:44 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:44 devstack cinder-volume[87169]: DEBUG cinder.volume.volume_utils [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Attempting download of ebfde8ed-5aa6-4420-89de-c708d8b2352a ((None, [{'url': 'file:///opt/stack/data/glance/images/ebfde8ed-5aa6-4420-89de-c708d8b2352a', 'metadata': {}}])) to volume de13b40b-ab46-4c42-b4d6-dff16d46c78b. {{(pid=87169) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 04 12:29:44 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b74bde5-36b2-44fd-a2d2-7545b8d965b4]: (4, 'raw') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:29:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ebfde8ed-5aa6-4420-89de-c708d8b2352a_ot1cb8eo {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:44 devstack sudo[107273]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ebfde8ed-5aa6-4420-89de-c708d8b2352a_ot1cb8eo
Nov 04 12:29:44 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:44 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-aa8ec57c-f246-491a-99f4-fcfa7b6a350a tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Acquiring lock "cinder-d82238e0-9e76-470a-8c56-a3326608726d-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:29:44 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-aa8ec57c-f246-491a-99f4-fcfa7b6a350a tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "cinder-d82238e0-9e76-470a-8c56-a3326608726d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:29:44 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-96786918-f6bd-4112-b474-2d8223fae4a2 tempest-CreateVolumesFromImageTest-383500336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f68ae101-2a48-4725-92d7-8eb3569fe9d0" returned: 0 in 0.318s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:44 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-96786918-f6bd-4112-b474-2d8223fae4a2 tempest-CreateVolumesFromImageTest-383500336 None] Lock "cinder-quobyte-f68ae101-2a48-4725-92d7-8eb3569fe9d0" released by "delete_volume" :: held 0.735s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:29:44 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-aa8ec57c-f246-491a-99f4-fcfa7b6a350a tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Acquiring lock "cinder-quobyte-d82238e0-9e76-470a-8c56-a3326608726d" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:29:44 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-aa8ec57c-f246-491a-99f4-fcfa7b6a350a tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "cinder-quobyte-d82238e0-9e76-470a-8c56-a3326608726d" acquired by "delete_volume" :: waited 0.022s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:29:44 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[cecfca0f-0338-4512-98b6-10276bd2e453]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:29:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-aa8ec57c-f246-491a-99f4-fcfa7b6a350a tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d82238e0-9e76-470a-8c56-a3326608726d {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:44 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-96786918-f6bd-4112-b474-2d8223fae4a2 tempest-CreateVolumesFromImageTest-383500336 None] Created reservations ['4716a269-a377-412e-be28-4ac00f514fd5', '9c280f3b-fcf7-48a3-b793-3f4531254424', 'd1ee8ae3-36e0-408f-b8bb-b37f2a07f821', '6ee5d6f4-2e7e-4ec4-a31a-eb72748bf5fb'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:29:45 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-96786918-f6bd-4112-b474-2d8223fae4a2 tempest-CreateVolumesFromImageTest-383500336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-96786918-f6bd-4112-b474-2d8223fae4a2 tempest-CreateVolumesFromImageTest-383500336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:45 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-96786918-f6bd-4112-b474-2d8223fae4a2 tempest-CreateVolumesFromImageTest-383500336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:29:45 devstack sudo[107280]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d82238e0-9e76-470a-8c56-a3326608726d
Nov 04 12:29:45 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-96786918-f6bd-4112-b474-2d8223fae4a2 tempest-CreateVolumesFromImageTest-383500336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:29:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-96786918-f6bd-4112-b474-2d8223fae4a2 tempest-CreateVolumesFromImageTest-383500336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-96786918-f6bd-4112-b474-2d8223fae4a2 tempest-CreateVolumesFromImageTest-383500336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:45 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ebfde8ed-5aa6-4420-89de-c708d8b2352a_ot1cb8eo" returned: 0 in 0.467s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ebfde8ed-5aa6-4420-89de-c708d8b2352a_ot1cb8eo {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:45 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-645e4bd5-8418-447d-a7a2-9564d691f98e tempest-CreateVolumesFromSnapshotTest-2032084862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3a325bb1-89ba-4877-98fe-85bc253b65c0 1073741824" returned: 0 in 0.607s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:45 devstack sudo[107284]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:29:45 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-645e4bd5-8418-447d-a7a2-9564d691f98e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3a325bb1-89ba-4877-98fe-85bc253b65c0 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:45 devstack sudo[107287]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3a325bb1-89ba-4877-98fe-85bc253b65c0
Nov 04 12:29:45 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:45 devstack sudo[107285]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ebfde8ed-5aa6-4420-89de-c708d8b2352a_ot1cb8eo
Nov 04 12:29:45 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:45 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-96786918-f6bd-4112-b474-2d8223fae4a2 tempest-CreateVolumesFromImageTest-383500336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.282s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:45 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-96786918-f6bd-4112-b474-2d8223fae4a2 tempest-CreateVolumesFromImageTest-383500336 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:29:45 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-96786918-f6bd-4112-b474-2d8223fae4a2 tempest-CreateVolumesFromImageTest-383500336 None] Deleted volume successfully.
Nov 04 12:29:45 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-96786918-f6bd-4112-b474-2d8223fae4a2 tempest-CreateVolumesFromImageTest-383500336 None] Lock "cinder-f68ae101-2a48-4725-92d7-8eb3569fe9d0-delete_volume" released by "delete_volume" :: held 1.354s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:29:45 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:45 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-aa8ec57c-f246-491a-99f4-fcfa7b6a350a tempest-CreateVolumesFromSourceVolumeTest-147450298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d82238e0-9e76-470a-8c56-a3326608726d" returned: 0 in 0.561s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-aa8ec57c-f246-491a-99f4-fcfa7b6a350a tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d82238e0-9e76-470a-8c56-a3326608726d {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-645e4bd5-8418-447d-a7a2-9564d691f98e tempest-CreateVolumesFromSnapshotTest-2032084862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3a325bb1-89ba-4877-98fe-85bc253b65c0" returned: 0 in 0.345s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:45 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-645e4bd5-8418-447d-a7a2-9564d691f98e tempest-CreateVolumesFromSnapshotTest-2032084862 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:29:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-645e4bd5-8418-447d-a7a2-9564d691f98e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:45 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2f837125-81d1-4a03-8610-f0a55a60d474 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.732s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:45 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-2f837125-81d1-4a03-8610-f0a55a60d474 tempest-CreateVolumesFromSnapshotTest-2032084862 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:29:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1032415527',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a9576fc-2d7d-46eb-ba4d-08af75b946d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4bd7e2af9846e1ac25525998457444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:41Z,use_quota=True,user_id='d7ee65def192460f91e684a26a271088',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:29:45 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-2f837125-81d1-4a03-8610-f0a55a60d474 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Creating volume 7a9576fc-2d7d-46eb-ba4d-08af75b946d6 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:29:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2f837125-81d1-4a03-8610-f0a55a60d474 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2f837125-81d1-4a03-8610-f0a55a60d474 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:45 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-2f837125-81d1-4a03-8610-f0a55a60d474 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:29:45 devstack sudo[107298]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d82238e0-9e76-470a-8c56-a3326608726d
Nov 04 12:29:45 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:45 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-2f837125-81d1-4a03-8610-f0a55a60d474 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:29:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2f837125-81d1-4a03-8610-f0a55a60d474 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:45 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-2f837125-81d1-4a03-8610-f0a55a60d474 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:29:45 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-2f837125-81d1-4a03-8610-f0a55a60d474 tempest-CreateVolumesFromSnapshotTest-2032084862 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:29:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2f837125-81d1-4a03-8610-f0a55a60d474 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-7a9576fc-2d7d-46eb-ba4d-08af75b946d6 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ebfde8ed-5aa6-4420-89de-c708d8b2352a_ot1cb8eo" returned: 1 in 0.467s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ebfde8ed-5aa6-4420-89de-c708d8b2352a_ot1cb8eo' failed. Not Retrying. {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 12:29:45 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f857fd-1d03-402c-976e-7f2bda684288]: (4, 'raw') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:29:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ebfde8ed-5aa6-4420-89de-c708d8b2352a_i78ak0nodevstack@QuobyteHD {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:45 devstack sudo[107300]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-7a9576fc-2d7d-46eb-ba4d-08af75b946d6 1073741824
Nov 04 12:29:45 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:45 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-645e4bd5-8418-447d-a7a2-9564d691f98e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b1fcc95-016e-4811-86d8-aff373c520d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a325bb1-89ba-4877-98fe-85bc253b65c0', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:45 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-645e4bd5-8418-447d-a7a2-9564d691f98e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dedb9e4f-a8c1-449d-8483-51f1575d8a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:45 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-645e4bd5-8418-447d-a7a2-9564d691f98e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Volume volume-3a325bb1-89ba-4877-98fe-85bc253b65c0 (3a325bb1-89ba-4877-98fe-85bc253b65c0): created successfully
Nov 04 12:29:45 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-645e4bd5-8418-447d-a7a2-9564d691f98e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dedb9e4f-a8c1-449d-8483-51f1575d8a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:45 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-645e4bd5-8418-447d-a7a2-9564d691f98e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Flow 'volume_create_manager' (f2158eb5-7d88-45eb-bd72-9f617c9d9980) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:29:45 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-645e4bd5-8418-447d-a7a2-9564d691f98e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Created volume successfully.
Nov 04 12:29:45 devstack sudo[107301]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ebfde8ed-5aa6-4420-89de-c708d8b2352a_i78ak0nodevstack@QuobyteHD
Nov 04 12:29:45 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:45 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-aa8ec57c-f246-491a-99f4-fcfa7b6a350a tempest-CreateVolumesFromSourceVolumeTest-147450298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-d82238e0-9e76-470a-8c56-a3326608726d" returned: 0 in 0.349s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:45 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-aa8ec57c-f246-491a-99f4-fcfa7b6a350a tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "cinder-quobyte-d82238e0-9e76-470a-8c56-a3326608726d" released by "delete_volume" :: held 0.972s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:29:45 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-aa8ec57c-f246-491a-99f4-fcfa7b6a350a tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Created reservations ['ad9ee930-d2a0-48cc-b083-e613c393f5c5', '16b5539b-ea97-468e-9a82-358d004f829f', '5ba8ad9a-5f19-4f39-9e22-c6b208d499fc', 'fdbd616b-d0c2-42f7-b73b-0cae61b679ed'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:29:46 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ebfde8ed-5aa6-4420-89de-c708d8b2352a_i78ak0nodevstack@QuobyteHD" returned: 0 in 0.443s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebfde8ed-5aa6-4420-89de-c708d8b2352a_i78ak0nodevstack@QuobyteHD {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-aa8ec57c-f246-491a-99f4-fcfa7b6a350a tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-aa8ec57c-f246-491a-99f4-fcfa7b6a350a tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:46 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-aa8ec57c-f246-491a-99f4-fcfa7b6a350a tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:29:46 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-aa8ec57c-f246-491a-99f4-fcfa7b6a350a tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:29:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-aa8ec57c-f246-491a-99f4-fcfa7b6a350a tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-aa8ec57c-f246-491a-99f4-fcfa7b6a350a tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:46 devstack sudo[107311]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:29:46 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:46 devstack sudo[107310]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebfde8ed-5aa6-4420-89de-c708d8b2352a_i78ak0nodevstack@QuobyteHD
Nov 04 12:29:46 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:46 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2f837125-81d1-4a03-8610-f0a55a60d474 tempest-CreateVolumesFromSnapshotTest-2032084862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-7a9576fc-2d7d-46eb-ba4d-08af75b946d6 1073741824" returned: 0 in 0.700s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2f837125-81d1-4a03-8610-f0a55a60d474 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-7a9576fc-2d7d-46eb-ba4d-08af75b946d6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:46 devstack sudo[107314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-7a9576fc-2d7d-46eb-ba4d-08af75b946d6
Nov 04 12:29:46 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:46 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-aa8ec57c-f246-491a-99f4-fcfa7b6a350a tempest-CreateVolumesFromSourceVolumeTest-147450298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.350s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:46 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-aa8ec57c-f246-491a-99f4-fcfa7b6a350a tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:29:46 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-aa8ec57c-f246-491a-99f4-fcfa7b6a350a tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Deleted volume successfully.
Nov 04 12:29:46 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-aa8ec57c-f246-491a-99f4-fcfa7b6a350a tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "cinder-d82238e0-9e76-470a-8c56-a3326608726d-delete_volume" released by "delete_volume" :: held 1.651s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:29:46 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebfde8ed-5aa6-4420-89de-c708d8b2352a_i78ak0nodevstack@QuobyteHD" returned: 1 in 0.489s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ebfde8ed-5aa6-4420-89de-c708d8b2352a_i78ak0nodevstack@QuobyteHD' failed. Not Retrying. {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 12:29:46 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] ebfde8ed-5aa6-4420-89de-c708d8b2352a was raw, converting to qcow2 {{(pid=87169) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 04 12:29:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ebfde8ed-5aa6-4420-89de-c708d8b2352a_i78ak0nodevstack@QuobyteHD /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-de13b40b-ab46-4c42-b4d6-dff16d46c78b {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:46 devstack sudo[107320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ebfde8ed-5aa6-4420-89de-c708d8b2352a_i78ak0nodevstack@QuobyteHD /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-de13b40b-ab46-4c42-b4d6-dff16d46c78b
Nov 04 12:29:46 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:46 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2f837125-81d1-4a03-8610-f0a55a60d474 tempest-CreateVolumesFromSnapshotTest-2032084862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-7a9576fc-2d7d-46eb-ba4d-08af75b946d6" returned: 0 in 0.308s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:46 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-2f837125-81d1-4a03-8610-f0a55a60d474 tempest-CreateVolumesFromSnapshotTest-2032084862 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:29:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2f837125-81d1-4a03-8610-f0a55a60d474 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7cf43503-0d5e-4344-af08-fb2134953d06 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.433s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:46 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-7cf43503-0d5e-4344-af08-fb2134953d06 tempest-CreateVolumesFromSnapshotTest-2032084862 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-150811820',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72141e77-2ffe-4a62-b17e-3c16648574d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4bd7e2af9846e1ac25525998457444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:41Z,use_quota=True,user_id='d7ee65def192460f91e684a26a271088',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:29:46 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-7cf43503-0d5e-4344-af08-fb2134953d06 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Creating volume 72141e77-2ffe-4a62-b17e-3c16648574d4 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:29:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7cf43503-0d5e-4344-af08-fb2134953d06 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7cf43503-0d5e-4344-af08-fb2134953d06 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:46 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-7cf43503-0d5e-4344-af08-fb2134953d06 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:29:46 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-7cf43503-0d5e-4344-af08-fb2134953d06 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:29:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7cf43503-0d5e-4344-af08-fb2134953d06 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:46 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-7cf43503-0d5e-4344-af08-fb2134953d06 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:29:46 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-7cf43503-0d5e-4344-af08-fb2134953d06 tempest-CreateVolumesFromSnapshotTest-2032084862 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:29:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7cf43503-0d5e-4344-af08-fb2134953d06 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-72141e77-2ffe-4a62-b17e-3c16648574d4 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:46 devstack sudo[107324]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-72141e77-2ffe-4a62-b17e-3c16648574d4 1073741824
Nov 04 12:29:46 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:46 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2f837125-81d1-4a03-8610-f0a55a60d474 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68041ae4-398f-4700-a0c4-958dc1e8da38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a9576fc-2d7d-46eb-ba4d-08af75b946d6', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:46 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2f837125-81d1-4a03-8610-f0a55a60d474 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5af89666-2503-4f43-97a4-391c4d91c1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:46 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-2f837125-81d1-4a03-8610-f0a55a60d474 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Volume volume-7a9576fc-2d7d-46eb-ba4d-08af75b946d6 (7a9576fc-2d7d-46eb-ba4d-08af75b946d6): created successfully
Nov 04 12:29:46 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2f837125-81d1-4a03-8610-f0a55a60d474 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5af89666-2503-4f43-97a4-391c4d91c1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:46 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-2f837125-81d1-4a03-8610-f0a55a60d474 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Flow 'volume_create_manager' (449670c8-44f8-4475-86d3-805eb05e2e28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:29:46 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-2f837125-81d1-4a03-8610-f0a55a60d474 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Created volume successfully.
Nov 04 12:29:47 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ebfde8ed-5aa6-4420-89de-c708d8b2352a_i78ak0nodevstack@QuobyteHD /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-de13b40b-ab46-4c42-b4d6-dff16d46c78b" returned: 0 in 0.577s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:47 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ebfde8ed-5aa6-4420-89de-c708d8b2352a_i78ak0nodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-de13b40b-ab46-4c42-b4d6-dff16d46c78b {{(pid=87169) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 12:29:47 devstack cinder-volume[87169]: INFO cinder.image.image_utils [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Converted 0.00 MB image at 0.00 MB/s
Nov 04 12:29:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-de13b40b-ab46-4c42-b4d6-dff16d46c78b 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:47 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-91edeca5-0885-4a1a-93ac-e957df7e3ed1 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Acquiring lock "cinder-6812048b-f5b7-4ae8-bed9-7b1b082da21b-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:29:47 devstack sudo[107334]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-de13b40b-ab46-4c42-b4d6-dff16d46c78b 1G
Nov 04 12:29:47 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:47 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-91edeca5-0885-4a1a-93ac-e957df7e3ed1 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "cinder-6812048b-f5b7-4ae8-bed9-7b1b082da21b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:29:47 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-91edeca5-0885-4a1a-93ac-e957df7e3ed1 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Acquiring lock "cinder-quobyte-6812048b-f5b7-4ae8-bed9-7b1b082da21b" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:29:47 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-91edeca5-0885-4a1a-93ac-e957df7e3ed1 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "cinder-quobyte-6812048b-f5b7-4ae8-bed9-7b1b082da21b" acquired by "delete_volume" :: waited 0.022s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:29:47 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9fc4400-c721-4e5b-acd0-9354fde77865]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:29:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-91edeca5-0885-4a1a-93ac-e957df7e3ed1 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6812048b-f5b7-4ae8-bed9-7b1b082da21b {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:47 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7cf43503-0d5e-4344-af08-fb2134953d06 tempest-CreateVolumesFromSnapshotTest-2032084862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-72141e77-2ffe-4a62-b17e-3c16648574d4 1073741824" returned: 0 in 0.642s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7cf43503-0d5e-4344-af08-fb2134953d06 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-72141e77-2ffe-4a62-b17e-3c16648574d4 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:47 devstack sudo[107337]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-72141e77-2ffe-4a62-b17e-3c16648574d4
Nov 04 12:29:47 devstack sudo[107337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:47 devstack sudo[107336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6812048b-f5b7-4ae8-bed9-7b1b082da21b
Nov 04 12:29:47 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:47 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-de13b40b-ab46-4c42-b4d6-dff16d46c78b 1G" returned: 0 in 0.514s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:47 devstack cinder-volume[87169]: DEBUG cinder.volume.volume_utils [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Downloaded image ebfde8ed-5aa6-4420-89de-c708d8b2352a ((None, [{'url': 'file:///opt/stack/data/glance/images/ebfde8ed-5aa6-4420-89de-c708d8b2352a', 'metadata': {}}])) to volume de13b40b-ab46-4c42-b4d6-dff16d46c78b successfully. {{(pid=87169) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 04 12:29:47 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Temporary image ebfde8ed-5aa6-4420-89de-c708d8b2352a for user 06a09cda8c044d92b741703bce764a1f is deleted. {{(pid=87169) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 04 12:29:47 devstack cinder-volume[87169]: DEBUG cinder.volume.volume_utils [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Marking volume de13b40b-ab46-4c42-b4d6-dff16d46c78b as bootable. {{(pid=87169) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 04 12:29:47 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Copying metadata from image ebfde8ed-5aa6-4420-89de-c708d8b2352a to de13b40b-ab46-4c42-b4d6-dff16d46c78b. {{(pid=87169) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 04 12:29:47 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Creating volume glance metadata for volume de13b40b-ab46-4c42-b4d6-dff16d46c78b backed by image ebfde8ed-5aa6-4420-89de-c708d8b2352a with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'ebfde8ed-5aa6-4420-89de-c708d8b2352a', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'e2f5d3f9ca580fb571536e1aa14f8007', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87169) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 04 12:29:47 devstack sudo[107337]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7cf43503-0d5e-4344-af08-fb2134953d06 tempest-CreateVolumesFromSnapshotTest-2032084862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-72141e77-2ffe-4a62-b17e-3c16648574d4" returned: 0 in 0.342s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:47 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-7cf43503-0d5e-4344-af08-fb2134953d06 tempest-CreateVolumesFromSnapshotTest-2032084862 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:29:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7cf43503-0d5e-4344-af08-fb2134953d06 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-40cd11e5-c7f2-45c4-9d29-f0ecc20bc912 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.982s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:47 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-40cd11e5-c7f2-45c4-9d29-f0ecc20bc912 tempest-CreateVolumesFromSnapshotTest-2032084862 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:29:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-97386391',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e8f47f4-b73d-4fb1-a7f6-26cceafcf29e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4bd7e2af9846e1ac25525998457444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:42Z,use_quota=True,user_id='d7ee65def192460f91e684a26a271088',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:29:47 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-40cd11e5-c7f2-45c4-9d29-f0ecc20bc912 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Creating volume 9e8f47f4-b73d-4fb1-a7f6-26cceafcf29e {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:29:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-40cd11e5-c7f2-45c4-9d29-f0ecc20bc912 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-40cd11e5-c7f2-45c4-9d29-f0ecc20bc912 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:47 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-40cd11e5-c7f2-45c4-9d29-f0ecc20bc912 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:29:47 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-40cd11e5-c7f2-45c4-9d29-f0ecc20bc912 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:29:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-40cd11e5-c7f2-45c4-9d29-f0ecc20bc912 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:47 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-40cd11e5-c7f2-45c4-9d29-f0ecc20bc912 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:29:47 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-40cd11e5-c7f2-45c4-9d29-f0ecc20bc912 tempest-CreateVolumesFromSnapshotTest-2032084862 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:29:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-40cd11e5-c7f2-45c4-9d29-f0ecc20bc912 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9e8f47f4-b73d-4fb1-a7f6-26cceafcf29e 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:47 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7cf43503-0d5e-4344-af08-fb2134953d06 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8747a81e-b15f-4412-92f1-6a4df69cc77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72141e77-2ffe-4a62-b17e-3c16648574d4', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:47 devstack sudo[107348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9e8f47f4-b73d-4fb1-a7f6-26cceafcf29e 1073741824
Nov 04 12:29:47 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:47 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:47 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7cf43503-0d5e-4344-af08-fb2134953d06 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d21d43d-9be3-4bd5-8942-fda31afe072d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-91edeca5-0885-4a1a-93ac-e957df7e3ed1 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6812048b-f5b7-4ae8-bed9-7b1b082da21b" returned: 0 in 0.500s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-91edeca5-0885-4a1a-93ac-e957df7e3ed1 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6812048b-f5b7-4ae8-bed9-7b1b082da21b {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:47 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-7cf43503-0d5e-4344-af08-fb2134953d06 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Volume volume-72141e77-2ffe-4a62-b17e-3c16648574d4 (72141e77-2ffe-4a62-b17e-3c16648574d4): created successfully
Nov 04 12:29:47 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7cf43503-0d5e-4344-af08-fb2134953d06 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d21d43d-9be3-4bd5-8942-fda31afe072d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:47 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7cf43503-0d5e-4344-af08-fb2134953d06 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Flow 'volume_create_manager' (3964fbd9-a5b0-45be-a491-62c5d21c85d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:29:47 devstack sudo[107350]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6812048b-f5b7-4ae8-bed9-7b1b082da21b
Nov 04 12:29:47 devstack sudo[107350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:47 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3b71e22-975c-43c3-9d2c-50dc9c85f6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de13b40b-ab46-4c42-b4d6-dff16d46c78b', 'volume_size': 1, 'image_id': 'ebfde8ed-5aa6-4420-89de-c708d8b2352a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ebfde8ed-5aa6-4420-89de-c708d8b2352a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e2f5d3f9ca580fb571536e1aa14f8007', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6bab1f7ad94f4911bfa9f1c13a2a22c7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f7b20815c0e9f2041fd21f66bd95f1a789fcecafe5f7a9300ce7fbc88496d7f075955483144af2b0ef7d57050c34048bd31cf0db7cb142e03a4257e57a1ff3ce', 'id': 'ebfde8ed-5aa6-4420-89de-c708d8b2352a', 'created_at': datetime.datetime(2026, 11, 4, 11, 29, 33, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 29, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ebfde8ed-5aa6-4420-89de-c708d8b2352a/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cc0592dc740>}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:47 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (898d470d-bbc1-45eb-b9ec-ac59724f3e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:47 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-7cf43503-0d5e-4344-af08-fb2134953d06 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Created volume successfully.
Nov 04 12:29:47 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Volume volume-de13b40b-ab46-4c42-b4d6-dff16d46c78b (de13b40b-ab46-4c42-b4d6-dff16d46c78b): created successfully
Nov 04 12:29:47 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (898d470d-bbc1-45eb-b9ec-ac59724f3e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:47 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Flow 'volume_create_manager' (95a3a0c5-2103-4cb8-b557-d5d6b9696a12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:29:47 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-d53faff9-c7cb-4b46-88c8-22089bd058a7 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Created volume successfully.
Nov 04 12:29:48 devstack sudo[107350]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-91edeca5-0885-4a1a-93ac-e957df7e3ed1 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-6812048b-f5b7-4ae8-bed9-7b1b082da21b" returned: 0 in 0.353s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:48 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-91edeca5-0885-4a1a-93ac-e957df7e3ed1 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "cinder-quobyte-6812048b-f5b7-4ae8-bed9-7b1b082da21b" released by "delete_volume" :: held 0.903s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:29:48 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-91edeca5-0885-4a1a-93ac-e957df7e3ed1 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Created reservations ['3a4af44c-e5fc-4c7e-b2d9-7ce796a6b526', '0c74cba9-9001-4c80-b6b6-a0cc4ca4ea71', 'e9a6b4e7-17a4-48c3-90dc-36974efb39f4', '112ac0a3-923c-4141-aa4d-30fcdb4f4383'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:29:48 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-40cd11e5-c7f2-45c4-9d29-f0ecc20bc912 tempest-CreateVolumesFromSnapshotTest-2032084862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9e8f47f4-b73d-4fb1-a7f6-26cceafcf29e 1073741824" returned: 0 in 0.547s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-40cd11e5-c7f2-45c4-9d29-f0ecc20bc912 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9e8f47f4-b73d-4fb1-a7f6-26cceafcf29e {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-91edeca5-0885-4a1a-93ac-e957df7e3ed1 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-91edeca5-0885-4a1a-93ac-e957df7e3ed1 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:48 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-91edeca5-0885-4a1a-93ac-e957df7e3ed1 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:29:48 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-91edeca5-0885-4a1a-93ac-e957df7e3ed1 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:29:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-91edeca5-0885-4a1a-93ac-e957df7e3ed1 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-91edeca5-0885-4a1a-93ac-e957df7e3ed1 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:48 devstack sudo[107357]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9e8f47f4-b73d-4fb1-a7f6-26cceafcf29e
Nov 04 12:29:48 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:48 devstack sudo[107358]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:29:48 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-278dd061-211f-47d8-9b01-ce2d80e4eb51 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Acquiring lock "cinder-8032ad7c-98e7-4fb2-b68c-93799559766e-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:29:48 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:48 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-278dd061-211f-47d8-9b01-ce2d80e4eb51 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "cinder-8032ad7c-98e7-4fb2-b68c-93799559766e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:29:48 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-278dd061-211f-47d8-9b01-ce2d80e4eb51 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Acquiring lock "cinder-quobyte-8032ad7c-98e7-4fb2-b68c-93799559766e" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:29:48 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-278dd061-211f-47d8-9b01-ce2d80e4eb51 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "cinder-quobyte-8032ad7c-98e7-4fb2-b68c-93799559766e" acquired by "delete_volume" :: waited 0.018s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:29:48 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[141503c9-5ee9-4cdf-92f2-a952e40e5200]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:29:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-278dd061-211f-47d8-9b01-ce2d80e4eb51 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8032ad7c-98e7-4fb2-b68c-93799559766e {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:48 devstack sudo[107361]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8032ad7c-98e7-4fb2-b68c-93799559766e
Nov 04 12:29:48 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:48 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-40cd11e5-c7f2-45c4-9d29-f0ecc20bc912 tempest-CreateVolumesFromSnapshotTest-2032084862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9e8f47f4-b73d-4fb1-a7f6-26cceafcf29e" returned: 0 in 0.364s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:48 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-40cd11e5-c7f2-45c4-9d29-f0ecc20bc912 tempest-CreateVolumesFromSnapshotTest-2032084862 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:29:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-40cd11e5-c7f2-45c4-9d29-f0ecc20bc912 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-66058e89-4e17-4f38-9be8-986bce800869 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.536s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:48 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-66058e89-4e17-4f38-9be8-986bce800869 tempest-CreateVolumesFromSnapshotTest-2032084862 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:29:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1210833810',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a60204fb-8bde-45b0-8b20-4f210e2a16d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c4bd7e2af9846e1ac25525998457444',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:42Z,use_quota=True,user_id='d7ee65def192460f91e684a26a271088',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:29:48 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-66058e89-4e17-4f38-9be8-986bce800869 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Creating volume a60204fb-8bde-45b0-8b20-4f210e2a16d2 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:29:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-66058e89-4e17-4f38-9be8-986bce800869 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-66058e89-4e17-4f38-9be8-986bce800869 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:48 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-66058e89-4e17-4f38-9be8-986bce800869 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:29:48 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-66058e89-4e17-4f38-9be8-986bce800869 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:29:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-66058e89-4e17-4f38-9be8-986bce800869 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:48 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-66058e89-4e17-4f38-9be8-986bce800869 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:29:48 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-66058e89-4e17-4f38-9be8-986bce800869 tempest-CreateVolumesFromSnapshotTest-2032084862 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:29:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-66058e89-4e17-4f38-9be8-986bce800869 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a60204fb-8bde-45b0-8b20-4f210e2a16d2 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:48 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-91edeca5-0885-4a1a-93ac-e957df7e3ed1 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.403s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:48 devstack sudo[107365]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a60204fb-8bde-45b0-8b20-4f210e2a16d2 1073741824
Nov 04 12:29:48 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:48 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-91edeca5-0885-4a1a-93ac-e957df7e3ed1 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:29:48 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-91edeca5-0885-4a1a-93ac-e957df7e3ed1 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Deleted volume successfully.
Nov 04 12:29:48 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-40cd11e5-c7f2-45c4-9d29-f0ecc20bc912 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c265e122-0bd3-4712-b40d-90e8105b8a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e8f47f4-b73d-4fb1-a7f6-26cceafcf29e', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:48 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-40cd11e5-c7f2-45c4-9d29-f0ecc20bc912 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b03ff4b6-bae4-4a63-b58b-6afab5ebd9a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:48 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-40cd11e5-c7f2-45c4-9d29-f0ecc20bc912 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Volume volume-9e8f47f4-b73d-4fb1-a7f6-26cceafcf29e (9e8f47f4-b73d-4fb1-a7f6-26cceafcf29e): created successfully
Nov 04 12:29:48 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-40cd11e5-c7f2-45c4-9d29-f0ecc20bc912 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b03ff4b6-bae4-4a63-b58b-6afab5ebd9a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:48 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-40cd11e5-c7f2-45c4-9d29-f0ecc20bc912 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Flow 'volume_create_manager' (dec5e47c-3534-4f26-b11f-23fd589d3df8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:29:48 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-91edeca5-0885-4a1a-93ac-e957df7e3ed1 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "cinder-6812048b-f5b7-4ae8-bed9-7b1b082da21b-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:29:48 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-40cd11e5-c7f2-45c4-9d29-f0ecc20bc912 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Created volume successfully.
Nov 04 12:29:48 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-278dd061-211f-47d8-9b01-ce2d80e4eb51 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8032ad7c-98e7-4fb2-b68c-93799559766e" returned: 0 in 0.508s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-278dd061-211f-47d8-9b01-ce2d80e4eb51 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8032ad7c-98e7-4fb2-b68c-93799559766e {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:49 devstack sudo[107372]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8032ad7c-98e7-4fb2-b68c-93799559766e
Nov 04 12:29:49 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:49 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-40f06d24-6da9-43de-98e8-3481b39754e5 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Acquiring lock "cinder-de13b40b-ab46-4c42-b4d6-dff16d46c78b-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:29:49 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-40f06d24-6da9-43de-98e8-3481b39754e5 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Lock "cinder-de13b40b-ab46-4c42-b4d6-dff16d46c78b-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:29:49 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-40f06d24-6da9-43de-98e8-3481b39754e5 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Acquiring lock "cinder-quobyte-de13b40b-ab46-4c42-b4d6-dff16d46c78b" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:29:49 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-40f06d24-6da9-43de-98e8-3481b39754e5 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Lock "cinder-quobyte-de13b40b-ab46-4c42-b4d6-dff16d46c78b" acquired by "delete_volume" :: waited 0.024s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:29:49 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e8e744-f365-4d68-9bf4-0c1a8995daaf]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:29:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-40f06d24-6da9-43de-98e8-3481b39754e5 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-de13b40b-ab46-4c42-b4d6-dff16d46c78b {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:49 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-66058e89-4e17-4f38-9be8-986bce800869 tempest-CreateVolumesFromSnapshotTest-2032084862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a60204fb-8bde-45b0-8b20-4f210e2a16d2 1073741824" returned: 0 in 0.671s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:49 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-278dd061-211f-47d8-9b01-ce2d80e4eb51 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8032ad7c-98e7-4fb2-b68c-93799559766e" returned: 0 in 0.385s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:49 devstack sudo[107375]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-de13b40b-ab46-4c42-b4d6-dff16d46c78b
Nov 04 12:29:49 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:49 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-278dd061-211f-47d8-9b01-ce2d80e4eb51 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "cinder-quobyte-8032ad7c-98e7-4fb2-b68c-93799559766e" released by "delete_volume" :: held 0.962s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:29:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-66058e89-4e17-4f38-9be8-986bce800869 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a60204fb-8bde-45b0-8b20-4f210e2a16d2 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:49 devstack sudo[107378]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a60204fb-8bde-45b0-8b20-4f210e2a16d2
Nov 04 12:29:49 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:49 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-278dd061-211f-47d8-9b01-ce2d80e4eb51 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Created reservations ['60a58e39-c2bb-49df-a6eb-9caae416bc83', '46076994-6e03-452e-a66f-519ed5e5a75e', '348ca4b2-5cf5-412f-93fa-6a1f7be983e7', '08f12556-2067-4f48-8c05-754e3538783c'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:29:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-278dd061-211f-47d8-9b01-ce2d80e4eb51 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-278dd061-211f-47d8-9b01-ce2d80e4eb51 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-278dd061-211f-47d8-9b01-ce2d80e4eb51 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:29:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-278dd061-211f-47d8-9b01-ce2d80e4eb51 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:29:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-278dd061-211f-47d8-9b01-ce2d80e4eb51 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-278dd061-211f-47d8-9b01-ce2d80e4eb51 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:49 devstack sudo[107380]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:29:49 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:49 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ec86c2c1-54db-4a1b-8099-66c295fbb98b tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Acquiring lock "cinder-a7b027ce-097f-4a86-8e60-b84782e65143-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:29:49 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ec86c2c1-54db-4a1b-8099-66c295fbb98b tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "cinder-a7b027ce-097f-4a86-8e60-b84782e65143-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:29:49 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ec86c2c1-54db-4a1b-8099-66c295fbb98b tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Acquiring lock "cinder-quobyte-a7b027ce-097f-4a86-8e60-b84782e65143" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:29:49 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ec86c2c1-54db-4a1b-8099-66c295fbb98b tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "cinder-quobyte-a7b027ce-097f-4a86-8e60-b84782e65143" acquired by "delete_volume" :: waited 0.039s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:29:49 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-66058e89-4e17-4f38-9be8-986bce800869 tempest-CreateVolumesFromSnapshotTest-2032084862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a60204fb-8bde-45b0-8b20-4f210e2a16d2" returned: 0 in 0.414s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-66058e89-4e17-4f38-9be8-986bce800869 tempest-CreateVolumesFromSnapshotTest-2032084862 None] <== create_volume: return (1155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:29:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-66058e89-4e17-4f38-9be8-986bce800869 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:49 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:49 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70b14a4-f370-48dd-a3d3-cd2ab501e120]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:29:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ec86c2c1-54db-4a1b-8099-66c295fbb98b tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a7b027ce-097f-4a86-8e60-b84782e65143 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-40f06d24-6da9-43de-98e8-3481b39754e5 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-de13b40b-ab46-4c42-b4d6-dff16d46c78b" returned: 0 in 0.612s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-40f06d24-6da9-43de-98e8-3481b39754e5 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-de13b40b-ab46-4c42-b4d6-dff16d46c78b {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:49 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:29:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:29:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:29:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:49 devstack sudo[107387]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-de13b40b-ab46-4c42-b4d6-dff16d46c78b
Nov 04 12:29:49 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:49 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-66058e89-4e17-4f38-9be8-986bce800869 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (601a3f2a-b474-415f-8844-a0453259f0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a60204fb-8bde-45b0-8b20-4f210e2a16d2', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:49 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:49 devstack sudo[107389]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:29:49 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-66058e89-4e17-4f38-9be8-986bce800869 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dc16a00-320a-4348-8f7f-df74b373a33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:49 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-278dd061-211f-47d8-9b01-ce2d80e4eb51 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.409s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:49 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-278dd061-211f-47d8-9b01-ce2d80e4eb51 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:29:49 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-66058e89-4e17-4f38-9be8-986bce800869 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Volume volume-a60204fb-8bde-45b0-8b20-4f210e2a16d2 (a60204fb-8bde-45b0-8b20-4f210e2a16d2): created successfully
Nov 04 12:29:49 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-66058e89-4e17-4f38-9be8-986bce800869 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dc16a00-320a-4348-8f7f-df74b373a33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:49 devstack sudo[107386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a7b027ce-097f-4a86-8e60-b84782e65143
Nov 04 12:29:49 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:49 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-66058e89-4e17-4f38-9be8-986bce800869 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Flow 'volume_create_manager' (794e4771-524f-4c66-8ea2-aeda7633918c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:29:50 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-278dd061-211f-47d8-9b01-ce2d80e4eb51 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Deleted volume successfully.
Nov 04 12:29:50 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-66058e89-4e17-4f38-9be8-986bce800869 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Created volume successfully.
Nov 04 12:29:50 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-278dd061-211f-47d8-9b01-ce2d80e4eb51 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "cinder-8032ad7c-98e7-4fb2-b68c-93799559766e-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:29:50 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-40f06d24-6da9-43de-98e8-3481b39754e5 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-de13b40b-ab46-4c42-b4d6-dff16d46c78b" returned: 0 in 0.374s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:50 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-40f06d24-6da9-43de-98e8-3481b39754e5 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Lock "cinder-quobyte-de13b40b-ab46-4c42-b4d6-dff16d46c78b" released by "delete_volume" :: held 1.036s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:29:50 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.390s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:50 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:29:50 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager._thread_info {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:29:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread count: 28 {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 12:29:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread info: [<_MainThread(MainThread, started 137165867425920)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137165754678912)>, <Thread(Thread-3 (stat_writer), started daemon 137165754130752)>, <Thread(Rabbit-heartbeat, started daemon 137165752997504)>, <Thread(Thread-5 (_runner), started daemon 137165753227712)>, <Thread(Thread-7 (_runner), started daemon 137165751273856)>, <Thread(fd_logger, started daemon 137165755322048)>, <Thread(privsep_reader, started daemon 137165748896704)>, <Thread(tpool_thread_0, started daemon 137165742520000)>, <Thread(tpool_thread_1, started daemon 137165734127296)>, <Thread(tpool_thread_2, started daemon 137165725734592)>, <Thread(tpool_thread_3, started daemon 137165717341888)>, <Thread(tpool_thread_4, started daemon 137165708949184)>, <Thread(tpool_thread_5, started daemon 137165700556480)>, <Thread(tpool_thread_6, started daemon 137165692163776)>, <Thread(tpool_thread_7, started daemon 137165683771072)>, <Thread(tpool_thread_8, started daemon 137165675378368)>, <Thread(tpool_thread_9, started daemon 137165666985664)>, <Thread(tpool_thread_10, started daemon 137165658592960)>, <Thread(tpool_thread_11, started daemon 137165650183872)>, <Thread(tpool_thread_12, started daemon 137165641774784)>, <Thread(tpool_thread_13, started daemon 137165633365696)>, <Thread(tpool_thread_14, started daemon 137165624956608)>, <Thread(tpool_thread_15, started daemon 137165616547520)>, <Thread(tpool_thread_16, started daemon 137165608138432)>, <Thread(tpool_thread_17, started daemon 137165599729344)>, <Thread(tpool_thread_18, started daemon 137165591320256)>, <Thread(tpool_thread_19, started daemon 137165582911168)>] {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 12:29:50 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ec86c2c1-54db-4a1b-8099-66c295fbb98b tempest-CreateVolumesFromSourceVolumeTest-147450298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a7b027ce-097f-4a86-8e60-b84782e65143" returned: 0 in 0.476s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ec86c2c1-54db-4a1b-8099-66c295fbb98b tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a7b027ce-097f-4a86-8e60-b84782e65143 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:50 devstack sudo[107398]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a7b027ce-097f-4a86-8e60-b84782e65143
Nov 04 12:29:50 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:50 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-40f06d24-6da9-43de-98e8-3481b39754e5 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Created reservations ['f73560eb-13e9-43da-9cf5-781de85551a7', '1681b7fa-539c-44af-beed-9f6cd3a20891', 'f372672d-030b-4600-bae6-6dba4e032b5a', '7b9a6ade-87aa-4b5a-991c-813d81f9fac5'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:29:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-40f06d24-6da9-43de-98e8-3481b39754e5 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-40f06d24-6da9-43de-98e8-3481b39754e5 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:50 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-40f06d24-6da9-43de-98e8-3481b39754e5 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:29:50 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-40f06d24-6da9-43de-98e8-3481b39754e5 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:29:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-40f06d24-6da9-43de-98e8-3481b39754e5 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-40f06d24-6da9-43de-98e8-3481b39754e5 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:50 devstack sudo[107400]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:29:50 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:50 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ec86c2c1-54db-4a1b-8099-66c295fbb98b tempest-CreateVolumesFromSourceVolumeTest-147450298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a7b027ce-097f-4a86-8e60-b84782e65143" returned: 0 in 0.280s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:50 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ec86c2c1-54db-4a1b-8099-66c295fbb98b tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "cinder-quobyte-a7b027ce-097f-4a86-8e60-b84782e65143" released by "delete_volume" :: held 0.823s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:29:50 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-ec86c2c1-54db-4a1b-8099-66c295fbb98b tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Created reservations ['70e14a6d-f60c-4d8b-ae8a-8cdb3bb329c0', '193a359e-dc75-4b12-b709-57ea56d15729', '332e2689-eb41-4241-b039-cde73b6ea20f', '47358bbd-c442-4bee-b33b-dc2565d8d99b'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:29:50 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-40f06d24-6da9-43de-98e8-3481b39754e5 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.267s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:50 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-40f06d24-6da9-43de-98e8-3481b39754e5 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:29:50 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-40f06d24-6da9-43de-98e8-3481b39754e5 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Deleted volume successfully.
Nov 04 12:29:50 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-40f06d24-6da9-43de-98e8-3481b39754e5 tempest-VolumeAndVolumeTypeFromImageTest-691988269 None] Lock "cinder-de13b40b-ab46-4c42-b4d6-dff16d46c78b-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:29:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ec86c2c1-54db-4a1b-8099-66c295fbb98b tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ec86c2c1-54db-4a1b-8099-66c295fbb98b tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:50 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ec86c2c1-54db-4a1b-8099-66c295fbb98b tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:29:50 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-ec86c2c1-54db-4a1b-8099-66c295fbb98b tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:29:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ec86c2c1-54db-4a1b-8099-66c295fbb98b tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ec86c2c1-54db-4a1b-8099-66c295fbb98b tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:50 devstack sudo[107404]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:29:50 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:50 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5ae0f968-6c18-4873-b47d-5c087ac91fac tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Acquiring lock "cinder-e5813259-8c43-41d6-979d-12d098ce6c55-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:29:50 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5ae0f968-6c18-4873-b47d-5c087ac91fac tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "cinder-e5813259-8c43-41d6-979d-12d098ce6c55-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:29:50 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5ae0f968-6c18-4873-b47d-5c087ac91fac tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Acquiring lock "cinder-quobyte-e5813259-8c43-41d6-979d-12d098ce6c55" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:29:50 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5ae0f968-6c18-4873-b47d-5c087ac91fac tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "cinder-quobyte-e5813259-8c43-41d6-979d-12d098ce6c55" acquired by "delete_volume" :: waited 0.024s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:29:51 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba951751-d82c-49f5-a8d3-8e6ea5679584]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:29:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5ae0f968-6c18-4873-b47d-5c087ac91fac tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e5813259-8c43-41d6-979d-12d098ce6c55 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:51 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ec86c2c1-54db-4a1b-8099-66c295fbb98b tempest-CreateVolumesFromSourceVolumeTest-147450298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.312s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:51 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-ec86c2c1-54db-4a1b-8099-66c295fbb98b tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:29:51 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-ec86c2c1-54db-4a1b-8099-66c295fbb98b tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Deleted volume successfully.
Nov 04 12:29:51 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-cfda7d67-aecf-46e4-a321-e7ceb3cabf3e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Acquiring lock "cinder-a60204fb-8bde-45b0-8b20-4f210e2a16d2-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:29:51 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ec86c2c1-54db-4a1b-8099-66c295fbb98b tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "cinder-a7b027ce-097f-4a86-8e60-b84782e65143-delete_volume" released by "delete_volume" :: held 1.430s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:29:51 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-cfda7d67-aecf-46e4-a321-e7ceb3cabf3e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "cinder-a60204fb-8bde-45b0-8b20-4f210e2a16d2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:29:51 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-cfda7d67-aecf-46e4-a321-e7ceb3cabf3e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Acquiring lock "cinder-quobyte-a60204fb-8bde-45b0-8b20-4f210e2a16d2" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:29:51 devstack sudo[107407]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e5813259-8c43-41d6-979d-12d098ce6c55
Nov 04 12:29:51 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:51 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-cfda7d67-aecf-46e4-a321-e7ceb3cabf3e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "cinder-quobyte-a60204fb-8bde-45b0-8b20-4f210e2a16d2" acquired by "delete_volume" :: waited 0.021s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:29:51 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[817b01b4-d850-4eb1-9a61-fc59908c3b68]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:29:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-cfda7d67-aecf-46e4-a321-e7ceb3cabf3e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a60204fb-8bde-45b0-8b20-4f210e2a16d2 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:51 devstack sudo[107409]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a60204fb-8bde-45b0-8b20-4f210e2a16d2
Nov 04 12:29:51 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:51 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5ae0f968-6c18-4873-b47d-5c087ac91fac tempest-CreateVolumesFromSourceVolumeTest-147450298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e5813259-8c43-41d6-979d-12d098ce6c55" returned: 0 in 0.464s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5ae0f968-6c18-4873-b47d-5c087ac91fac tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e5813259-8c43-41d6-979d-12d098ce6c55 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:51 devstack sudo[107414]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e5813259-8c43-41d6-979d-12d098ce6c55
Nov 04 12:29:51 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:51 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-cfda7d67-aecf-46e4-a321-e7ceb3cabf3e tempest-CreateVolumesFromSnapshotTest-2032084862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a60204fb-8bde-45b0-8b20-4f210e2a16d2" returned: 0 in 0.601s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-cfda7d67-aecf-46e4-a321-e7ceb3cabf3e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a60204fb-8bde-45b0-8b20-4f210e2a16d2 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:51 devstack sudo[107421]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a60204fb-8bde-45b0-8b20-4f210e2a16d2
Nov 04 12:29:51 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:51 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5ae0f968-6c18-4873-b47d-5c087ac91fac tempest-CreateVolumesFromSourceVolumeTest-147450298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e5813259-8c43-41d6-979d-12d098ce6c55" returned: 0 in 0.382s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:51 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5ae0f968-6c18-4873-b47d-5c087ac91fac tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "cinder-quobyte-e5813259-8c43-41d6-979d-12d098ce6c55" released by "delete_volume" :: held 0.919s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:29:51 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-5ae0f968-6c18-4873-b47d-5c087ac91fac tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Created reservations ['12efa5b9-70aa-4b5b-9b40-f750d5d8129e', 'ad53eef9-4869-4d0f-a7cd-fab8e806eddc', '283a731f-ef8e-496b-ae1c-ba567e9cf3c2', '536c29dc-f3e9-4c9b-aa0a-61fdfb7bdf59'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:29:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5ae0f968-6c18-4873-b47d-5c087ac91fac tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5ae0f968-6c18-4873-b47d-5c087ac91fac tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:52 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5ae0f968-6c18-4873-b47d-5c087ac91fac tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:29:52 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5ae0f968-6c18-4873-b47d-5c087ac91fac tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:29:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5ae0f968-6c18-4873-b47d-5c087ac91fac tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5ae0f968-6c18-4873-b47d-5c087ac91fac tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:52 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-cfda7d67-aecf-46e4-a321-e7ceb3cabf3e tempest-CreateVolumesFromSnapshotTest-2032084862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-a60204fb-8bde-45b0-8b20-4f210e2a16d2" returned: 0 in 0.318s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:52 devstack sudo[107424]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:29:52 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:52 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-cfda7d67-aecf-46e4-a321-e7ceb3cabf3e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "cinder-quobyte-a60204fb-8bde-45b0-8b20-4f210e2a16d2" released by "delete_volume" :: held 0.994s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:29:52 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-cfda7d67-aecf-46e4-a321-e7ceb3cabf3e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Created reservations ['c1c57586-1ba8-46b3-995d-edc7212dd9a8', '36cbfeb0-6b9d-411b-ba11-4ffd867fc6c7', 'e5429729-7d66-4b6d-965e-0d0e51562ae6', '0448ea19-60c9-4bd4-ab61-c54019548263'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:29:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-cfda7d67-aecf-46e4-a321-e7ceb3cabf3e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-cfda7d67-aecf-46e4-a321-e7ceb3cabf3e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:52 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-cfda7d67-aecf-46e4-a321-e7ceb3cabf3e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:29:52 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-cfda7d67-aecf-46e4-a321-e7ceb3cabf3e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:29:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-cfda7d67-aecf-46e4-a321-e7ceb3cabf3e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-cfda7d67-aecf-46e4-a321-e7ceb3cabf3e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:52 devstack sudo[107426]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:29:52 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:52 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5ae0f968-6c18-4873-b47d-5c087ac91fac tempest-CreateVolumesFromSourceVolumeTest-147450298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.302s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:52 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-5ae0f968-6c18-4873-b47d-5c087ac91fac tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:29:52 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-5ae0f968-6c18-4873-b47d-5c087ac91fac tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Deleted volume successfully.
Nov 04 12:29:52 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5ae0f968-6c18-4873-b47d-5c087ac91fac tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "cinder-e5813259-8c43-41d6-979d-12d098ce6c55-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:29:52 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-cfda7d67-aecf-46e4-a321-e7ceb3cabf3e tempest-CreateVolumesFromSnapshotTest-2032084862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.321s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:52 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-cfda7d67-aecf-46e4-a321-e7ceb3cabf3e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:29:52 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-cfda7d67-aecf-46e4-a321-e7ceb3cabf3e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Deleted volume successfully.
Nov 04 12:29:52 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-cfda7d67-aecf-46e4-a321-e7ceb3cabf3e tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "cinder-a60204fb-8bde-45b0-8b20-4f210e2a16d2-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:29:53 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-18965be4-b0e0-4437-920e-5801831c0e92 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Acquiring lock "cinder-92dc9a97-4e37-4d3d-830c-b6d3cc493e45-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:29:53 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-18965be4-b0e0-4437-920e-5801831c0e92 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "cinder-92dc9a97-4e37-4d3d-830c-b6d3cc493e45-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:29:53 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-18965be4-b0e0-4437-920e-5801831c0e92 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Acquiring lock "cinder-quobyte-92dc9a97-4e37-4d3d-830c-b6d3cc493e45" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:29:53 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-18965be4-b0e0-4437-920e-5801831c0e92 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "cinder-quobyte-92dc9a97-4e37-4d3d-830c-b6d3cc493e45" acquired by "delete_volume" :: waited 0.027s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:29:53 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[c59492a9-d5af-47f9-8278-ca43c0aa5ad3]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:29:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-18965be4-b0e0-4437-920e-5801831c0e92 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-92dc9a97-4e37-4d3d-830c-b6d3cc493e45 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:53 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-353286d4-4674-4037-8670-d23a829ce2cd tempest-CreateVolumesFromSnapshotTest-2032084862 None] Acquiring lock "cinder-9e8f47f4-b73d-4fb1-a7f6-26cceafcf29e-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:29:53 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-353286d4-4674-4037-8670-d23a829ce2cd tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "cinder-9e8f47f4-b73d-4fb1-a7f6-26cceafcf29e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:29:53 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-353286d4-4674-4037-8670-d23a829ce2cd tempest-CreateVolumesFromSnapshotTest-2032084862 None] Acquiring lock "cinder-quobyte-9e8f47f4-b73d-4fb1-a7f6-26cceafcf29e" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:29:53 devstack sudo[107433]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-92dc9a97-4e37-4d3d-830c-b6d3cc493e45
Nov 04 12:29:53 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:53 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-353286d4-4674-4037-8670-d23a829ce2cd tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "cinder-quobyte-9e8f47f4-b73d-4fb1-a7f6-26cceafcf29e" acquired by "delete_volume" :: waited 0.028s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:29:53 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6118ed-f05f-452d-baf4-533fe8831122]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:29:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-353286d4-4674-4037-8670-d23a829ce2cd tempest-CreateVolumesFromSnapshotTest-2032084862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9e8f47f4-b73d-4fb1-a7f6-26cceafcf29e {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:53 devstack sudo[107435]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9e8f47f4-b73d-4fb1-a7f6-26cceafcf29e
Nov 04 12:29:53 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:53 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-18965be4-b0e0-4437-920e-5801831c0e92 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-92dc9a97-4e37-4d3d-830c-b6d3cc493e45" returned: 0 in 0.514s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-18965be4-b0e0-4437-920e-5801831c0e92 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-92dc9a97-4e37-4d3d-830c-b6d3cc493e45 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:53 devstack sudo[107440]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-92dc9a97-4e37-4d3d-830c-b6d3cc493e45
Nov 04 12:29:53 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:54 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-353286d4-4674-4037-8670-d23a829ce2cd tempest-CreateVolumesFromSnapshotTest-2032084862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9e8f47f4-b73d-4fb1-a7f6-26cceafcf29e" returned: 0 in 0.525s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-353286d4-4674-4037-8670-d23a829ce2cd tempest-CreateVolumesFromSnapshotTest-2032084862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9e8f47f4-b73d-4fb1-a7f6-26cceafcf29e {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:54 devstack sudo[107445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9e8f47f4-b73d-4fb1-a7f6-26cceafcf29e
Nov 04 12:29:54 devstack sudo[107445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:54 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-18965be4-b0e0-4437-920e-5801831c0e92 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-92dc9a97-4e37-4d3d-830c-b6d3cc493e45" returned: 0 in 0.340s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:54 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-18965be4-b0e0-4437-920e-5801831c0e92 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "cinder-quobyte-92dc9a97-4e37-4d3d-830c-b6d3cc493e45" released by "delete_volume" :: held 0.930s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:29:54 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-18965be4-b0e0-4437-920e-5801831c0e92 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Created reservations ['c922b5f6-8742-42a5-8f29-0a00e9c0bb06', '4888e73e-f461-46a4-89d0-6b4b6039fe5e', '01e5eaa5-365b-4492-b133-a7f92600d17c', '11deab71-ae2d-462d-b153-4a16528c87ee'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:29:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-18965be4-b0e0-4437-920e-5801831c0e92 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-18965be4-b0e0-4437-920e-5801831c0e92 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:54 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-18965be4-b0e0-4437-920e-5801831c0e92 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:29:54 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-18965be4-b0e0-4437-920e-5801831c0e92 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:29:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-18965be4-b0e0-4437-920e-5801831c0e92 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-18965be4-b0e0-4437-920e-5801831c0e92 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:54 devstack sudo[107449]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:29:54 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:54 devstack sudo[107445]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-353286d4-4674-4037-8670-d23a829ce2cd tempest-CreateVolumesFromSnapshotTest-2032084862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9e8f47f4-b73d-4fb1-a7f6-26cceafcf29e" returned: 0 in 0.418s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:54 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-353286d4-4674-4037-8670-d23a829ce2cd tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "cinder-quobyte-9e8f47f4-b73d-4fb1-a7f6-26cceafcf29e" released by "delete_volume" :: held 1.025s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:29:54 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-353286d4-4674-4037-8670-d23a829ce2cd tempest-CreateVolumesFromSnapshotTest-2032084862 None] Created reservations ['f61ef2d4-e7d0-41b3-ae86-d0b477d97bf4', 'da5ea5da-10f1-4937-ab18-d8756c580cd9', '02651cc6-da28-4720-8b80-3bca8d974199', 'bfe19318-5a4d-4763-9dfb-c861b4b19274'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:29:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-353286d4-4674-4037-8670-d23a829ce2cd tempest-CreateVolumesFromSnapshotTest-2032084862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-353286d4-4674-4037-8670-d23a829ce2cd tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:54 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-353286d4-4674-4037-8670-d23a829ce2cd tempest-CreateVolumesFromSnapshotTest-2032084862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:29:54 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-353286d4-4674-4037-8670-d23a829ce2cd tempest-CreateVolumesFromSnapshotTest-2032084862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:29:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-353286d4-4674-4037-8670-d23a829ce2cd tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-353286d4-4674-4037-8670-d23a829ce2cd tempest-CreateVolumesFromSnapshotTest-2032084862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:54 devstack sudo[107451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:29:54 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:54 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-18965be4-b0e0-4437-920e-5801831c0e92 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.333s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:54 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-18965be4-b0e0-4437-920e-5801831c0e92 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:29:54 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-18965be4-b0e0-4437-920e-5801831c0e92 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Deleted volume successfully.
Nov 04 12:29:54 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-18965be4-b0e0-4437-920e-5801831c0e92 tempest-CreateVolumesFromSourceVolumeTest-147450298 None] Lock "cinder-92dc9a97-4e37-4d3d-830c-b6d3cc493e45-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:29:55 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-353286d4-4674-4037-8670-d23a829ce2cd tempest-CreateVolumesFromSnapshotTest-2032084862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.314s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:55 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-353286d4-4674-4037-8670-d23a829ce2cd tempest-CreateVolumesFromSnapshotTest-2032084862 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:29:55 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-353286d4-4674-4037-8670-d23a829ce2cd tempest-CreateVolumesFromSnapshotTest-2032084862 None] Deleted volume successfully.
Nov 04 12:29:55 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-353286d4-4674-4037-8670-d23a829ce2cd tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "cinder-9e8f47f4-b73d-4fb1-a7f6-26cceafcf29e-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:29:55 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3074be82-f163-4fc0-8059-1cebb0f35127 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Acquiring lock "cinder-72141e77-2ffe-4a62-b17e-3c16648574d4-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:29:55 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3074be82-f163-4fc0-8059-1cebb0f35127 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "cinder-72141e77-2ffe-4a62-b17e-3c16648574d4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:29:55 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3074be82-f163-4fc0-8059-1cebb0f35127 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Acquiring lock "cinder-quobyte-72141e77-2ffe-4a62-b17e-3c16648574d4" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:29:55 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3074be82-f163-4fc0-8059-1cebb0f35127 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "cinder-quobyte-72141e77-2ffe-4a62-b17e-3c16648574d4" acquired by "delete_volume" :: waited 0.014s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:29:55 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef0d765-5e9c-4913-8bc8-b6ee9137ddf2]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:29:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3074be82-f163-4fc0-8059-1cebb0f35127 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-72141e77-2ffe-4a62-b17e-3c16648574d4 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:55 devstack sudo[107457]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-72141e77-2ffe-4a62-b17e-3c16648574d4
Nov 04 12:29:56 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:56 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3074be82-f163-4fc0-8059-1cebb0f35127 tempest-CreateVolumesFromSnapshotTest-2032084862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-72141e77-2ffe-4a62-b17e-3c16648574d4" returned: 0 in 0.528s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3074be82-f163-4fc0-8059-1cebb0f35127 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-72141e77-2ffe-4a62-b17e-3c16648574d4 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:56 devstack sudo[107463]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-72141e77-2ffe-4a62-b17e-3c16648574d4
Nov 04 12:29:56 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:56 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3074be82-f163-4fc0-8059-1cebb0f35127 tempest-CreateVolumesFromSnapshotTest-2032084862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-72141e77-2ffe-4a62-b17e-3c16648574d4" returned: 0 in 0.300s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:56 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3074be82-f163-4fc0-8059-1cebb0f35127 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "cinder-quobyte-72141e77-2ffe-4a62-b17e-3c16648574d4" released by "delete_volume" :: held 0.888s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:29:56 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-3074be82-f163-4fc0-8059-1cebb0f35127 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Created reservations ['7f7ef6c7-b3bc-449e-922c-b7d3cc7aa068', 'f2e280b6-7ba4-4604-8cb4-70ed4cead0db', '46c92292-8bc2-4507-b3fe-e95c0bbea329', 'd7ce4ce3-a36a-4768-af57-e1cdae244aa7'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:29:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3074be82-f163-4fc0-8059-1cebb0f35127 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3074be82-f163-4fc0-8059-1cebb0f35127 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:56 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3074be82-f163-4fc0-8059-1cebb0f35127 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:29:56 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3074be82-f163-4fc0-8059-1cebb0f35127 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:29:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3074be82-f163-4fc0-8059-1cebb0f35127 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3074be82-f163-4fc0-8059-1cebb0f35127 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:56 devstack sudo[107466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:29:56 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:56 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-dcf2ca04-f687-44a3-a54c-48f21083fb43 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Acquiring lock "cinder-7a9576fc-2d7d-46eb-ba4d-08af75b946d6-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:29:56 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-dcf2ca04-f687-44a3-a54c-48f21083fb43 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "cinder-7a9576fc-2d7d-46eb-ba4d-08af75b946d6-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:29:57 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-dcf2ca04-f687-44a3-a54c-48f21083fb43 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Acquiring lock "cinder-quobyte-7a9576fc-2d7d-46eb-ba4d-08af75b946d6" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:29:57 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-dcf2ca04-f687-44a3-a54c-48f21083fb43 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "cinder-quobyte-7a9576fc-2d7d-46eb-ba4d-08af75b946d6" acquired by "delete_volume" :: waited 0.027s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:29:57 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ceac97d-8fdf-4ffa-b07a-b995e3da3310]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:29:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dcf2ca04-f687-44a3-a54c-48f21083fb43 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-7a9576fc-2d7d-46eb-ba4d-08af75b946d6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:57 devstack sudo[107468]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-7a9576fc-2d7d-46eb-ba4d-08af75b946d6
Nov 04 12:29:57 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:57 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3074be82-f163-4fc0-8059-1cebb0f35127 tempest-CreateVolumesFromSnapshotTest-2032084862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.458s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:57 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-3074be82-f163-4fc0-8059-1cebb0f35127 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:29:57 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-3074be82-f163-4fc0-8059-1cebb0f35127 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Deleted volume successfully.
Nov 04 12:29:57 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-04926cb1-b034-4d23-9ecb-94689793919b tempest-VolumeDependencyTests-297018988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:29:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-04926cb1-b034-4d23-9ecb-94689793919b tempest-VolumeDependencyTests-297018988 None] Flow 'volume_create_manager' (4201cdc5-b14d-42f5-9372-985fb01c6864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:29:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-04926cb1-b034-4d23-9ecb-94689793919b tempest-VolumeDependencyTests-297018988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d761d6e-8b69-42c4-87f5-434b50c4c73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:57 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3074be82-f163-4fc0-8059-1cebb0f35127 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "cinder-72141e77-2ffe-4a62-b17e-3c16648574d4-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:29:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-04926cb1-b034-4d23-9ecb-94689793919b tempest-VolumeDependencyTests-297018988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d761d6e-8b69-42c4-87f5-434b50c4c73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1495261631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09900986-1012-4d1f-812b-ebad4c05b9de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9af797ae856642b5a22cca67640b63b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:57Z,use_quota=True,user_id='7fb80e12c13b412588f80943f01758c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-04926cb1-b034-4d23-9ecb-94689793919b tempest-VolumeDependencyTests-297018988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ed85e7b-88e7-4da2-b244-c53c75261550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-04926cb1-b034-4d23-9ecb-94689793919b tempest-VolumeDependencyTests-297018988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ed85e7b-88e7-4da2-b244-c53c75261550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-04926cb1-b034-4d23-9ecb-94689793919b tempest-VolumeDependencyTests-297018988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6c9a713-ed58-48f3-993a-bd7ab1ec4542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-04926cb1-b034-4d23-9ecb-94689793919b tempest-VolumeDependencyTests-297018988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6c9a713-ed58-48f3-993a-bd7ab1ec4542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09900986-1012-4d1f-812b-ebad4c05b9de', 'volume_name': 'volume-09900986-1012-4d1f-812b-ebad4c05b9de', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-04926cb1-b034-4d23-9ecb-94689793919b tempest-VolumeDependencyTests-297018988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d984cd0-d0e9-4d99-8be5-a3628043584d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-04926cb1-b034-4d23-9ecb-94689793919b tempest-VolumeDependencyTests-297018988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d984cd0-d0e9-4d99-8be5-a3628043584d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-04926cb1-b034-4d23-9ecb-94689793919b tempest-VolumeDependencyTests-297018988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ede920df-1162-41b2-9d01-df42e86be04d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:57 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-04926cb1-b034-4d23-9ecb-94689793919b tempest-VolumeDependencyTests-297018988 None] Volume 09900986-1012-4d1f-812b-ebad4c05b9de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09900986-1012-4d1f-812b-ebad4c05b9de', 'volume_size': 1}
Nov 04 12:29:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-04926cb1-b034-4d23-9ecb-94689793919b tempest-VolumeDependencyTests-297018988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-04926cb1-b034-4d23-9ecb-94689793919b tempest-VolumeDependencyTests-297018988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:57 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-04926cb1-b034-4d23-9ecb-94689793919b tempest-VolumeDependencyTests-297018988 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1495261631',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09900986-1012-4d1f-812b-ebad4c05b9de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9af797ae856642b5a22cca67640b63b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:29:57Z,use_quota=True,user_id='7fb80e12c13b412588f80943f01758c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:29:57 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-04926cb1-b034-4d23-9ecb-94689793919b tempest-VolumeDependencyTests-297018988 None] Creating volume 09900986-1012-4d1f-812b-ebad4c05b9de {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:29:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-04926cb1-b034-4d23-9ecb-94689793919b tempest-VolumeDependencyTests-297018988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-04926cb1-b034-4d23-9ecb-94689793919b tempest-VolumeDependencyTests-297018988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:57 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-04926cb1-b034-4d23-9ecb-94689793919b tempest-VolumeDependencyTests-297018988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:29:57 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-04926cb1-b034-4d23-9ecb-94689793919b tempest-VolumeDependencyTests-297018988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:29:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-04926cb1-b034-4d23-9ecb-94689793919b tempest-VolumeDependencyTests-297018988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:57 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-04926cb1-b034-4d23-9ecb-94689793919b tempest-VolumeDependencyTests-297018988 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:29:57 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-04926cb1-b034-4d23-9ecb-94689793919b tempest-VolumeDependencyTests-297018988 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:29:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-04926cb1-b034-4d23-9ecb-94689793919b tempest-VolumeDependencyTests-297018988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:57 devstack sudo[107471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de 1073741824
Nov 04 12:29:57 devstack sudo[107471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:57 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dcf2ca04-f687-44a3-a54c-48f21083fb43 tempest-CreateVolumesFromSnapshotTest-2032084862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-7a9576fc-2d7d-46eb-ba4d-08af75b946d6" returned: 0 in 0.545s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dcf2ca04-f687-44a3-a54c-48f21083fb43 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-7a9576fc-2d7d-46eb-ba4d-08af75b946d6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:57 devstack sudo[107477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-7a9576fc-2d7d-46eb-ba4d-08af75b946d6
Nov 04 12:29:57 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:57 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dcf2ca04-f687-44a3-a54c-48f21083fb43 tempest-CreateVolumesFromSnapshotTest-2032084862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-7a9576fc-2d7d-46eb-ba4d-08af75b946d6" returned: 0 in 0.312s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:57 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-dcf2ca04-f687-44a3-a54c-48f21083fb43 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "cinder-quobyte-7a9576fc-2d7d-46eb-ba4d-08af75b946d6" released by "delete_volume" :: held 0.936s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:29:58 devstack sudo[107471]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:58 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-dcf2ca04-f687-44a3-a54c-48f21083fb43 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Created reservations ['5dea5c47-29c3-4092-a12b-3af7e761e7ec', '00ff0966-beee-4730-91c2-07b8da22827b', 'ec450a5e-3fd7-42f7-80d0-b36502a61e1e', 'bcdc6151-f103-4a36-9186-ff2d8d7acb99'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:29:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-04926cb1-b034-4d23-9ecb-94689793919b tempest-VolumeDependencyTests-297018988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de 1073741824" returned: 0 in 0.669s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-04926cb1-b034-4d23-9ecb-94689793919b tempest-VolumeDependencyTests-297018988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:58 devstack sudo[107484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de
Nov 04 12:29:58 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-dcf2ca04-f687-44a3-a54c-48f21083fb43 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-dcf2ca04-f687-44a3-a54c-48f21083fb43 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:58 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-dcf2ca04-f687-44a3-a54c-48f21083fb43 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:29:58 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-dcf2ca04-f687-44a3-a54c-48f21083fb43 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:29:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-dcf2ca04-f687-44a3-a54c-48f21083fb43 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dcf2ca04-f687-44a3-a54c-48f21083fb43 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:58 devstack sudo[107486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:29:58 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:58 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-04926cb1-b034-4d23-9ecb-94689793919b tempest-VolumeDependencyTests-297018988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de" returned: 0 in 0.362s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:58 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-04926cb1-b034-4d23-9ecb-94689793919b tempest-VolumeDependencyTests-297018988 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:29:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-04926cb1-b034-4d23-9ecb-94689793919b tempest-VolumeDependencyTests-297018988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:29:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-04926cb1-b034-4d23-9ecb-94689793919b tempest-VolumeDependencyTests-297018988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ede920df-1162-41b2-9d01-df42e86be04d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09900986-1012-4d1f-812b-ebad4c05b9de', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-04926cb1-b034-4d23-9ecb-94689793919b tempest-VolumeDependencyTests-297018988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a42891e2-841a-427c-ba1f-cd58a59d8f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:29:58 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-04926cb1-b034-4d23-9ecb-94689793919b tempest-VolumeDependencyTests-297018988 None] Volume volume-09900986-1012-4d1f-812b-ebad4c05b9de (09900986-1012-4d1f-812b-ebad4c05b9de): created successfully
Nov 04 12:29:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-04926cb1-b034-4d23-9ecb-94689793919b tempest-VolumeDependencyTests-297018988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a42891e2-841a-427c-ba1f-cd58a59d8f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:29:58 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-04926cb1-b034-4d23-9ecb-94689793919b tempest-VolumeDependencyTests-297018988 None] Flow 'volume_create_manager' (4201cdc5-b14d-42f5-9372-985fb01c6864) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:29:58 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:58 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-04926cb1-b034-4d23-9ecb-94689793919b tempest-VolumeDependencyTests-297018988 None] Created volume successfully.
Nov 04 12:29:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dcf2ca04-f687-44a3-a54c-48f21083fb43 tempest-CreateVolumesFromSnapshotTest-2032084862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.382s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:58 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-dcf2ca04-f687-44a3-a54c-48f21083fb43 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:29:58 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-dcf2ca04-f687-44a3-a54c-48f21083fb43 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Deleted volume successfully.
Nov 04 12:29:58 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-dcf2ca04-f687-44a3-a54c-48f21083fb43 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "cinder-7a9576fc-2d7d-46eb-ba4d-08af75b946d6-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:29:59 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a5a42967-5e76-4fce-b041-d8f61b125978 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Acquiring lock "cinder-3a325bb1-89ba-4877-98fe-85bc253b65c0-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:29:59 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a5a42967-5e76-4fce-b041-d8f61b125978 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "cinder-3a325bb1-89ba-4877-98fe-85bc253b65c0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:29:59 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a5a42967-5e76-4fce-b041-d8f61b125978 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Acquiring lock "cinder-quobyte-3a325bb1-89ba-4877-98fe-85bc253b65c0" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:29:59 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a5a42967-5e76-4fce-b041-d8f61b125978 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "cinder-quobyte-3a325bb1-89ba-4877-98fe-85bc253b65c0" acquired by "delete_volume" :: waited 0.020s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:29:59 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[511e75cb-bf28-4138-8c8b-0f9c74f5174d]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:29:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a5a42967-5e76-4fce-b041-d8f61b125978 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3a325bb1-89ba-4877-98fe-85bc253b65c0 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:59 devstack sudo[107490]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3a325bb1-89ba-4877-98fe-85bc253b65c0
Nov 04 12:29:59 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-bd8c53e9-9f0e-4bb7-9d7a-9e0be00f4f08 tempest-VolumeDependencyTests-297018988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:29:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-bd8c53e9-9f0e-4bb7-9d7a-9e0be00f4f08 tempest-VolumeDependencyTests-297018988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:29:59 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-bd8c53e9-9f0e-4bb7-9d7a-9e0be00f4f08 tempest-VolumeDependencyTests-297018988 None] Creating offline snapshot 29715d83-ab48-4858-a60a-68170d440392 of volume 09900986-1012-4d1f-812b-ebad4c05b9de {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:29:59 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d85a4cf-c919-4645-a965-9f11023a38c5]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:29:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bd8c53e9-9f0e-4bb7-9d7a-9e0be00f4f08 tempest-VolumeDependencyTests-297018988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:59 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root
Nov 04 12:29:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a5a42967-5e76-4fce-b041-d8f61b125978 tempest-CreateVolumesFromSnapshotTest-2032084862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3a325bb1-89ba-4877-98fe-85bc253b65c0" returned: 0 in 0.432s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:29:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a5a42967-5e76-4fce-b041-d8f61b125978 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3a325bb1-89ba-4877-98fe-85bc253b65c0 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:29:59 devstack sudo[107497]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3a325bb1-89ba-4877-98fe-85bc253b65c0
Nov 04 12:29:59 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:29:59 devstack sudo[107494]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de
Nov 04 12:29:59 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:00 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a5a42967-5e76-4fce-b041-d8f61b125978 tempest-CreateVolumesFromSnapshotTest-2032084862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-3a325bb1-89ba-4877-98fe-85bc253b65c0" returned: 0 in 0.311s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:00 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a5a42967-5e76-4fce-b041-d8f61b125978 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "cinder-quobyte-3a325bb1-89ba-4877-98fe-85bc253b65c0" released by "delete_volume" :: held 0.803s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:00 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-a5a42967-5e76-4fce-b041-d8f61b125978 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Created reservations ['9a4fc2c5-1f79-4551-9d3d-41d5bb34dfa1', '0c2a76ac-700d-4faf-ae28-1855ca1a6ba6', '66c307ec-3062-45df-83a4-0a5034e0f279', '511b2890-ce06-4818-ae8b-8431e90d88de'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:30:00 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bd8c53e9-9f0e-4bb7-9d7a-9e0be00f4f08 tempest-VolumeDependencyTests-297018988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de" returned: 0 in 0.514s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bd8c53e9-9f0e-4bb7-9d7a-9e0be00f4f08 tempest-VolumeDependencyTests-297018988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de.29715d83-ab48-4858-a60a-68170d440392 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:00 devstack sudo[107504]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de.29715d83-ab48-4858-a60a-68170d440392 1G
Nov 04 12:30:00 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a5a42967-5e76-4fce-b041-d8f61b125978 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a5a42967-5e76-4fce-b041-d8f61b125978 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:00 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a5a42967-5e76-4fce-b041-d8f61b125978 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:30:00 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a5a42967-5e76-4fce-b041-d8f61b125978 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:30:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a5a42967-5e76-4fce-b041-d8f61b125978 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a5a42967-5e76-4fce-b041-d8f61b125978 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:00 devstack sudo[107506]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:30:00 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:00 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-732264fb-5f5d-4219-a1b7-f593c3a06aff tempest-CreateVolumesFromSnapshotTest-2032084862 None] Acquiring lock "cinder-ea4a9246-9d7f-4790-8d8e-a3708f5936ed-delete_snapshot" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:00 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-732264fb-5f5d-4219-a1b7-f593c3a06aff tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "cinder-ea4a9246-9d7f-4790-8d8e-a3708f5936ed-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:00 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-732264fb-5f5d-4219-a1b7-f593c3a06aff tempest-CreateVolumesFromSnapshotTest-2032084862 None] Acquiring lock "cinder-quobyte-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:00 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-732264fb-5f5d-4219-a1b7-f593c3a06aff tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "cinder-quobyte-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:00 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-732264fb-5f5d-4219-a1b7-f593c3a06aff tempest-CreateVolumesFromSnapshotTest-2032084862 None] Acquiring lock "cinder-quobyte-ea4a9246-9d7f-4790-8d8e-a3708f5936ed" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:00 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-732264fb-5f5d-4219-a1b7-f593c3a06aff tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "cinder-quobyte-ea4a9246-9d7f-4790-8d8e-a3708f5936ed" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:00 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-732264fb-5f5d-4219-a1b7-f593c3a06aff tempest-CreateVolumesFromSnapshotTest-2032084862 None] Deleting offline snapshot ea4a9246-9d7f-4790-8d8e-a3708f5936ed of volume 1f08a3f0-ba1c-4e08-be81-259b3a20ecdf {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:30:00 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-732264fb-5f5d-4219-a1b7-f593c3a06aff tempest-CreateVolumesFromSnapshotTest-2032084862 None] snapshot_file for this snap is: volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf.ea4a9246-9d7f-4790-8d8e-a3708f5936ed {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:30:00 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:00 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[386d7b6e-b6af-409d-9761-9acb23ea6e06]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-732264fb-5f5d-4219-a1b7-f593c3a06aff tempest-CreateVolumesFromSnapshotTest-2032084862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf.ea4a9246-9d7f-4790-8d8e-a3708f5936ed {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a5a42967-5e76-4fce-b041-d8f61b125978 tempest-CreateVolumesFromSnapshotTest-2032084862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.351s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:00 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-a5a42967-5e76-4fce-b041-d8f61b125978 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:30:00 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-a5a42967-5e76-4fce-b041-d8f61b125978 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Deleted volume successfully.
Nov 04 12:30:00 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a5a42967-5e76-4fce-b041-d8f61b125978 tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "cinder-3a325bb1-89ba-4877-98fe-85bc253b65c0-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:00 devstack sudo[107512]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf.ea4a9246-9d7f-4790-8d8e-a3708f5936ed
Nov 04 12:30:00 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:00 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bd8c53e9-9f0e-4bb7-9d7a-9e0be00f4f08 tempest-VolumeDependencyTests-297018988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de.29715d83-ab48-4858-a60a-68170d440392 1G" returned: 0 in 0.622s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bd8c53e9-9f0e-4bb7-9d7a-9e0be00f4f08 tempest-VolumeDependencyTests-297018988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09900986-1012-4d1f-812b-ebad4c05b9de -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de.29715d83-ab48-4858-a60a-68170d440392 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:00 devstack sudo[107515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09900986-1012-4d1f-812b-ebad4c05b9de -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de.29715d83-ab48-4858-a60a-68170d440392
Nov 04 12:30:00 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:01 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-732264fb-5f5d-4219-a1b7-f593c3a06aff tempest-CreateVolumesFromSnapshotTest-2032084862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf.ea4a9246-9d7f-4790-8d8e-a3708f5936ed" returned: 0 in 0.450s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:01 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-732264fb-5f5d-4219-a1b7-f593c3a06aff tempest-CreateVolumesFromSnapshotTest-2032084862 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:30:01 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed66d3a-b931-430e-8792-bc2b148e7b00]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-732264fb-5f5d-4219-a1b7-f593c3a06aff tempest-CreateVolumesFromSnapshotTest-2032084862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:01 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bd8c53e9-9f0e-4bb7-9d7a-9e0be00f4f08 tempest-VolumeDependencyTests-297018988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09900986-1012-4d1f-812b-ebad4c05b9de -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de.29715d83-ab48-4858-a60a-68170d440392" returned: 0 in 0.368s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:01 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-bd8c53e9-9f0e-4bb7-9d7a-9e0be00f4f08 tempest-VolumeDependencyTests-297018988 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de.29715d83-ab48-4858-a60a-68170d440392 is being set with open permissions: ugo+rw
Nov 04 12:30:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bd8c53e9-9f0e-4bb7-9d7a-9e0be00f4f08 tempest-VolumeDependencyTests-297018988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de.29715d83-ab48-4858-a60a-68170d440392 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:01 devstack sudo[107524]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de.29715d83-ab48-4858-a60a-68170d440392
Nov 04 12:30:01 devstack sudo[107524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:01 devstack sudo[107522]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf
Nov 04 12:30:01 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:01 devstack sudo[107524]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bd8c53e9-9f0e-4bb7-9d7a-9e0be00f4f08 tempest-VolumeDependencyTests-297018988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de.29715d83-ab48-4858-a60a-68170d440392" returned: 0 in 0.304s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bd8c53e9-9f0e-4bb7-9d7a-9e0be00f4f08 tempest-VolumeDependencyTests-297018988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:01 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-732264fb-5f5d-4219-a1b7-f593c3a06aff tempest-CreateVolumesFromSnapshotTest-2032084862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf" returned: 0 in 0.504s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-732264fb-5f5d-4219-a1b7-f593c3a06aff tempest-CreateVolumesFromSnapshotTest-2032084862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf.ea4a9246-9d7f-4790-8d8e-a3708f5936ed {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:01 devstack sudo[107532]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de.info
Nov 04 12:30:01 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:01 devstack sudo[107533]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf.ea4a9246-9d7f-4790-8d8e-a3708f5936ed
Nov 04 12:30:01 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:01 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bd8c53e9-9f0e-4bb7-9d7a-9e0be00f4f08 tempest-VolumeDependencyTests-297018988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de.info" returned: 0 in 0.348s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:01 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-bd8c53e9-9f0e-4bb7-9d7a-9e0be00f4f08 tempest-VolumeDependencyTests-297018988 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de.info is being set with open permissions: ugo+rw
Nov 04 12:30:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bd8c53e9-9f0e-4bb7-9d7a-9e0be00f4f08 tempest-VolumeDependencyTests-297018988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:01 devstack sudo[107539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de.info
Nov 04 12:30:01 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:02 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-732264fb-5f5d-4219-a1b7-f593c3a06aff tempest-CreateVolumesFromSnapshotTest-2032084862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf.ea4a9246-9d7f-4790-8d8e-a3708f5936ed" returned: 0 in 0.588s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-732264fb-5f5d-4219-a1b7-f593c3a06aff tempest-CreateVolumesFromSnapshotTest-2032084862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf.ea4a9246-9d7f-4790-8d8e-a3708f5936ed {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:02 devstack sudo[107542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf.ea4a9246-9d7f-4790-8d8e-a3708f5936ed
Nov 04 12:30:02 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:02 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:30:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Flow 'volume_create_manager' (b5105013-819a-416c-8d14-e6dd6160bc82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:30:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c5b6c6e-f812-4ef6-95d8-e9f377b978d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:02 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bd8c53e9-9f0e-4bb7-9d7a-9e0be00f4f08 tempest-VolumeDependencyTests-297018988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de.info" returned: 0 in 0.398s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-bd8c53e9-9f0e-4bb7-9d7a-9e0be00f4f08 tempest-VolumeDependencyTests-297018988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.701s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c5b6c6e-f812-4ef6-95d8-e9f377b978d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:30:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab15c6ed-4962-4150-8cc5-6282a0206f79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0afae3e18642460d904f4793173cb7f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:02Z,use_quota=True,user_id='5acc49bedb764f5fb016059d40ab3b58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50b95652-b457-44f2-a2b9-02fced44279a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50b95652-b457-44f2-a2b9-02fced44279a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ac448c2-3aaf-4ef9-9710-9e34d579185b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:02 devstack cinder-volume[87169]: DEBUG cinder.image.glance [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Creating Keystone auth plugin from conf {{(pid=87169) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}}
Nov 04 12:30:02 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-bd8c53e9-9f0e-4bb7-9d7a-9e0be00f4f08 tempest-VolumeDependencyTests-297018988 None] Create snapshot completed successfully
Nov 04 12:30:02 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-732264fb-5f5d-4219-a1b7-f593c3a06aff tempest-CreateVolumesFromSnapshotTest-2032084862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf.ea4a9246-9d7f-4790-8d8e-a3708f5936ed" returned: 0 in 0.315s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:02 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-732264fb-5f5d-4219-a1b7-f593c3a06aff tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "cinder-quobyte-ea4a9246-9d7f-4790-8d8e-a3708f5936ed" released by "_delete_snapshot" :: held 2.001s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:02 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-732264fb-5f5d-4219-a1b7-f593c3a06aff tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "cinder-quobyte-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf" released by "delete_snapshot" :: held 2.051s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:02 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-732264fb-5f5d-4219-a1b7-f593c3a06aff tempest-CreateVolumesFromSnapshotTest-2032084862 None] Created reservations ['35a07fb7-1cdf-4349-be80-6b2554df5d3a', '21fb52f2-dbfd-43bc-af3a-e21c387064e4', '500191dd-63af-4123-940b-fec7d2314381', '65dcba00-d08a-4973-a268-c5ee68dbd089'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:30:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ac448c2-3aaf-4ef9-9710-9e34d579185b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ab15c6ed-4962-4150-8cc5-6282a0206f79', 'volume_name': 'volume-ab15c6ed-4962-4150-8cc5-6282a0206f79', 'volume_size': 1, 'image_id': 'eabbf4ce-1523-40d5-86d8-b77311e52cbd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eabbf4ce-1523-40d5-86d8-b77311e52cbd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '47fa5d0f49368c1c3f42bf1dd7a508dc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0afae3e18642460d904f4793173cb7f9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '06f86b04ac4d2353df68c3220212b9c2221f38fc13d6352dcd8c34fb858428ca5547e847f031023f9a7a09fbfbc0b3f88ecf1ad27546f0b2c0dd7a4a148c3046', 'id': 'eabbf4ce-1523-40d5-86d8-b77311e52cbd', 'created_at': datetime.datetime(2026, 11, 4, 11, 29, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 30, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eabbf4ce-1523-40d5-86d8-b77311e52cbd/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cc0591a6d50>}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5ba1b09-f6a8-4453-a85e-6d958354beae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5ba1b09-f6a8-4453-a85e-6d958354beae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:02 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1017e98b-bb10-4859-bb00-1067852b2aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:02 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Volume ab15c6ed-4962-4150-8cc5-6282a0206f79: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ab15c6ed-4962-4150-8cc5-6282a0206f79', 'volume_size': 1, 'image_id': 'eabbf4ce-1523-40d5-86d8-b77311e52cbd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eabbf4ce-1523-40d5-86d8-b77311e52cbd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '47fa5d0f49368c1c3f42bf1dd7a508dc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0afae3e18642460d904f4793173cb7f9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '06f86b04ac4d2353df68c3220212b9c2221f38fc13d6352dcd8c34fb858428ca5547e847f031023f9a7a09fbfbc0b3f88ecf1ad27546f0b2c0dd7a4a148c3046', 'id': 'eabbf4ce-1523-40d5-86d8-b77311e52cbd', 'created_at': datetime.datetime(2026, 11, 4, 11, 29, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 30, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eabbf4ce-1523-40d5-86d8-b77311e52cbd/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cc0591a6d50>}
Nov 04 12:30:02 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Trying to clone ab15c6ed-4962-4150-8cc5-6282a0206f79 from image eabbf4ce-1523-40d5-86d8-b77311e52cbd at location (None, [{'url': 'file:///opt/stack/data/glance/images/eabbf4ce-1523-40d5-86d8-b77311e52cbd', 'metadata': {}}]). {{(pid=87169) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}}
Nov 04 12:30:02 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_eabbf4ce-1523-40d5-86d8-b77311e52cbd_vhmrxgv9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87169) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}}
Nov 04 12:30:02 devstack cinder-volume[87169]: INFO cinder.image.image_utils [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Image download 0.00 MB at 0.00 MB/s
Nov 04 12:30:02 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-732264fb-5f5d-4219-a1b7-f593c3a06aff tempest-CreateVolumesFromSnapshotTest-2032084862 None] Delete snapshot completed successfully.
Nov 04 12:30:02 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-732264fb-5f5d-4219-a1b7-f593c3a06aff tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "cinder-ea4a9246-9d7f-4790-8d8e-a3708f5936ed-delete_snapshot" released by "delete_snapshot" :: held 2.398s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:02 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0abcc9-7283-46b0-9d3c-ec4f7c204eca]: (4, 'raw') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eabbf4ce-1523-40d5-86d8-b77311e52cbd_vhmrxgv9devstack@QuobyteHD {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:03 devstack sudo[107546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eabbf4ce-1523-40d5-86d8-b77311e52cbd_vhmrxgv9devstack@QuobyteHD
Nov 04 12:30:03 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:03 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eabbf4ce-1523-40d5-86d8-b77311e52cbd_vhmrxgv9devstack@QuobyteHD" returned: 0 in 0.396s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eabbf4ce-1523-40d5-86d8-b77311e52cbd_vhmrxgv9devstack@QuobyteHD {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:03 devstack sudo[107550]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eabbf4ce-1523-40d5-86d8-b77311e52cbd_vhmrxgv9devstack@QuobyteHD
Nov 04 12:30:03 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:03 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:30:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Flow 'volume_create_manager' (a986f21b-7c43-4df0-985c-633f5cbc586e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:30:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8df8123-8592-41d0-8b47-b18be16f423d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8df8123-8592-41d0-8b47-b18be16f423d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1685329988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3646f51-b1bc-4a0f-8a55-dbcfd5ef6d3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9af797ae856642b5a22cca67640b63b1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=29715d83-ab48-4858-a60a-68170d440392,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:03Z,use_quota=True,user_id='7fb80e12c13b412588f80943f01758c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2644cbf9-9ab2-42e3-a58f-93e93bb75b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2644cbf9-9ab2-42e3-a58f-93e93bb75b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (765cf4f0-de07-4cd6-8c3e-76e4c55c6749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (765cf4f0-de07-4cd6-8c3e-76e4c55c6749) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b3646f51-b1bc-4a0f-8a55-dbcfd5ef6d3a', 'volume_name': 'volume-b3646f51-b1bc-4a0f-8a55-dbcfd5ef6d3a', 'volume_size': 1, 'snapshot_id': '29715d83-ab48-4858-a60a-68170d440392'}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7284b367-659c-4db0-b445-b87d0d7ec3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7284b367-659c-4db0-b445-b87d0d7ec3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:03 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fe74459-a9c2-42db-ae56-37e8b6acd4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:03 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Volume b3646f51-b1bc-4a0f-8a55-dbcfd5ef6d3a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b3646f51-b1bc-4a0f-8a55-dbcfd5ef6d3a', 'volume_size': 1, 'snapshot_id': '29715d83-ab48-4858-a60a-68170d440392'}
Nov 04 12:30:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:03 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Acquiring lock "cinder-quobyte-29715d83-ab48-4858-a60a-68170d440392-b3646f51-b1bc-4a0f-8a55-dbcfd5ef6d3a" by "_create_volume_from_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:03 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Lock "cinder-quobyte-29715d83-ab48-4858-a60a-68170d440392-b3646f51-b1bc-4a0f-8a55-dbcfd5ef6d3a" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:03 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Creating volume b3646f51-b1bc-4a0f-8a55-dbcfd5ef6d3a from snapshot 29715d83-ab48-4858-a60a-68170d440392 {{(pid=87169) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 04 12:30:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:03 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:30:03 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:30:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:03 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:30:03 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Acquiring lock "cinder-quobyte-b3646f51-b1bc-4a0f-8a55-dbcfd5ef6d3a" by "_copy_volume_from_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:03 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Lock "cinder-quobyte-b3646f51-b1bc-4a0f-8a55-dbcfd5ef6d3a" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:03 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] snapshot: 29715d83-ab48-4858-a60a-68170d440392, volume: b3646f51-b1bc-4a0f-8a55-dbcfd5ef6d3a,  {{(pid=87169) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 04 12:30:03 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eabbf4ce-1523-40d5-86d8-b77311e52cbd_vhmrxgv9devstack@QuobyteHD" returned: 1 in 0.388s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eabbf4ce-1523-40d5-86d8-b77311e52cbd_vhmrxgv9devstack@QuobyteHD' failed. Not Retrying. {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 12:30:03 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Temporary image eabbf4ce-1523-40d5-86d8-b77311e52cbd is fetched for user 5acc49bedb764f5fb016059d40ab3b58. {{(pid=87169) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}}
Nov 04 12:30:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:03 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:30:03 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:30:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:03 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-dbe063c0-d9d4-4657-a3bd-cecf3a8b4ddf tempest-CreateVolumesFromSnapshotTest-2032084862 None] Acquiring lock "cinder-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:03 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[57968eb2-1479-41a4-9b51-e47dec276027]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de.29715d83-ab48-4858-a60a-68170d440392 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:03 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-dbe063c0-d9d4-4657-a3bd-cecf3a8b4ddf tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "cinder-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:03 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-dbe063c0-d9d4-4657-a3bd-cecf3a8b4ddf tempest-CreateVolumesFromSnapshotTest-2032084862 None] Acquiring lock "cinder-quobyte-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:03 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca79136-0116-4513-b127-a944619aec12]: (4, 'raw') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eabbf4ce-1523-40d5-86d8-b77311e52cbd_vhmrxgv9devstack@QuobyteHD {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:03 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-dbe063c0-d9d4-4657-a3bd-cecf3a8b4ddf tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "cinder-quobyte-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf" acquired by "delete_volume" :: waited 0.032s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:03 devstack sudo[107555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de.29715d83-ab48-4858-a60a-68170d440392
Nov 04 12:30:03 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:03 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b88c24-3b14-4810-9032-7710d9edc3ba]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dbe063c0-d9d4-4657-a3bd-cecf3a8b4ddf tempest-CreateVolumesFromSnapshotTest-2032084862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:03 devstack sudo[107556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eabbf4ce-1523-40d5-86d8-b77311e52cbd_vhmrxgv9devstack@QuobyteHD
Nov 04 12:30:03 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:04 devstack sudo[107558]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf
Nov 04 12:30:04 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:04 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eabbf4ce-1523-40d5-86d8-b77311e52cbd_vhmrxgv9devstack@QuobyteHD" returned: 0 in 0.385s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eabbf4ce-1523-40d5-86d8-b77311e52cbd_vhmrxgv9devstack@QuobyteHD {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:04 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de.29715d83-ab48-4858-a60a-68170d440392" returned: 0 in 0.516s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:04 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09900986-1012-4d1f-812b-ebad4c05b9de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:30:04 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2551033-63da-4335-b688-bbeea68d3634]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:04 devstack sudo[107566]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eabbf4ce-1523-40d5-86d8-b77311e52cbd_vhmrxgv9devstack@QuobyteHD
Nov 04 12:30:04 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:04 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dbe063c0-d9d4-4657-a3bd-cecf3a8b4ddf tempest-CreateVolumesFromSnapshotTest-2032084862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf" returned: 0 in 0.438s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dbe063c0-d9d4-4657-a3bd-cecf3a8b4ddf tempest-CreateVolumesFromSnapshotTest-2032084862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:04 devstack sudo[107572]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf
Nov 04 12:30:04 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:04 devstack sudo[107569]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de
Nov 04 12:30:04 devstack sudo[107569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:04 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eabbf4ce-1523-40d5-86d8-b77311e52cbd_vhmrxgv9devstack@QuobyteHD" returned: 1 in 0.382s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eabbf4ce-1523-40d5-86d8-b77311e52cbd_vhmrxgv9devstack@QuobyteHD' failed. Not Retrying. {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 12:30:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:04 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dbe063c0-d9d4-4657-a3bd-cecf3a8b4ddf tempest-CreateVolumesFromSnapshotTest-2032084862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf" returned: 0 in 0.322s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:04 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-dbe063c0-d9d4-4657-a3bd-cecf3a8b4ddf tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "cinder-quobyte-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf" released by "delete_volume" :: held 0.851s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:04 devstack sudo[107569]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de" returned: 0 in 0.440s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:04 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de {{(pid=87169) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 04 12:30:04 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Creating direct copy from snapshot {{(pid=87169) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 04 12:30:04 devstack cinder-volume[87169]: DEBUG cinder.utils [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Path /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-b3646f51-b1bc-4a0f-8a55-dbcfd5ef6d3a not found in is_blk_device check {{(pid=87169) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 04 12:30:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-b3646f51-b1bc-4a0f-8a55-dbcfd5ef6d3a {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:04 devstack sudo[107582]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-b3646f51-b1bc-4a0f-8a55-dbcfd5ef6d3a
Nov 04 12:30:04 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:04 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-dbe063c0-d9d4-4657-a3bd-cecf3a8b4ddf tempest-CreateVolumesFromSnapshotTest-2032084862 None] Created reservations ['b6f882be-d759-451a-b201-28292168b817', '2885fca5-2275-4b6c-a8a2-da5e26252306', '002cacca-c290-4b2c-a510-505fb593996c', 'f2aa6674-3a27-47d8-ac6f-c64d93306d6a'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:30:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-dbe063c0-d9d4-4657-a3bd-cecf3a8b4ddf tempest-CreateVolumesFromSnapshotTest-2032084862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-dbe063c0-d9d4-4657-a3bd-cecf3a8b4ddf tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:04 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-dbe063c0-d9d4-4657-a3bd-cecf3a8b4ddf tempest-CreateVolumesFromSnapshotTest-2032084862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:30:04 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-dbe063c0-d9d4-4657-a3bd-cecf3a8b4ddf tempest-CreateVolumesFromSnapshotTest-2032084862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:30:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-dbe063c0-d9d4-4657-a3bd-cecf3a8b4ddf tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dbe063c0-d9d4-4657-a3bd-cecf3a8b4ddf tempest-CreateVolumesFromSnapshotTest-2032084862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:04 devstack sudo[107584]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:30:04 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:05 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dbe063c0-d9d4-4657-a3bd-cecf3a8b4ddf tempest-CreateVolumesFromSnapshotTest-2032084862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.270s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:05 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-dbe063c0-d9d4-4657-a3bd-cecf3a8b4ddf tempest-CreateVolumesFromSnapshotTest-2032084862 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:30:05 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-dbe063c0-d9d4-4657-a3bd-cecf3a8b4ddf tempest-CreateVolumesFromSnapshotTest-2032084862 None] Deleted volume successfully.
Nov 04 12:30:05 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-dbe063c0-d9d4-4657-a3bd-cecf3a8b4ddf tempest-CreateVolumesFromSnapshotTest-2032084862 None] Lock "cinder-1f08a3f0-ba1c-4e08-be81-259b3a20ecdf-delete_volume" released by "delete_volume" :: held 1.416s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:13 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-b3646f51-b1bc-4a0f-8a55-dbcfd5ef6d3a" returned: 0 in 8.607s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:13 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Image conversion details: src /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de, size 1024.00 MB, duration 8.61 sec, destination /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-b3646f51-b1bc-4a0f-8a55-dbcfd5ef6d3a {{(pid=87169) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 12:30:13 devstack cinder-volume[87169]: INFO cinder.image.image_utils [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Converted 1024.00 MB image at 118.95 MB/s
Nov 04 12:30:13 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-b3646f51-b1bc-4a0f-8a55-dbcfd5ef6d3a is being set with open permissions: ugo+rw
Nov 04 12:30:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-b3646f51-b1bc-4a0f-8a55-dbcfd5ef6d3a {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:13 devstack sudo[107604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-b3646f51-b1bc-4a0f-8a55-dbcfd5ef6d3a
Nov 04 12:30:13 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:13 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-b3646f51-b1bc-4a0f-8a55-dbcfd5ef6d3a" returned: 0 in 0.272s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:13 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Lock "cinder-quobyte-b3646f51-b1bc-4a0f-8a55-dbcfd5ef6d3a" released by "_copy_volume_from_snapshot" :: held 9.953s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:13 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Lock "cinder-quobyte-29715d83-ab48-4858-a60a-68170d440392-b3646f51-b1bc-4a0f-8a55-dbcfd5ef6d3a" released by "_create_volume_from_snapshot" :: held 10.031s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.048s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.072s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:13 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:30:02Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab15c6ed-4962-4150-8cc5-6282a0206f79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0afae3e18642460d904f4793173cb7f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:02Z,use_quota=True,user_id='5acc49bedb764f5fb016059d40ab3b58',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:30:13 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Creating volume ab15c6ed-4962-4150-8cc5-6282a0206f79 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:30:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:13 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:30:13 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:30:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:13 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:30:13 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:30:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ab15c6ed-4962-4150-8cc5-6282a0206f79 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:13 devstack sudo[107607]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ab15c6ed-4962-4150-8cc5-6282a0206f79 1073741824
Nov 04 12:30:13 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:13 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fe74459-a9c2-42db-ae56-37e8b6acd4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3646f51-b1bc-4a0f-8a55-dbcfd5ef6d3a', 'volume_size': 1, 'snapshot_id': '29715d83-ab48-4858-a60a-68170d440392'}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:13 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (572394cd-4d18-47f7-a0aa-030fd8736d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:13 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Volume volume-b3646f51-b1bc-4a0f-8a55-dbcfd5ef6d3a (b3646f51-b1bc-4a0f-8a55-dbcfd5ef6d3a): created successfully
Nov 04 12:30:13 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (572394cd-4d18-47f7-a0aa-030fd8736d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:13 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Flow 'volume_create_manager' (a986f21b-7c43-4df0-985c-633f5cbc586e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:30:13 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-47d536e5-af30-47cc-ab39-fd4d2e1b3bd4 tempest-VolumeDependencyTests-297018988 None] Created volume successfully.
Nov 04 12:30:14 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ab15c6ed-4962-4150-8cc5-6282a0206f79 1073741824" returned: 0 in 0.559s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ab15c6ed-4962-4150-8cc5-6282a0206f79 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:14 devstack sudo[107613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ab15c6ed-4962-4150-8cc5-6282a0206f79
Nov 04 12:30:14 devstack sudo[107613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:14 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c61fb064-f0fe-4fbb-aff6-491c1974027e tempest-VolumeDependencyTests-297018988 None] Acquiring lock "cinder-29715d83-ab48-4858-a60a-68170d440392-delete_snapshot" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:14 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c61fb064-f0fe-4fbb-aff6-491c1974027e tempest-VolumeDependencyTests-297018988 None] Lock "cinder-29715d83-ab48-4858-a60a-68170d440392-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:14 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c61fb064-f0fe-4fbb-aff6-491c1974027e tempest-VolumeDependencyTests-297018988 None] Acquiring lock "cinder-quobyte-09900986-1012-4d1f-812b-ebad4c05b9de" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:14 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c61fb064-f0fe-4fbb-aff6-491c1974027e tempest-VolumeDependencyTests-297018988 None] Lock "cinder-quobyte-09900986-1012-4d1f-812b-ebad4c05b9de" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:14 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c61fb064-f0fe-4fbb-aff6-491c1974027e tempest-VolumeDependencyTests-297018988 None] Acquiring lock "cinder-quobyte-29715d83-ab48-4858-a60a-68170d440392" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:14 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c61fb064-f0fe-4fbb-aff6-491c1974027e tempest-VolumeDependencyTests-297018988 None] Lock "cinder-quobyte-29715d83-ab48-4858-a60a-68170d440392" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:14 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-c61fb064-f0fe-4fbb-aff6-491c1974027e tempest-VolumeDependencyTests-297018988 None] Deleting offline snapshot 29715d83-ab48-4858-a60a-68170d440392 of volume 09900986-1012-4d1f-812b-ebad4c05b9de {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:30:14 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-c61fb064-f0fe-4fbb-aff6-491c1974027e tempest-VolumeDependencyTests-297018988 None] snapshot_file for this snap is: volume-09900986-1012-4d1f-812b-ebad4c05b9de.29715d83-ab48-4858-a60a-68170d440392 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:30:14 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb0ecb4-3d85-4461-a69f-2578b00d4c78]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c61fb064-f0fe-4fbb-aff6-491c1974027e tempest-VolumeDependencyTests-297018988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de.29715d83-ab48-4858-a60a-68170d440392 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:14 devstack sudo[107613]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ab15c6ed-4962-4150-8cc5-6282a0206f79" returned: 0 in 0.330s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:14 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:30:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:14 devstack cinder-volume[87169]: DEBUG cinder.volume.volume_utils [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Attempting download of eabbf4ce-1523-40d5-86d8-b77311e52cbd ((None, [{'url': 'file:///opt/stack/data/glance/images/eabbf4ce-1523-40d5-86d8-b77311e52cbd', 'metadata': {}}])) to volume ab15c6ed-4962-4150-8cc5-6282a0206f79. {{(pid=87169) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}}
Nov 04 12:30:14 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[b736a437-2fab-4fb5-a1e2-9e5cb8a9884d]: (4, 'raw') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eabbf4ce-1523-40d5-86d8-b77311e52cbd_8yx73fc7 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:14 devstack sudo[107616]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de.29715d83-ab48-4858-a60a-68170d440392
Nov 04 12:30:14 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:14 devstack sudo[107618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eabbf4ce-1523-40d5-86d8-b77311e52cbd_8yx73fc7
Nov 04 12:30:14 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:15 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c61fb064-f0fe-4fbb-aff6-491c1974027e tempest-VolumeDependencyTests-297018988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de.29715d83-ab48-4858-a60a-68170d440392" returned: 0 in 0.484s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:15 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-c61fb064-f0fe-4fbb-aff6-491c1974027e tempest-VolumeDependencyTests-297018988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09900986-1012-4d1f-812b-ebad4c05b9de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:30:15 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1add67-6fa6-4095-996f-042725f96a95]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c61fb064-f0fe-4fbb-aff6-491c1974027e tempest-VolumeDependencyTests-297018988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:15 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_eabbf4ce-1523-40d5-86d8-b77311e52cbd_8yx73fc7" returned: 0 in 0.429s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eabbf4ce-1523-40d5-86d8-b77311e52cbd_8yx73fc7 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:15 devstack sudo[107625]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de
Nov 04 12:30:15 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:15 devstack sudo[107626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eabbf4ce-1523-40d5-86d8-b77311e52cbd_8yx73fc7
Nov 04 12:30:15 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:15 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eabbf4ce-1523-40d5-86d8-b77311e52cbd_8yx73fc7" returned: 1 in 0.449s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_eabbf4ce-1523-40d5-86d8-b77311e52cbd_8yx73fc7' failed. Not Retrying. {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 12:30:15 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa39987-4a45-4d77-a9a7-8842a46c77c7]: (4, 'raw') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eabbf4ce-1523-40d5-86d8-b77311e52cbd_vhmrxgv9devstack@QuobyteHD {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:15 devstack sudo[107633]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eabbf4ce-1523-40d5-86d8-b77311e52cbd_vhmrxgv9devstack@QuobyteHD
Nov 04 12:30:15 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:15 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c61fb064-f0fe-4fbb-aff6-491c1974027e tempest-VolumeDependencyTests-297018988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de" returned: 0 in 0.726s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c61fb064-f0fe-4fbb-aff6-491c1974027e tempest-VolumeDependencyTests-297018988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de.29715d83-ab48-4858-a60a-68170d440392 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:15 devstack sudo[107636]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de.29715d83-ab48-4858-a60a-68170d440392
Nov 04 12:30:15 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:16 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_eabbf4ce-1523-40d5-86d8-b77311e52cbd_vhmrxgv9devstack@QuobyteHD" returned: 0 in 0.437s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eabbf4ce-1523-40d5-86d8-b77311e52cbd_vhmrxgv9devstack@QuobyteHD {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:16 devstack sudo[107640]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eabbf4ce-1523-40d5-86d8-b77311e52cbd_vhmrxgv9devstack@QuobyteHD
Nov 04 12:30:16 devstack sudo[107640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:16 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c61fb064-f0fe-4fbb-aff6-491c1974027e tempest-VolumeDependencyTests-297018988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de.29715d83-ab48-4858-a60a-68170d440392" returned: 0 in 0.467s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c61fb064-f0fe-4fbb-aff6-491c1974027e tempest-VolumeDependencyTests-297018988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de.29715d83-ab48-4858-a60a-68170d440392 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:16 devstack sudo[107645]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de.29715d83-ab48-4858-a60a-68170d440392
Nov 04 12:30:16 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:16 devstack sudo[107640]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eabbf4ce-1523-40d5-86d8-b77311e52cbd_vhmrxgv9devstack@QuobyteHD" returned: 1 in 0.495s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_eabbf4ce-1523-40d5-86d8-b77311e52cbd_vhmrxgv9devstack@QuobyteHD' failed. Not Retrying. {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}}
Nov 04 12:30:16 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] eabbf4ce-1523-40d5-86d8-b77311e52cbd was raw, converting to qcow2 {{(pid=87169) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}}
Nov 04 12:30:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_eabbf4ce-1523-40d5-86d8-b77311e52cbd_vhmrxgv9devstack@QuobyteHD /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ab15c6ed-4962-4150-8cc5-6282a0206f79 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:16 devstack sudo[107650]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_eabbf4ce-1523-40d5-86d8-b77311e52cbd_vhmrxgv9devstack@QuobyteHD /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ab15c6ed-4962-4150-8cc5-6282a0206f79
Nov 04 12:30:16 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:16 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c61fb064-f0fe-4fbb-aff6-491c1974027e tempest-VolumeDependencyTests-297018988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de.29715d83-ab48-4858-a60a-68170d440392" returned: 0 in 0.345s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:16 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c61fb064-f0fe-4fbb-aff6-491c1974027e tempest-VolumeDependencyTests-297018988 None] Lock "cinder-quobyte-29715d83-ab48-4858-a60a-68170d440392" released by "_delete_snapshot" :: held 2.177s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:16 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c61fb064-f0fe-4fbb-aff6-491c1974027e tempest-VolumeDependencyTests-297018988 None] Lock "cinder-quobyte-09900986-1012-4d1f-812b-ebad4c05b9de" released by "delete_snapshot" :: held 2.207s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:16 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-c61fb064-f0fe-4fbb-aff6-491c1974027e tempest-VolumeDependencyTests-297018988 None] Created reservations ['f017eaf1-a5ef-444c-87a3-a373d8e99295', '4fa5e1be-45e9-45b3-b5c3-b4880b26a77a', '62900193-34bf-4680-b037-a3ee8fc85f84', '6381cdf1-9d4f-4b28-878a-b1b175921f75'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:30:16 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-c61fb064-f0fe-4fbb-aff6-491c1974027e tempest-VolumeDependencyTests-297018988 None] Delete snapshot completed successfully.
Nov 04 12:30:16 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c61fb064-f0fe-4fbb-aff6-491c1974027e tempest-VolumeDependencyTests-297018988 None] Lock "cinder-29715d83-ab48-4858-a60a-68170d440392-delete_snapshot" released by "delete_snapshot" :: held 2.403s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:17 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_eabbf4ce-1523-40d5-86d8-b77311e52cbd_vhmrxgv9devstack@QuobyteHD /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ab15c6ed-4962-4150-8cc5-6282a0206f79" returned: 0 in 0.586s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:17 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_eabbf4ce-1523-40d5-86d8-b77311e52cbd_vhmrxgv9devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ab15c6ed-4962-4150-8cc5-6282a0206f79 {{(pid=87169) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 12:30:17 devstack cinder-volume[87169]: INFO cinder.image.image_utils [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Converted 0.00 MB image at 0.00 MB/s
Nov 04 12:30:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ab15c6ed-4962-4150-8cc5-6282a0206f79 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:17 devstack sudo[107657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ab15c6ed-4962-4150-8cc5-6282a0206f79 1G
Nov 04 12:30:17 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:17 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ab15c6ed-4962-4150-8cc5-6282a0206f79 1G" returned: 0 in 0.361s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:17 devstack cinder-volume[87169]: DEBUG cinder.volume.volume_utils [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Downloaded image eabbf4ce-1523-40d5-86d8-b77311e52cbd ((None, [{'url': 'file:///opt/stack/data/glance/images/eabbf4ce-1523-40d5-86d8-b77311e52cbd', 'metadata': {}}])) to volume ab15c6ed-4962-4150-8cc5-6282a0206f79 successfully. {{(pid=87169) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}}
Nov 04 12:30:17 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Temporary image eabbf4ce-1523-40d5-86d8-b77311e52cbd for user 5acc49bedb764f5fb016059d40ab3b58 is deleted. {{(pid=87169) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}}
Nov 04 12:30:17 devstack cinder-volume[87169]: DEBUG cinder.volume.volume_utils [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Marking volume ab15c6ed-4962-4150-8cc5-6282a0206f79 as bootable. {{(pid=87169) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}}
Nov 04 12:30:17 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Copying metadata from image eabbf4ce-1523-40d5-86d8-b77311e52cbd to ab15c6ed-4962-4150-8cc5-6282a0206f79. {{(pid=87169) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Nov 04 12:30:17 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Creating volume glance metadata for volume ab15c6ed-4962-4150-8cc5-6282a0206f79 backed by image eabbf4ce-1523-40d5-86d8-b77311e52cbd with: {'image_id': 'eabbf4ce-1523-40d5-86d8-b77311e52cbd', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '47fa5d0f49368c1c3f42bf1dd7a508dc', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87169) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Nov 04 12:30:17 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1017e98b-bb10-4859-bb00-1067852b2aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab15c6ed-4962-4150-8cc5-6282a0206f79', 'volume_size': 1, 'image_id': 'eabbf4ce-1523-40d5-86d8-b77311e52cbd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/eabbf4ce-1523-40d5-86d8-b77311e52cbd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '47fa5d0f49368c1c3f42bf1dd7a508dc', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0afae3e18642460d904f4793173cb7f9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '06f86b04ac4d2353df68c3220212b9c2221f38fc13d6352dcd8c34fb858428ca5547e847f031023f9a7a09fbfbc0b3f88ecf1ad27546f0b2c0dd7a4a148c3046', 'id': 'eabbf4ce-1523-40d5-86d8-b77311e52cbd', 'created_at': datetime.datetime(2026, 11, 4, 11, 29, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 4, 11, 30, 1, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/eabbf4ce-1523-40d5-86d8-b77311e52cbd/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7cc0591a6d50>}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:17 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (620df06a-608a-4bfe-897a-08d2461833d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:17 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Volume volume-ab15c6ed-4962-4150-8cc5-6282a0206f79 (ab15c6ed-4962-4150-8cc5-6282a0206f79): created successfully
Nov 04 12:30:17 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (620df06a-608a-4bfe-897a-08d2461833d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:17 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Flow 'volume_create_manager' (b5105013-819a-416c-8d14-e6dd6160bc82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:30:17 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-bbfec15c-bedc-4dd9-9798-a45f41e3fcb7 tempest-VolumeImageDependencyTests-881313610 None] Created volume successfully.
Nov 04 12:30:17 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-420785b5-77cf-4d49-b62d-6e254f6438eb tempest-VolumeDependencyTests-297018988 None] Acquiring lock "cinder-09900986-1012-4d1f-812b-ebad4c05b9de-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:17 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-420785b5-77cf-4d49-b62d-6e254f6438eb tempest-VolumeDependencyTests-297018988 None] Lock "cinder-09900986-1012-4d1f-812b-ebad4c05b9de-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:17 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-420785b5-77cf-4d49-b62d-6e254f6438eb tempest-VolumeDependencyTests-297018988 None] Acquiring lock "cinder-quobyte-09900986-1012-4d1f-812b-ebad4c05b9de" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:17 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-420785b5-77cf-4d49-b62d-6e254f6438eb tempest-VolumeDependencyTests-297018988 None] Lock "cinder-quobyte-09900986-1012-4d1f-812b-ebad4c05b9de" acquired by "delete_volume" :: waited 0.020s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:17 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce5bf7f-8c7b-4131-96f0-6d33fcc67e3c]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-420785b5-77cf-4d49-b62d-6e254f6438eb tempest-VolumeDependencyTests-297018988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:18 devstack sudo[107663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de
Nov 04 12:30:18 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:18 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-420785b5-77cf-4d49-b62d-6e254f6438eb tempest-VolumeDependencyTests-297018988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de" returned: 0 in 0.473s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-420785b5-77cf-4d49-b62d-6e254f6438eb tempest-VolumeDependencyTests-297018988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:18 devstack sudo[107669]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de
Nov 04 12:30:18 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:18 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-420785b5-77cf-4d49-b62d-6e254f6438eb tempest-VolumeDependencyTests-297018988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-09900986-1012-4d1f-812b-ebad4c05b9de" returned: 0 in 0.275s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:18 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-420785b5-77cf-4d49-b62d-6e254f6438eb tempest-VolumeDependencyTests-297018988 None] Lock "cinder-quobyte-09900986-1012-4d1f-812b-ebad4c05b9de" released by "delete_volume" :: held 0.829s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:18 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-420785b5-77cf-4d49-b62d-6e254f6438eb tempest-VolumeDependencyTests-297018988 None] Created reservations ['b55653de-f780-43cf-a355-bbbee5cf9172', 'cc6858db-b894-46ba-af38-48b31d746155', 'ca91b6e8-2ff6-40e2-bcc0-3687e9610cd7', 'e638ff08-6178-4698-8230-dae82a864f2c'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:30:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-420785b5-77cf-4d49-b62d-6e254f6438eb tempest-VolumeDependencyTests-297018988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-420785b5-77cf-4d49-b62d-6e254f6438eb tempest-VolumeDependencyTests-297018988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:18 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-420785b5-77cf-4d49-b62d-6e254f6438eb tempest-VolumeDependencyTests-297018988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:30:18 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-420785b5-77cf-4d49-b62d-6e254f6438eb tempest-VolumeDependencyTests-297018988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:30:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-420785b5-77cf-4d49-b62d-6e254f6438eb tempest-VolumeDependencyTests-297018988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-420785b5-77cf-4d49-b62d-6e254f6438eb tempest-VolumeDependencyTests-297018988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:18 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5b3ef97d-5f72-4ecb-a443-daeda2f898e3 tempest-VolumeImageDependencyTests-881313610 None] Acquiring lock "cinder-ab15c6ed-4962-4150-8cc5-6282a0206f79-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:18 devstack sudo[107672]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:30:18 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:18 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5b3ef97d-5f72-4ecb-a443-daeda2f898e3 tempest-VolumeImageDependencyTests-881313610 None] Lock "cinder-ab15c6ed-4962-4150-8cc5-6282a0206f79-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:18 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5b3ef97d-5f72-4ecb-a443-daeda2f898e3 tempest-VolumeImageDependencyTests-881313610 None] Acquiring lock "cinder-quobyte-ab15c6ed-4962-4150-8cc5-6282a0206f79" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:18 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5b3ef97d-5f72-4ecb-a443-daeda2f898e3 tempest-VolumeImageDependencyTests-881313610 None] Lock "cinder-quobyte-ab15c6ed-4962-4150-8cc5-6282a0206f79" acquired by "delete_volume" :: waited 0.027s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:19 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c9392f-4fc8-4495-bc79-e730fb48f2ed]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5b3ef97d-5f72-4ecb-a443-daeda2f898e3 tempest-VolumeImageDependencyTests-881313610 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ab15c6ed-4962-4150-8cc5-6282a0206f79 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-415d4872-5058-405c-9249-b1a7dc1e86a0 tempest-VolumeDependencyTests-297018988 None] Acquiring lock "cinder-b3646f51-b1bc-4a0f-8a55-dbcfd5ef6d3a-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-415d4872-5058-405c-9249-b1a7dc1e86a0 tempest-VolumeDependencyTests-297018988 None] Lock "cinder-b3646f51-b1bc-4a0f-8a55-dbcfd5ef6d3a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:19 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-420785b5-77cf-4d49-b62d-6e254f6438eb tempest-VolumeDependencyTests-297018988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.358s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:19 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-420785b5-77cf-4d49-b62d-6e254f6438eb tempest-VolumeDependencyTests-297018988 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:30:19 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-420785b5-77cf-4d49-b62d-6e254f6438eb tempest-VolumeDependencyTests-297018988 None] Deleted volume successfully.
Nov 04 12:30:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-415d4872-5058-405c-9249-b1a7dc1e86a0 tempest-VolumeDependencyTests-297018988 None] Acquiring lock "cinder-quobyte-b3646f51-b1bc-4a0f-8a55-dbcfd5ef6d3a" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:19 devstack sudo[107674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ab15c6ed-4962-4150-8cc5-6282a0206f79
Nov 04 12:30:19 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-415d4872-5058-405c-9249-b1a7dc1e86a0 tempest-VolumeDependencyTests-297018988 None] Lock "cinder-quobyte-b3646f51-b1bc-4a0f-8a55-dbcfd5ef6d3a" acquired by "delete_volume" :: waited 0.027s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-420785b5-77cf-4d49-b62d-6e254f6438eb tempest-VolumeDependencyTests-297018988 None] Lock "cinder-09900986-1012-4d1f-812b-ebad4c05b9de-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:19 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[97927954-6bf2-4dd9-b735-cac52bb20a39]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-415d4872-5058-405c-9249-b1a7dc1e86a0 tempest-VolumeDependencyTests-297018988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-b3646f51-b1bc-4a0f-8a55-dbcfd5ef6d3a {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:19 devstack sudo[107677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-b3646f51-b1bc-4a0f-8a55-dbcfd5ef6d3a
Nov 04 12:30:19 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:19 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5b3ef97d-5f72-4ecb-a443-daeda2f898e3 tempest-VolumeImageDependencyTests-881313610 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ab15c6ed-4962-4150-8cc5-6282a0206f79" returned: 0 in 0.552s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5b3ef97d-5f72-4ecb-a443-daeda2f898e3 tempest-VolumeImageDependencyTests-881313610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ab15c6ed-4962-4150-8cc5-6282a0206f79 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:19 devstack sudo[107683]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ab15c6ed-4962-4150-8cc5-6282a0206f79
Nov 04 12:30:19 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:19 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-415d4872-5058-405c-9249-b1a7dc1e86a0 tempest-VolumeDependencyTests-297018988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-b3646f51-b1bc-4a0f-8a55-dbcfd5ef6d3a" returned: 0 in 0.497s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-415d4872-5058-405c-9249-b1a7dc1e86a0 tempest-VolumeDependencyTests-297018988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-b3646f51-b1bc-4a0f-8a55-dbcfd5ef6d3a {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:19 devstack sudo[107688]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-b3646f51-b1bc-4a0f-8a55-dbcfd5ef6d3a
Nov 04 12:30:19 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:19 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5b3ef97d-5f72-4ecb-a443-daeda2f898e3 tempest-VolumeImageDependencyTests-881313610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ab15c6ed-4962-4150-8cc5-6282a0206f79" returned: 0 in 0.357s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5b3ef97d-5f72-4ecb-a443-daeda2f898e3 tempest-VolumeImageDependencyTests-881313610 None] Lock "cinder-quobyte-ab15c6ed-4962-4150-8cc5-6282a0206f79" released by "delete_volume" :: held 1.014s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-5b3ef97d-5f72-4ecb-a443-daeda2f898e3 tempest-VolumeImageDependencyTests-881313610 None] Created reservations ['ae4f8e44-daef-4f8c-997f-cb76e6e6bf7c', '4cfbdf28-e6cf-4ff5-8bd1-d5df2fcd71e0', '62e83afe-adc0-48a6-aaba-d2117dea49b3', '91ff43d4-2e45-4233-86b4-9d034256dc88'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cb36b41-cdc3-4f25-b1c6-e128ecb814b6 tempest-ProjectMemberTests-782019947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:30:20 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3cb36b41-cdc3-4f25-b1c6-e128ecb814b6 tempest-ProjectMemberTests-782019947 None] Flow 'volume_create_manager' (120c0dc9-33d0-4a73-ad9c-c5a851fc053f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3cb36b41-cdc3-4f25-b1c6-e128ecb814b6 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8925c519-8a01-440c-9d25-0ce4dbf52f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-415d4872-5058-405c-9249-b1a7dc1e86a0 tempest-VolumeDependencyTests-297018988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-b3646f51-b1bc-4a0f-8a55-dbcfd5ef6d3a" returned: 0 in 0.466s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3cb36b41-cdc3-4f25-b1c6-e128ecb814b6 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8925c519-8a01-440c-9d25-0ce4dbf52f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-832379640',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18c8b16d-e88e-4a67-9da0-c7fa9800fa9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5a80a035d04be496795229f2e16378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:20Z,use_quota=True,user_id='4f258b2e50a741e4b75bd5ecf8d3039a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3cb36b41-cdc3-4f25-b1c6-e128ecb814b6 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11cc1d74-5218-4372-8e6c-5b04a48a0d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3cb36b41-cdc3-4f25-b1c6-e128ecb814b6 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11cc1d74-5218-4372-8e6c-5b04a48a0d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3cb36b41-cdc3-4f25-b1c6-e128ecb814b6 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (827d8b65-1406-48a1-bd0b-c5d4b5b8b47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3cb36b41-cdc3-4f25-b1c6-e128ecb814b6 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (827d8b65-1406-48a1-bd0b-c5d4b5b8b47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18c8b16d-e88e-4a67-9da0-c7fa9800fa9c', 'volume_name': 'volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3cb36b41-cdc3-4f25-b1c6-e128ecb814b6 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93eb11a1-dd9d-4ed7-b744-237ad50426ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3cb36b41-cdc3-4f25-b1c6-e128ecb814b6 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93eb11a1-dd9d-4ed7-b744-237ad50426ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3cb36b41-cdc3-4f25-b1c6-e128ecb814b6 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a4d7839-5cde-4053-9723-00313084183e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:20 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-3cb36b41-cdc3-4f25-b1c6-e128ecb814b6 tempest-ProjectMemberTests-782019947 None] Volume 18c8b16d-e88e-4a67-9da0-c7fa9800fa9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c', 'volume_size': 1}
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3cb36b41-cdc3-4f25-b1c6-e128ecb814b6 tempest-ProjectMemberTests-782019947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3cb36b41-cdc3-4f25-b1c6-e128ecb814b6 tempest-ProjectMemberTests-782019947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3cb36b41-cdc3-4f25-b1c6-e128ecb814b6 tempest-ProjectMemberTests-782019947 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-832379640',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18c8b16d-e88e-4a67-9da0-c7fa9800fa9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5a80a035d04be496795229f2e16378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:20Z,use_quota=True,user_id='4f258b2e50a741e4b75bd5ecf8d3039a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-3cb36b41-cdc3-4f25-b1c6-e128ecb814b6 tempest-ProjectMemberTests-782019947 None] Creating volume 18c8b16d-e88e-4a67-9da0-c7fa9800fa9c {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3cb36b41-cdc3-4f25-b1c6-e128ecb814b6 tempest-ProjectMemberTests-782019947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3cb36b41-cdc3-4f25-b1c6-e128ecb814b6 tempest-ProjectMemberTests-782019947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3cb36b41-cdc3-4f25-b1c6-e128ecb814b6 tempest-ProjectMemberTests-782019947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3cb36b41-cdc3-4f25-b1c6-e128ecb814b6 tempest-ProjectMemberTests-782019947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3cb36b41-cdc3-4f25-b1c6-e128ecb814b6 tempest-ProjectMemberTests-782019947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3cb36b41-cdc3-4f25-b1c6-e128ecb814b6 tempest-ProjectMemberTests-782019947 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:30:20 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-3cb36b41-cdc3-4f25-b1c6-e128ecb814b6 tempest-ProjectMemberTests-782019947 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3cb36b41-cdc3-4f25-b1c6-e128ecb814b6 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-415d4872-5058-405c-9249-b1a7dc1e86a0 tempest-VolumeDependencyTests-297018988 None] Lock "cinder-quobyte-b3646f51-b1bc-4a0f-8a55-dbcfd5ef6d3a" released by "delete_volume" :: held 1.087s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5b3ef97d-5f72-4ecb-a443-daeda2f898e3 tempest-VolumeImageDependencyTests-881313610 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5b3ef97d-5f72-4ecb-a443-daeda2f898e3 tempest-VolumeImageDependencyTests-881313610 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5b3ef97d-5f72-4ecb-a443-daeda2f898e3 tempest-VolumeImageDependencyTests-881313610 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5b3ef97d-5f72-4ecb-a443-daeda2f898e3 tempest-VolumeImageDependencyTests-881313610 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5b3ef97d-5f72-4ecb-a443-daeda2f898e3 tempest-VolumeImageDependencyTests-881313610 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5b3ef97d-5f72-4ecb-a443-daeda2f898e3 tempest-VolumeImageDependencyTests-881313610 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:20 devstack sudo[107692]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c 1073741824
Nov 04 12:30:20 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:20 devstack sudo[107694]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:30:20 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-415d4872-5058-405c-9249-b1a7dc1e86a0 tempest-VolumeDependencyTests-297018988 None] Created reservations ['735cf225-d112-46dd-989d-7779d80035ac', '4aa0d0fe-3c3c-4f3e-a60d-bd6c1bb6ee1d', '0298fa74-6372-4b40-ba9c-6f9632d5ba2c', '97bd86cd-af27-4a50-97a8-33984448ff8c'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-415d4872-5058-405c-9249-b1a7dc1e86a0 tempest-VolumeDependencyTests-297018988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-415d4872-5058-405c-9249-b1a7dc1e86a0 tempest-VolumeDependencyTests-297018988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-415d4872-5058-405c-9249-b1a7dc1e86a0 tempest-VolumeDependencyTests-297018988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-415d4872-5058-405c-9249-b1a7dc1e86a0 tempest-VolumeDependencyTests-297018988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-415d4872-5058-405c-9249-b1a7dc1e86a0 tempest-VolumeDependencyTests-297018988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-415d4872-5058-405c-9249-b1a7dc1e86a0 tempest-VolumeDependencyTests-297018988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:20 devstack sudo[107696]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:30:20 devstack sudo[107696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:20 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5b3ef97d-5f72-4ecb-a443-daeda2f898e3 tempest-VolumeImageDependencyTests-881313610 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.291s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-5b3ef97d-5f72-4ecb-a443-daeda2f898e3 tempest-VolumeImageDependencyTests-881313610 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:30:20 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-5b3ef97d-5f72-4ecb-a443-daeda2f898e3 tempest-VolumeImageDependencyTests-881313610 None] Deleted volume successfully.
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-5b3ef97d-5f72-4ecb-a443-daeda2f898e3 tempest-VolumeImageDependencyTests-881313610 None] Lock "cinder-ab15c6ed-4962-4150-8cc5-6282a0206f79-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:20 devstack sudo[107696]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-415d4872-5058-405c-9249-b1a7dc1e86a0 tempest-VolumeDependencyTests-297018988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.321s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-415d4872-5058-405c-9249-b1a7dc1e86a0 tempest-VolumeDependencyTests-297018988 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:30:20 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-415d4872-5058-405c-9249-b1a7dc1e86a0 tempest-VolumeDependencyTests-297018988 None] Deleted volume successfully.
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-415d4872-5058-405c-9249-b1a7dc1e86a0 tempest-VolumeDependencyTests-297018988 None] Lock "cinder-b3646f51-b1bc-4a0f-8a55-dbcfd5ef6d3a-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:20 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3cb36b41-cdc3-4f25-b1c6-e128ecb814b6 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c 1073741824" returned: 0 in 0.563s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3cb36b41-cdc3-4f25-b1c6-e128ecb814b6 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:20 devstack sudo[107704]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c
Nov 04 12:30:20 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:21 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3cb36b41-cdc3-4f25-b1c6-e128ecb814b6 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c" returned: 0 in 0.299s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:21 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3cb36b41-cdc3-4f25-b1c6-e128ecb814b6 tempest-ProjectMemberTests-782019947 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:30:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3cb36b41-cdc3-4f25-b1c6-e128ecb814b6 tempest-ProjectMemberTests-782019947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:21 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3cb36b41-cdc3-4f25-b1c6-e128ecb814b6 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a4d7839-5cde-4053-9723-00313084183e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:21 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3cb36b41-cdc3-4f25-b1c6-e128ecb814b6 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8f40735-7397-4990-ac86-de1807b8a67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:21 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-3cb36b41-cdc3-4f25-b1c6-e128ecb814b6 tempest-ProjectMemberTests-782019947 None] Volume volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c (18c8b16d-e88e-4a67-9da0-c7fa9800fa9c): created successfully
Nov 04 12:30:21 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3cb36b41-cdc3-4f25-b1c6-e128ecb814b6 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8f40735-7397-4990-ac86-de1807b8a67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:21 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3cb36b41-cdc3-4f25-b1c6-e128ecb814b6 tempest-ProjectMemberTests-782019947 None] Flow 'volume_create_manager' (120c0dc9-33d0-4a73-ad9c-c5a851fc053f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:30:21 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-3cb36b41-cdc3-4f25-b1c6-e128ecb814b6 tempest-ProjectMemberTests-782019947 None] Created volume successfully.
Nov 04 12:30:21 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9d67109-b95a-4ca6-8867-b77a38759362 tempest-ProjectReaderTests-1710404759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:30:21 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a9d67109-b95a-4ca6-8867-b77a38759362 tempest-ProjectReaderTests-1710404759 None] Flow 'volume_create_manager' (70e897a4-f529-4eb0-b3a2-32025e13c1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:30:21 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a9d67109-b95a-4ca6-8867-b77a38759362 tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07233d86-6e4b-4ee1-8e1e-b89d03113201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:21 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a9d67109-b95a-4ca6-8867-b77a38759362 tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07233d86-6e4b-4ee1-8e1e-b89d03113201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1308931599',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edfd70e6-0c37-44d2-8fe6-aa3aa8738071,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acea6ec1649b4cebaad9ac5925dcf8e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:21Z,use_quota=True,user_id='32c122b3b1f2421aab388e2afee84c8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:21 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a9d67109-b95a-4ca6-8867-b77a38759362 tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (724bba6c-8286-4c0f-b0be-5a64e13672a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:21 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a9d67109-b95a-4ca6-8867-b77a38759362 tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (724bba6c-8286-4c0f-b0be-5a64e13672a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:21 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a9d67109-b95a-4ca6-8867-b77a38759362 tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04563c8b-dbb9-4ac0-ba3c-9c3a38c5d8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:21 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a9d67109-b95a-4ca6-8867-b77a38759362 tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04563c8b-dbb9-4ac0-ba3c-9c3a38c5d8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edfd70e6-0c37-44d2-8fe6-aa3aa8738071', 'volume_name': 'volume-edfd70e6-0c37-44d2-8fe6-aa3aa8738071', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:21 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a9d67109-b95a-4ca6-8867-b77a38759362 tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aec3182-e814-442d-b189-73d8873933c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:21 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a9d67109-b95a-4ca6-8867-b77a38759362 tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7aec3182-e814-442d-b189-73d8873933c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:21 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a9d67109-b95a-4ca6-8867-b77a38759362 tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (357179a8-7428-4c0e-a219-acb87c5f8bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:21 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-a9d67109-b95a-4ca6-8867-b77a38759362 tempest-ProjectReaderTests-1710404759 None] Volume edfd70e6-0c37-44d2-8fe6-aa3aa8738071: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edfd70e6-0c37-44d2-8fe6-aa3aa8738071', 'volume_size': 1}
Nov 04 12:30:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a9d67109-b95a-4ca6-8867-b77a38759362 tempest-ProjectReaderTests-1710404759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a9d67109-b95a-4ca6-8867-b77a38759362 tempest-ProjectReaderTests-1710404759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:21 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a9d67109-b95a-4ca6-8867-b77a38759362 tempest-ProjectReaderTests-1710404759 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1308931599',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edfd70e6-0c37-44d2-8fe6-aa3aa8738071,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acea6ec1649b4cebaad9ac5925dcf8e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:21Z,use_quota=True,user_id='32c122b3b1f2421aab388e2afee84c8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:30:21 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-a9d67109-b95a-4ca6-8867-b77a38759362 tempest-ProjectReaderTests-1710404759 None] Creating volume edfd70e6-0c37-44d2-8fe6-aa3aa8738071 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:30:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a9d67109-b95a-4ca6-8867-b77a38759362 tempest-ProjectReaderTests-1710404759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a9d67109-b95a-4ca6-8867-b77a38759362 tempest-ProjectReaderTests-1710404759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:21 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a9d67109-b95a-4ca6-8867-b77a38759362 tempest-ProjectReaderTests-1710404759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:30:21 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a9d67109-b95a-4ca6-8867-b77a38759362 tempest-ProjectReaderTests-1710404759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:30:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a9d67109-b95a-4ca6-8867-b77a38759362 tempest-ProjectReaderTests-1710404759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:21 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a9d67109-b95a-4ca6-8867-b77a38759362 tempest-ProjectReaderTests-1710404759 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:30:21 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-a9d67109-b95a-4ca6-8867-b77a38759362 tempest-ProjectReaderTests-1710404759 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:30:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a9d67109-b95a-4ca6-8867-b77a38759362 tempest-ProjectReaderTests-1710404759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-edfd70e6-0c37-44d2-8fe6-aa3aa8738071 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:21 devstack sudo[107707]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-edfd70e6-0c37-44d2-8fe6-aa3aa8738071 1073741824
Nov 04 12:30:21 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:21 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a9d67109-b95a-4ca6-8867-b77a38759362 tempest-ProjectReaderTests-1710404759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-edfd70e6-0c37-44d2-8fe6-aa3aa8738071 1073741824" returned: 0 in 0.510s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a9d67109-b95a-4ca6-8867-b77a38759362 tempest-ProjectReaderTests-1710404759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-edfd70e6-0c37-44d2-8fe6-aa3aa8738071 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:21 devstack sudo[107714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-edfd70e6-0c37-44d2-8fe6-aa3aa8738071
Nov 04 12:30:21 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:22 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a9d67109-b95a-4ca6-8867-b77a38759362 tempest-ProjectReaderTests-1710404759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-edfd70e6-0c37-44d2-8fe6-aa3aa8738071" returned: 0 in 0.305s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:22 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a9d67109-b95a-4ca6-8867-b77a38759362 tempest-ProjectReaderTests-1710404759 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:30:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a9d67109-b95a-4ca6-8867-b77a38759362 tempest-ProjectReaderTests-1710404759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a9d67109-b95a-4ca6-8867-b77a38759362 tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (357179a8-7428-4c0e-a219-acb87c5f8bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edfd70e6-0c37-44d2-8fe6-aa3aa8738071', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a9d67109-b95a-4ca6-8867-b77a38759362 tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e58efad-fb9d-4857-91e2-4bb6c41aa549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:22 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-a9d67109-b95a-4ca6-8867-b77a38759362 tempest-ProjectReaderTests-1710404759 None] Volume volume-edfd70e6-0c37-44d2-8fe6-aa3aa8738071 (edfd70e6-0c37-44d2-8fe6-aa3aa8738071): created successfully
Nov 04 12:30:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a9d67109-b95a-4ca6-8867-b77a38759362 tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e58efad-fb9d-4857-91e2-4bb6c41aa549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a9d67109-b95a-4ca6-8867-b77a38759362 tempest-ProjectReaderTests-1710404759 None] Flow 'volume_create_manager' (70e897a4-f529-4eb0-b3a2-32025e13c1eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:30:22 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-a9d67109-b95a-4ca6-8867-b77a38759362 tempest-ProjectReaderTests-1710404759 None] Created volume successfully.
Nov 04 12:30:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-6257c65e-b001-4200-9617-1b176a432fc3 tempest-ProjectMemberTests-782019947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-6257c65e-b001-4200-9617-1b176a432fc3 tempest-ProjectMemberTests-782019947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:22 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-6257c65e-b001-4200-9617-1b176a432fc3 tempest-ProjectMemberTests-782019947 None] Creating offline snapshot 9f5f2044-d81f-44c1-9d41-780da2e8be92 of volume 18c8b16d-e88e-4a67-9da0-c7fa9800fa9c {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:30:22 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9337dc-3d47-492c-8535-c60e261a03db]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6257c65e-b001-4200-9617-1b176a432fc3 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:22 devstack sudo[107717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c
Nov 04 12:30:22 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:23 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6257c65e-b001-4200-9617-1b176a432fc3 tempest-ProjectMemberTests-782019947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c" returned: 0 in 0.497s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6257c65e-b001-4200-9617-1b176a432fc3 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c.9f5f2044-d81f-44c1-9d41-780da2e8be92 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:23 devstack sudo[107722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c.9f5f2044-d81f-44c1-9d41-780da2e8be92 1G
Nov 04 12:30:23 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:23 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6257c65e-b001-4200-9617-1b176a432fc3 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c.9f5f2044-d81f-44c1-9d41-780da2e8be92 1G" returned: 0 in 0.535s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6257c65e-b001-4200-9617-1b176a432fc3 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c.9f5f2044-d81f-44c1-9d41-780da2e8be92 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:23 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-2b0f2f6a-6ff4-4116-acfa-d436222fd958 tempest-ProjectReaderTests-1710404759 None] Acquiring lock "cinder-edfd70e6-0c37-44d2-8fe6-aa3aa8738071-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:23 devstack sudo[107728]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c.9f5f2044-d81f-44c1-9d41-780da2e8be92
Nov 04 12:30:23 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:23 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-2b0f2f6a-6ff4-4116-acfa-d436222fd958 tempest-ProjectReaderTests-1710404759 None] Lock "cinder-edfd70e6-0c37-44d2-8fe6-aa3aa8738071-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:23 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-2b0f2f6a-6ff4-4116-acfa-d436222fd958 tempest-ProjectReaderTests-1710404759 None] Acquiring lock "cinder-quobyte-edfd70e6-0c37-44d2-8fe6-aa3aa8738071" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:24 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-2b0f2f6a-6ff4-4116-acfa-d436222fd958 tempest-ProjectReaderTests-1710404759 None] Lock "cinder-quobyte-edfd70e6-0c37-44d2-8fe6-aa3aa8738071" acquired by "delete_volume" :: waited 0.028s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:24 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7876e3f-9d9a-4e35-845f-d9ce0451ca39]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2b0f2f6a-6ff4-4116-acfa-d436222fd958 tempest-ProjectReaderTests-1710404759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-edfd70e6-0c37-44d2-8fe6-aa3aa8738071 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:24 devstack sudo[107730]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-edfd70e6-0c37-44d2-8fe6-aa3aa8738071
Nov 04 12:30:24 devstack sudo[107730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:24 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6257c65e-b001-4200-9617-1b176a432fc3 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c.9f5f2044-d81f-44c1-9d41-780da2e8be92" returned: 0 in 0.418s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:24 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-6257c65e-b001-4200-9617-1b176a432fc3 tempest-ProjectMemberTests-782019947 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c.9f5f2044-d81f-44c1-9d41-780da2e8be92 is being set with open permissions: ugo+rw
Nov 04 12:30:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6257c65e-b001-4200-9617-1b176a432fc3 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c.9f5f2044-d81f-44c1-9d41-780da2e8be92 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:24 devstack sudo[107736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c.9f5f2044-d81f-44c1-9d41-780da2e8be92
Nov 04 12:30:24 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:24 devstack sudo[107730]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2b0f2f6a-6ff4-4116-acfa-d436222fd958 tempest-ProjectReaderTests-1710404759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-edfd70e6-0c37-44d2-8fe6-aa3aa8738071" returned: 0 in 0.419s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2b0f2f6a-6ff4-4116-acfa-d436222fd958 tempest-ProjectReaderTests-1710404759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-edfd70e6-0c37-44d2-8fe6-aa3aa8738071 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:24 devstack sudo[107741]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-edfd70e6-0c37-44d2-8fe6-aa3aa8738071
Nov 04 12:30:24 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:24 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6257c65e-b001-4200-9617-1b176a432fc3 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c.9f5f2044-d81f-44c1-9d41-780da2e8be92" returned: 0 in 0.361s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:24 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=204,cinder:UPDATE=250,cinder:INSERT=71,cinder:DELETE=27 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:30:24 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=168,cinder:UPDATE=262,cinder:DELETE=19,cinder:INSERT=65 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:30:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6257c65e-b001-4200-9617-1b176a432fc3 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:24 devstack sudo[107744]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c.info
Nov 04 12:30:24 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2b0f2f6a-6ff4-4116-acfa-d436222fd958 tempest-ProjectReaderTests-1710404759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-edfd70e6-0c37-44d2-8fe6-aa3aa8738071" returned: 0 in 0.333s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:24 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:24 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-2b0f2f6a-6ff4-4116-acfa-d436222fd958 tempest-ProjectReaderTests-1710404759 None] Lock "cinder-quobyte-edfd70e6-0c37-44d2-8fe6-aa3aa8738071" released by "delete_volume" :: held 0.818s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:24 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-2b0f2f6a-6ff4-4116-acfa-d436222fd958 tempest-ProjectReaderTests-1710404759 None] Created reservations ['ff5b6dc2-e098-4c28-bd45-78d18a1aabe9', '644a116e-dd24-4b07-9a70-a4f497116441', '928c2448-b90d-49cf-af32-4b74f98405a7', '5b6afe3e-0fe6-488c-80f8-695b65fbbfe5'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:30:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2b0f2f6a-6ff4-4116-acfa-d436222fd958 tempest-ProjectReaderTests-1710404759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2b0f2f6a-6ff4-4116-acfa-d436222fd958 tempest-ProjectReaderTests-1710404759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:24 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:24 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-2b0f2f6a-6ff4-4116-acfa-d436222fd958 tempest-ProjectReaderTests-1710404759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:30:25 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-2b0f2f6a-6ff4-4116-acfa-d436222fd958 tempest-ProjectReaderTests-1710404759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:30:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2b0f2f6a-6ff4-4116-acfa-d436222fd958 tempest-ProjectReaderTests-1710404759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2b0f2f6a-6ff4-4116-acfa-d436222fd958 tempest-ProjectReaderTests-1710404759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6257c65e-b001-4200-9617-1b176a432fc3 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c.info" returned: 0 in 0.346s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:25 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-6257c65e-b001-4200-9617-1b176a432fc3 tempest-ProjectMemberTests-782019947 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c.info is being set with open permissions: ugo+rw
Nov 04 12:30:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6257c65e-b001-4200-9617-1b176a432fc3 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:25 devstack sudo[107748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:30:25 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:25 devstack sudo[107749]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c.info
Nov 04 12:30:25 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:25 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2b0f2f6a-6ff4-4116-acfa-d436222fd958 tempest-ProjectReaderTests-1710404759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.354s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:25 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-2b0f2f6a-6ff4-4116-acfa-d436222fd958 tempest-ProjectReaderTests-1710404759 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:30:25 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-2b0f2f6a-6ff4-4116-acfa-d436222fd958 tempest-ProjectReaderTests-1710404759 None] Deleted volume successfully.
Nov 04 12:30:25 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-2b0f2f6a-6ff4-4116-acfa-d436222fd958 tempest-ProjectReaderTests-1710404759 None] Lock "cinder-edfd70e6-0c37-44d2-8fe6-aa3aa8738071-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:25 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6257c65e-b001-4200-9617-1b176a432fc3 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c.info" returned: 0 in 0.502s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-6257c65e-b001-4200-9617-1b176a432fc3 tempest-ProjectMemberTests-782019947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.793s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:25 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-6257c65e-b001-4200-9617-1b176a432fc3 tempest-ProjectMemberTests-782019947 None] Create snapshot completed successfully
Nov 04 12:30:25 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0878e03-258e-473b-bbca-bd08c9c66ee8 tempest-CinderUnicodeTest-271981707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:30:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e0878e03-258e-473b-bbca-bd08c9c66ee8 tempest-CinderUnicodeTest-271981707 None] Flow 'volume_create_manager' (5329e0e7-f8fa-4850-85f4-452e699bdff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:30:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e0878e03-258e-473b-bbca-bd08c9c66ee8 tempest-CinderUnicodeTest-271981707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31eb095a-1387-4003-8787-3f680536c4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-9ca5969a-769f-48da-893f-06f66be0a0a2 tempest-ProjectAdminTests-1626650106 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.6071128845215, 'free_capacity_gb': 1773.6071128845215, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87169) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}}
Nov 04 12:30:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e0878e03-258e-473b-bbca-bd08c9c66ee8 tempest-CinderUnicodeTest-271981707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31eb095a-1387-4003-8787-3f680536c4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe6ae517-678d-4440-9b4d-682af2ba468b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4220c19033ab47d59eea0ac9b6dfcb37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:26Z,use_quota=True,user_id='403facdf687f46eca12e2765f5276184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e0878e03-258e-473b-bbca-bd08c9c66ee8 tempest-CinderUnicodeTest-271981707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41a544c1-c1ec-4b5f-b52e-0548bce5c77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e0878e03-258e-473b-bbca-bd08c9c66ee8 tempest-CinderUnicodeTest-271981707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41a544c1-c1ec-4b5f-b52e-0548bce5c77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e0878e03-258e-473b-bbca-bd08c9c66ee8 tempest-CinderUnicodeTest-271981707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (003a48ca-019e-4ee1-8352-621809bb62e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e0878e03-258e-473b-bbca-bd08c9c66ee8 tempest-CinderUnicodeTest-271981707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (003a48ca-019e-4ee1-8352-621809bb62e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe6ae517-678d-4440-9b4d-682af2ba468b', 'volume_name': 'volume-fe6ae517-678d-4440-9b4d-682af2ba468b', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e0878e03-258e-473b-bbca-bd08c9c66ee8 tempest-CinderUnicodeTest-271981707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (810e6a99-9c21-47ea-ac42-3aa83ef835a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e0878e03-258e-473b-bbca-bd08c9c66ee8 tempest-CinderUnicodeTest-271981707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (810e6a99-9c21-47ea-ac42-3aa83ef835a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:25 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e0878e03-258e-473b-bbca-bd08c9c66ee8 tempest-CinderUnicodeTest-271981707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f8268dd-3749-46ba-8fb2-7c4b05107674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:25 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-e0878e03-258e-473b-bbca-bd08c9c66ee8 tempest-CinderUnicodeTest-271981707 None] Volume fe6ae517-678d-4440-9b4d-682af2ba468b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe6ae517-678d-4440-9b4d-682af2ba468b', 'volume_size': 1}
Nov 04 12:30:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e0878e03-258e-473b-bbca-bd08c9c66ee8 tempest-CinderUnicodeTest-271981707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e0878e03-258e-473b-bbca-bd08c9c66ee8 tempest-CinderUnicodeTest-271981707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:25 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e0878e03-258e-473b-bbca-bd08c9c66ee8 tempest-CinderUnicodeTest-271981707 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe6ae517-678d-4440-9b4d-682af2ba468b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4220c19033ab47d59eea0ac9b6dfcb37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:26Z,use_quota=True,user_id='403facdf687f46eca12e2765f5276184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:30:25 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-e0878e03-258e-473b-bbca-bd08c9c66ee8 tempest-CinderUnicodeTest-271981707 None] Creating volume fe6ae517-678d-4440-9b4d-682af2ba468b {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:30:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e0878e03-258e-473b-bbca-bd08c9c66ee8 tempest-CinderUnicodeTest-271981707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e0878e03-258e-473b-bbca-bd08c9c66ee8 tempest-CinderUnicodeTest-271981707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:25 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e0878e03-258e-473b-bbca-bd08c9c66ee8 tempest-CinderUnicodeTest-271981707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:30:25 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e0878e03-258e-473b-bbca-bd08c9c66ee8 tempest-CinderUnicodeTest-271981707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:30:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e0878e03-258e-473b-bbca-bd08c9c66ee8 tempest-CinderUnicodeTest-271981707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:25 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e0878e03-258e-473b-bbca-bd08c9c66ee8 tempest-CinderUnicodeTest-271981707 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:30:25 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-e0878e03-258e-473b-bbca-bd08c9c66ee8 tempest-CinderUnicodeTest-271981707 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:30:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e0878e03-258e-473b-bbca-bd08c9c66ee8 tempest-CinderUnicodeTest-271981707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fe6ae517-678d-4440-9b4d-682af2ba468b 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:26 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ff659dd1-5057-4609-8be5-c63c5b3c49a9 tempest-ProjectMemberTests-782019947 None] Acquiring lock "cinder-9f5f2044-d81f-44c1-9d41-780da2e8be92-delete_snapshot" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:26 devstack sudo[107755]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fe6ae517-678d-4440-9b4d-682af2ba468b 1073741824
Nov 04 12:30:26 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:26 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdc71195-052f-4286-ae43-0c963307fdad tempest-ProjectReaderTests-1710404759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:30:26 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bdc71195-052f-4286-ae43-0c963307fdad tempest-ProjectReaderTests-1710404759 None] Flow 'volume_create_manager' (fec401d2-79c4-47fe-bf8b-e30d9f70e7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:30:26 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bdc71195-052f-4286-ae43-0c963307fdad tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97931352-4855-4b37-944c-2cca22f0897e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:26 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ff659dd1-5057-4609-8be5-c63c5b3c49a9 tempest-ProjectMemberTests-782019947 None] Lock "cinder-9f5f2044-d81f-44c1-9d41-780da2e8be92-delete_snapshot" acquired by "delete_snapshot" :: waited 0.070s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:26 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ff659dd1-5057-4609-8be5-c63c5b3c49a9 tempest-ProjectMemberTests-782019947 None] Acquiring lock "cinder-quobyte-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:26 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bdc71195-052f-4286-ae43-0c963307fdad tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97931352-4855-4b37-944c-2cca22f0897e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-15698934',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a20a0e7-44e5-4413-a05b-7a61b0e7a83a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acea6ec1649b4cebaad9ac5925dcf8e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:26Z,use_quota=True,user_id='32c122b3b1f2421aab388e2afee84c8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:26 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bdc71195-052f-4286-ae43-0c963307fdad tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efa4c58d-8eef-45c7-875f-2954f7aa75c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:26 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bdc71195-052f-4286-ae43-0c963307fdad tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efa4c58d-8eef-45c7-875f-2954f7aa75c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:26 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bdc71195-052f-4286-ae43-0c963307fdad tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (641468c2-6c23-49b3-a4f5-5bd00fc6f091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:26 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bdc71195-052f-4286-ae43-0c963307fdad tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (641468c2-6c23-49b3-a4f5-5bd00fc6f091) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a20a0e7-44e5-4413-a05b-7a61b0e7a83a', 'volume_name': 'volume-8a20a0e7-44e5-4413-a05b-7a61b0e7a83a', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:26 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bdc71195-052f-4286-ae43-0c963307fdad tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a34d216-3114-4392-b2af-8ae8a1f5337f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:26 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bdc71195-052f-4286-ae43-0c963307fdad tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a34d216-3114-4392-b2af-8ae8a1f5337f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:26 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bdc71195-052f-4286-ae43-0c963307fdad tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a7ca4f0-676c-4d19-a09f-eaf5ffb398e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:26 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-bdc71195-052f-4286-ae43-0c963307fdad tempest-ProjectReaderTests-1710404759 None] Volume 8a20a0e7-44e5-4413-a05b-7a61b0e7a83a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a20a0e7-44e5-4413-a05b-7a61b0e7a83a', 'volume_size': 1}
Nov 04 12:30:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-bdc71195-052f-4286-ae43-0c963307fdad tempest-ProjectReaderTests-1710404759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:26 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ff659dd1-5057-4609-8be5-c63c5b3c49a9 tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c" acquired by "delete_snapshot" :: waited 0.073s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:26 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ff659dd1-5057-4609-8be5-c63c5b3c49a9 tempest-ProjectMemberTests-782019947 None] Acquiring lock "cinder-quobyte-9f5f2044-d81f-44c1-9d41-780da2e8be92" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:26 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ff659dd1-5057-4609-8be5-c63c5b3c49a9 tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-9f5f2044-d81f-44c1-9d41-780da2e8be92" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:26 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-ff659dd1-5057-4609-8be5-c63c5b3c49a9 tempest-ProjectMemberTests-782019947 None] Deleting offline snapshot 9f5f2044-d81f-44c1-9d41-780da2e8be92 of volume 18c8b16d-e88e-4a67-9da0-c7fa9800fa9c {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:30:26 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-ff659dd1-5057-4609-8be5-c63c5b3c49a9 tempest-ProjectMemberTests-782019947 None] snapshot_file for this snap is: volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c.9f5f2044-d81f-44c1-9d41-780da2e8be92 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:30:26 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a98621-8317-4545-87c1-fdc823e3f9ef]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ff659dd1-5057-4609-8be5-c63c5b3c49a9 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c.9f5f2044-d81f-44c1-9d41-780da2e8be92 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:26 devstack sudo[107759]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c.9f5f2044-d81f-44c1-9d41-780da2e8be92
Nov 04 12:30:26 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:26 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e0878e03-258e-473b-bbca-bd08c9c66ee8 tempest-CinderUnicodeTest-271981707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fe6ae517-678d-4440-9b4d-682af2ba468b 1073741824" returned: 0 in 0.479s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e0878e03-258e-473b-bbca-bd08c9c66ee8 tempest-CinderUnicodeTest-271981707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fe6ae517-678d-4440-9b4d-682af2ba468b {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:26 devstack sudo[107763]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fe6ae517-678d-4440-9b4d-682af2ba468b
Nov 04 12:30:26 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:26 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ff659dd1-5057-4609-8be5-c63c5b3c49a9 tempest-ProjectMemberTests-782019947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c.9f5f2044-d81f-44c1-9d41-780da2e8be92" returned: 0 in 0.426s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:26 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-ff659dd1-5057-4609-8be5-c63c5b3c49a9 tempest-ProjectMemberTests-782019947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:30:26 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4a8ed0-5ab0-4028-802c-96db81b5c7bd]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ff659dd1-5057-4609-8be5-c63c5b3c49a9 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:26 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e0878e03-258e-473b-bbca-bd08c9c66ee8 tempest-CinderUnicodeTest-271981707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fe6ae517-678d-4440-9b4d-682af2ba468b" returned: 0 in 0.315s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:26 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e0878e03-258e-473b-bbca-bd08c9c66ee8 tempest-CinderUnicodeTest-271981707 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:30:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e0878e03-258e-473b-bbca-bd08c9c66ee8 tempest-CinderUnicodeTest-271981707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:26 devstack sudo[107768]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c
Nov 04 12:30:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-bdc71195-052f-4286-ae43-0c963307fdad tempest-ProjectReaderTests-1710404759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.674s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:26 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:26 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-bdc71195-052f-4286-ae43-0c963307fdad tempest-ProjectReaderTests-1710404759 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:30:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-15698934',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a20a0e7-44e5-4413-a05b-7a61b0e7a83a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acea6ec1649b4cebaad9ac5925dcf8e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:26Z,use_quota=True,user_id='32c122b3b1f2421aab388e2afee84c8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:30:26 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-bdc71195-052f-4286-ae43-0c963307fdad tempest-ProjectReaderTests-1710404759 None] Creating volume 8a20a0e7-44e5-4413-a05b-7a61b0e7a83a {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:30:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-bdc71195-052f-4286-ae43-0c963307fdad tempest-ProjectReaderTests-1710404759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-bdc71195-052f-4286-ae43-0c963307fdad tempest-ProjectReaderTests-1710404759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:26 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-bdc71195-052f-4286-ae43-0c963307fdad tempest-ProjectReaderTests-1710404759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:30:26 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-bdc71195-052f-4286-ae43-0c963307fdad tempest-ProjectReaderTests-1710404759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:30:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-bdc71195-052f-4286-ae43-0c963307fdad tempest-ProjectReaderTests-1710404759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:26 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-bdc71195-052f-4286-ae43-0c963307fdad tempest-ProjectReaderTests-1710404759 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:30:26 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-bdc71195-052f-4286-ae43-0c963307fdad tempest-ProjectReaderTests-1710404759 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:30:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bdc71195-052f-4286-ae43-0c963307fdad tempest-ProjectReaderTests-1710404759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a20a0e7-44e5-4413-a05b-7a61b0e7a83a 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:26 devstack sudo[107771]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a20a0e7-44e5-4413-a05b-7a61b0e7a83a 1073741824
Nov 04 12:30:26 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:26 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e0878e03-258e-473b-bbca-bd08c9c66ee8 tempest-CinderUnicodeTest-271981707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f8268dd-3749-46ba-8fb2-7c4b05107674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe6ae517-678d-4440-9b4d-682af2ba468b', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:26 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e0878e03-258e-473b-bbca-bd08c9c66ee8 tempest-CinderUnicodeTest-271981707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4145245-8c15-47b5-9025-7c0813e492e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:26 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-e0878e03-258e-473b-bbca-bd08c9c66ee8 tempest-CinderUnicodeTest-271981707 None] Volume volume-fe6ae517-678d-4440-9b4d-682af2ba468b (fe6ae517-678d-4440-9b4d-682af2ba468b): created successfully
Nov 04 12:30:26 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e0878e03-258e-473b-bbca-bd08c9c66ee8 tempest-CinderUnicodeTest-271981707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4145245-8c15-47b5-9025-7c0813e492e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:26 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-e0878e03-258e-473b-bbca-bd08c9c66ee8 tempest-CinderUnicodeTest-271981707 None] Flow 'volume_create_manager' (5329e0e7-f8fa-4850-85f4-452e699bdff8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:30:26 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-e0878e03-258e-473b-bbca-bd08c9c66ee8 tempest-CinderUnicodeTest-271981707 None] Created volume successfully.
Nov 04 12:30:27 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:27 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ff659dd1-5057-4609-8be5-c63c5b3c49a9 tempest-ProjectMemberTests-782019947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c" returned: 0 in 0.471s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:27 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ff659dd1-5057-4609-8be5-c63c5b3c49a9 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c.9f5f2044-d81f-44c1-9d41-780da2e8be92 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:27 devstack sudo[107779]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c.9f5f2044-d81f-44c1-9d41-780da2e8be92
Nov 04 12:30:27 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:27 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:27 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bdc71195-052f-4286-ae43-0c963307fdad tempest-ProjectReaderTests-1710404759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a20a0e7-44e5-4413-a05b-7a61b0e7a83a 1073741824" returned: 0 in 0.539s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:27 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bdc71195-052f-4286-ae43-0c963307fdad tempest-ProjectReaderTests-1710404759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a20a0e7-44e5-4413-a05b-7a61b0e7a83a {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:27 devstack sudo[107784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a20a0e7-44e5-4413-a05b-7a61b0e7a83a
Nov 04 12:30:27 devstack sudo[107784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:27 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:27 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ff659dd1-5057-4609-8be5-c63c5b3c49a9 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c.9f5f2044-d81f-44c1-9d41-780da2e8be92" returned: 0 in 0.388s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:27 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ff659dd1-5057-4609-8be5-c63c5b3c49a9 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c.9f5f2044-d81f-44c1-9d41-780da2e8be92 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:27 devstack sudo[107788]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c.9f5f2044-d81f-44c1-9d41-780da2e8be92
Nov 04 12:30:27 devstack sudo[107788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:27 devstack sudo[107784]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:27 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-bdc71195-052f-4286-ae43-0c963307fdad tempest-ProjectReaderTests-1710404759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a20a0e7-44e5-4413-a05b-7a61b0e7a83a" returned: 0 in 0.335s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:27 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-bdc71195-052f-4286-ae43-0c963307fdad tempest-ProjectReaderTests-1710404759 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:30:27 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-bdc71195-052f-4286-ae43-0c963307fdad tempest-ProjectReaderTests-1710404759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:27 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bdc71195-052f-4286-ae43-0c963307fdad tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a7ca4f0-676c-4d19-a09f-eaf5ffb398e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a20a0e7-44e5-4413-a05b-7a61b0e7a83a', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:27 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bdc71195-052f-4286-ae43-0c963307fdad tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e1ec4e1-a466-4f39-a46e-d57007132132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:27 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-bdc71195-052f-4286-ae43-0c963307fdad tempest-ProjectReaderTests-1710404759 None] Volume volume-8a20a0e7-44e5-4413-a05b-7a61b0e7a83a (8a20a0e7-44e5-4413-a05b-7a61b0e7a83a): created successfully
Nov 04 12:30:27 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bdc71195-052f-4286-ae43-0c963307fdad tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e1ec4e1-a466-4f39-a46e-d57007132132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:27 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-bdc71195-052f-4286-ae43-0c963307fdad tempest-ProjectReaderTests-1710404759 None] Flow 'volume_create_manager' (fec401d2-79c4-47fe-bf8b-e30d9f70e7d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:30:27 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-bdc71195-052f-4286-ae43-0c963307fdad tempest-ProjectReaderTests-1710404759 None] Created volume successfully.
Nov 04 12:30:27 devstack sudo[107788]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:27 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ff659dd1-5057-4609-8be5-c63c5b3c49a9 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c.9f5f2044-d81f-44c1-9d41-780da2e8be92" returned: 0 in 0.354s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:27 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ff659dd1-5057-4609-8be5-c63c5b3c49a9 tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-9f5f2044-d81f-44c1-9d41-780da2e8be92" released by "_delete_snapshot" :: held 1.801s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:27 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ff659dd1-5057-4609-8be5-c63c5b3c49a9 tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c" released by "delete_snapshot" :: held 1.831s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:28 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-ff659dd1-5057-4609-8be5-c63c5b3c49a9 tempest-ProjectMemberTests-782019947 None] Created reservations ['b08a2487-2ab5-4bab-90f7-6e1798d3e48e', 'c8bae810-fa38-4036-8ce6-4f92b72bc85a', '14bf7bbb-6bde-4058-8a97-d2a2488de6b0', 'adfd3d24-c137-4d57-aa8d-ba1e2a6cb295'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:30:28 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-ff659dd1-5057-4609-8be5-c63c5b3c49a9 tempest-ProjectMemberTests-782019947 None] Delete snapshot completed successfully.
Nov 04 12:30:28 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ff659dd1-5057-4609-8be5-c63c5b3c49a9 tempest-ProjectMemberTests-782019947 None] Lock "cinder-9f5f2044-d81f-44c1-9d41-780da2e8be92-delete_snapshot" released by "delete_snapshot" :: held 2.210s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:28 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-93dfd7c7-8e1c-44a9-9eea-d31132f1f22c tempest-CinderUnicodeTest-271981707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:30:28 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-93dfd7c7-8e1c-44a9-9eea-d31132f1f22c tempest-CinderUnicodeTest-271981707 None] Flow 'volume_create_manager' (df8dd705-71ec-47c2-8cad-32030a0d3fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:30:28 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-93dfd7c7-8e1c-44a9-9eea-d31132f1f22c tempest-CinderUnicodeTest-271981707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fea0782c-5444-4401-9adc-759ce722be00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:28 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-93dfd7c7-8e1c-44a9-9eea-d31132f1f22c tempest-CinderUnicodeTest-271981707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fea0782c-5444-4401-9adc-759ce722be00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:30:28Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1808206695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e61974e6-018a-4e5b-b4a7-36df3b2de7c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4220c19033ab47d59eea0ac9b6dfcb37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:28Z,use_quota=True,user_id='403facdf687f46eca12e2765f5276184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:28 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-93dfd7c7-8e1c-44a9-9eea-d31132f1f22c tempest-CinderUnicodeTest-271981707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d221fe32-49f2-430d-8127-9d7a066e100b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:28 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-93dfd7c7-8e1c-44a9-9eea-d31132f1f22c tempest-CinderUnicodeTest-271981707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d221fe32-49f2-430d-8127-9d7a066e100b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:28 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-93dfd7c7-8e1c-44a9-9eea-d31132f1f22c tempest-CinderUnicodeTest-271981707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fbdbc9e-bc2c-4925-a6e0-60f9e83868a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:28 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-93dfd7c7-8e1c-44a9-9eea-d31132f1f22c tempest-CinderUnicodeTest-271981707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fbdbc9e-bc2c-4925-a6e0-60f9e83868a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e61974e6-018a-4e5b-b4a7-36df3b2de7c9', 'volume_name': 'volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:28 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-93dfd7c7-8e1c-44a9-9eea-d31132f1f22c tempest-CinderUnicodeTest-271981707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83ff9a1a-7401-45a4-baa1-034943bd93f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:28 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-93dfd7c7-8e1c-44a9-9eea-d31132f1f22c tempest-CinderUnicodeTest-271981707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83ff9a1a-7401-45a4-baa1-034943bd93f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:28 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-93dfd7c7-8e1c-44a9-9eea-d31132f1f22c tempest-CinderUnicodeTest-271981707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efc3daed-cbc4-4c96-bada-2b95af4c6277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:28 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-93dfd7c7-8e1c-44a9-9eea-d31132f1f22c tempest-CinderUnicodeTest-271981707 None] Volume e61974e6-018a-4e5b-b4a7-36df3b2de7c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9', 'volume_size': 1}
Nov 04 12:30:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-93dfd7c7-8e1c-44a9-9eea-d31132f1f22c tempest-CinderUnicodeTest-271981707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-93dfd7c7-8e1c-44a9-9eea-d31132f1f22c tempest-CinderUnicodeTest-271981707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:28 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-93dfd7c7-8e1c-44a9-9eea-d31132f1f22c tempest-CinderUnicodeTest-271981707 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:30:28Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1808206695',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e61974e6-018a-4e5b-b4a7-36df3b2de7c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4220c19033ab47d59eea0ac9b6dfcb37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:28Z,use_quota=True,user_id='403facdf687f46eca12e2765f5276184',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:30:28 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-93dfd7c7-8e1c-44a9-9eea-d31132f1f22c tempest-CinderUnicodeTest-271981707 None] Creating volume e61974e6-018a-4e5b-b4a7-36df3b2de7c9 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:30:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-93dfd7c7-8e1c-44a9-9eea-d31132f1f22c tempest-CinderUnicodeTest-271981707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-93dfd7c7-8e1c-44a9-9eea-d31132f1f22c tempest-CinderUnicodeTest-271981707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:28 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-93dfd7c7-8e1c-44a9-9eea-d31132f1f22c tempest-CinderUnicodeTest-271981707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:30:28 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-93dfd7c7-8e1c-44a9-9eea-d31132f1f22c tempest-CinderUnicodeTest-271981707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:30:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-93dfd7c7-8e1c-44a9-9eea-d31132f1f22c tempest-CinderUnicodeTest-271981707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:28 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-93dfd7c7-8e1c-44a9-9eea-d31132f1f22c tempest-CinderUnicodeTest-271981707 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:30:28 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-93dfd7c7-8e1c-44a9-9eea-d31132f1f22c tempest-CinderUnicodeTest-271981707 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:30:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-93dfd7c7-8e1c-44a9-9eea-d31132f1f22c tempest-CinderUnicodeTest-271981707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:28 devstack sudo[107792]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9 1073741824
Nov 04 12:30:28 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:29 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c608dfba-e09b-4074-96f5-9e7fb505ace4 tempest-ProjectReaderTests-1710404759 None] Acquiring lock "cinder-8a20a0e7-44e5-4413-a05b-7a61b0e7a83a-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:29 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c608dfba-e09b-4074-96f5-9e7fb505ace4 tempest-ProjectReaderTests-1710404759 None] Lock "cinder-8a20a0e7-44e5-4413-a05b-7a61b0e7a83a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:29 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c608dfba-e09b-4074-96f5-9e7fb505ace4 tempest-ProjectReaderTests-1710404759 None] Acquiring lock "cinder-quobyte-8a20a0e7-44e5-4413-a05b-7a61b0e7a83a" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:29 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-93dfd7c7-8e1c-44a9-9eea-d31132f1f22c tempest-CinderUnicodeTest-271981707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9 1073741824" returned: 0 in 0.574s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:29 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c608dfba-e09b-4074-96f5-9e7fb505ace4 tempest-ProjectReaderTests-1710404759 None] Lock "cinder-quobyte-8a20a0e7-44e5-4413-a05b-7a61b0e7a83a" acquired by "delete_volume" :: waited 0.022s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:29 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d78bfd1-d685-40fc-be98-e0caed8015e3]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c608dfba-e09b-4074-96f5-9e7fb505ace4 tempest-ProjectReaderTests-1710404759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a20a0e7-44e5-4413-a05b-7a61b0e7a83a {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-93dfd7c7-8e1c-44a9-9eea-d31132f1f22c tempest-CinderUnicodeTest-271981707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:29 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f484b6f0-8368-4216-95a7-5eb12fe9c302 tempest-ProjectMemberTests-782019947 None] Acquiring lock "cinder-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:29 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f484b6f0-8368-4216-95a7-5eb12fe9c302 tempest-ProjectMemberTests-782019947 None] Lock "cinder-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:29 devstack sudo[107799]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9
Nov 04 12:30:29 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:29 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f484b6f0-8368-4216-95a7-5eb12fe9c302 tempest-ProjectMemberTests-782019947 None] Acquiring lock "cinder-quobyte-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:29 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f484b6f0-8368-4216-95a7-5eb12fe9c302 tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c" acquired by "delete_volume" :: waited 0.015s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:29 devstack sudo[107798]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a20a0e7-44e5-4413-a05b-7a61b0e7a83a
Nov 04 12:30:29 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:29 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e537b2-a760-4979-8765-56195a049e0c]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f484b6f0-8368-4216-95a7-5eb12fe9c302 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:29 devstack sudo[107802]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c
Nov 04 12:30:29 devstack sudo[107802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:29 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-93dfd7c7-8e1c-44a9-9eea-d31132f1f22c tempest-CinderUnicodeTest-271981707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9" returned: 0 in 0.352s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:29 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-93dfd7c7-8e1c-44a9-9eea-d31132f1f22c tempest-CinderUnicodeTest-271981707 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:30:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-93dfd7c7-8e1c-44a9-9eea-d31132f1f22c tempest-CinderUnicodeTest-271981707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:29 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-93dfd7c7-8e1c-44a9-9eea-d31132f1f22c tempest-CinderUnicodeTest-271981707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efc3daed-cbc4-4c96-bada-2b95af4c6277) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:29 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-93dfd7c7-8e1c-44a9-9eea-d31132f1f22c tempest-CinderUnicodeTest-271981707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19ffc7ac-f250-44ef-8d30-ae0b50617d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:29 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-93dfd7c7-8e1c-44a9-9eea-d31132f1f22c tempest-CinderUnicodeTest-271981707 None] Volume volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9 (e61974e6-018a-4e5b-b4a7-36df3b2de7c9): created successfully
Nov 04 12:30:29 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-93dfd7c7-8e1c-44a9-9eea-d31132f1f22c tempest-CinderUnicodeTest-271981707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19ffc7ac-f250-44ef-8d30-ae0b50617d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:29 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-93dfd7c7-8e1c-44a9-9eea-d31132f1f22c tempest-CinderUnicodeTest-271981707 None] Flow 'volume_create_manager' (df8dd705-71ec-47c2-8cad-32030a0d3fe0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:30:29 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-93dfd7c7-8e1c-44a9-9eea-d31132f1f22c tempest-CinderUnicodeTest-271981707 None] Created volume successfully.
Nov 04 12:30:29 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c608dfba-e09b-4074-96f5-9e7fb505ace4 tempest-ProjectReaderTests-1710404759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a20a0e7-44e5-4413-a05b-7a61b0e7a83a" returned: 0 in 0.514s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c608dfba-e09b-4074-96f5-9e7fb505ace4 tempest-ProjectReaderTests-1710404759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a20a0e7-44e5-4413-a05b-7a61b0e7a83a {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:29 devstack sudo[107808]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a20a0e7-44e5-4413-a05b-7a61b0e7a83a
Nov 04 12:30:29 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:29 devstack sudo[107802]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f484b6f0-8368-4216-95a7-5eb12fe9c302 tempest-ProjectMemberTests-782019947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c" returned: 0 in 0.459s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f484b6f0-8368-4216-95a7-5eb12fe9c302 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:29 devstack sudo[107813]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c
Nov 04 12:30:29 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:29 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c608dfba-e09b-4074-96f5-9e7fb505ace4 tempest-ProjectReaderTests-1710404759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a20a0e7-44e5-4413-a05b-7a61b0e7a83a" returned: 0 in 0.276s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:29 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c608dfba-e09b-4074-96f5-9e7fb505ace4 tempest-ProjectReaderTests-1710404759 None] Lock "cinder-quobyte-8a20a0e7-44e5-4413-a05b-7a61b0e7a83a" released by "delete_volume" :: held 0.852s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:30 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-c608dfba-e09b-4074-96f5-9e7fb505ace4 tempest-ProjectReaderTests-1710404759 None] Created reservations ['83c9cf80-a869-465e-89bd-f16699b41f48', '8864cbcd-75f6-4b27-b9cc-1c0ea8daa8d4', '2f3fea2d-6bbf-4aff-af4d-1da987a43a56', '75ec6a7b-6088-4b2e-b9b1-81864ee812f6'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:30:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c608dfba-e09b-4074-96f5-9e7fb505ace4 tempest-ProjectReaderTests-1710404759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c608dfba-e09b-4074-96f5-9e7fb505ace4 tempest-ProjectReaderTests-1710404759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:30 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c608dfba-e09b-4074-96f5-9e7fb505ace4 tempest-ProjectReaderTests-1710404759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:30:30 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c608dfba-e09b-4074-96f5-9e7fb505ace4 tempest-ProjectReaderTests-1710404759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:30:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c608dfba-e09b-4074-96f5-9e7fb505ace4 tempest-ProjectReaderTests-1710404759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c608dfba-e09b-4074-96f5-9e7fb505ace4 tempest-ProjectReaderTests-1710404759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:30 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f484b6f0-8368-4216-95a7-5eb12fe9c302 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c" returned: 0 in 0.314s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:30 devstack sudo[107817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:30:30 devstack sudo[107817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:30 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f484b6f0-8368-4216-95a7-5eb12fe9c302 tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c" released by "delete_volume" :: held 0.875s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:30 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-f484b6f0-8368-4216-95a7-5eb12fe9c302 tempest-ProjectMemberTests-782019947 None] Created reservations ['675f4d69-296f-4891-abeb-3dc74cd670e9', 'cb41bdfb-5843-4a4d-a84d-3a44ae6105f0', '61ee58d0-58ec-4b4b-8f64-ec32be59da42', 'afa226a6-660a-4fb5-b817-8405f0fc770c'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:30:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f484b6f0-8368-4216-95a7-5eb12fe9c302 tempest-ProjectMemberTests-782019947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f484b6f0-8368-4216-95a7-5eb12fe9c302 tempest-ProjectMemberTests-782019947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:30 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f484b6f0-8368-4216-95a7-5eb12fe9c302 tempest-ProjectMemberTests-782019947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:30:30 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-f484b6f0-8368-4216-95a7-5eb12fe9c302 tempest-ProjectMemberTests-782019947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:30:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f484b6f0-8368-4216-95a7-5eb12fe9c302 tempest-ProjectMemberTests-782019947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f484b6f0-8368-4216-95a7-5eb12fe9c302 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:30 devstack sudo[107820]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:30:30 devstack sudo[107820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:30 devstack sudo[107817]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c608dfba-e09b-4074-96f5-9e7fb505ace4 tempest-ProjectReaderTests-1710404759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.340s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:30 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-c608dfba-e09b-4074-96f5-9e7fb505ace4 tempest-ProjectReaderTests-1710404759 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:30:30 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-c608dfba-e09b-4074-96f5-9e7fb505ace4 tempest-ProjectReaderTests-1710404759 None] Deleted volume successfully.
Nov 04 12:30:30 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c608dfba-e09b-4074-96f5-9e7fb505ace4 tempest-ProjectReaderTests-1710404759 None] Lock "cinder-8a20a0e7-44e5-4413-a05b-7a61b0e7a83a-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:30 devstack sudo[107820]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f484b6f0-8368-4216-95a7-5eb12fe9c302 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.419s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:30 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-f484b6f0-8368-4216-95a7-5eb12fe9c302 tempest-ProjectMemberTests-782019947 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:30:30 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-f484b6f0-8368-4216-95a7-5eb12fe9c302 tempest-ProjectMemberTests-782019947 None] Deleted volume successfully.
Nov 04 12:30:30 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-f484b6f0-8368-4216-95a7-5eb12fe9c302 tempest-ProjectMemberTests-782019947 None] Lock "cinder-18c8b16d-e88e-4a67-9da0-c7fa9800fa9c-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:30 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cab9348-f06d-41bb-a9c7-806252b7ca1a tempest-ProjectReaderTests-745542355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:30:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-9cab9348-f06d-41bb-a9c7-806252b7ca1a tempest-ProjectReaderTests-745542355 None] Flow 'volume_create_manager' (e021b56b-e3ba-43bd-a890-f32d9c0d2b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:30:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-9cab9348-f06d-41bb-a9c7-806252b7ca1a tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edbe735c-9d19-4ce6-a9b9-d3bdc0579865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-9cab9348-f06d-41bb-a9c7-806252b7ca1a tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edbe735c-9d19-4ce6-a9b9-d3bdc0579865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-654504225',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='324f832ed91d41c5891b98855382e88b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:31Z,use_quota=True,user_id='c72534133ab0445ca0b45d95d7c20347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-9cab9348-f06d-41bb-a9c7-806252b7ca1a tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9833862-ea71-40e3-bad0-3a547854e3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-9cab9348-f06d-41bb-a9c7-806252b7ca1a tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9833862-ea71-40e3-bad0-3a547854e3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-9cab9348-f06d-41bb-a9c7-806252b7ca1a tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37999c91-c0e6-441b-9165-24fec7f4d16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-9cab9348-f06d-41bb-a9c7-806252b7ca1a tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37999c91-c0e6-441b-9165-24fec7f4d16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508', 'volume_name': 'volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-9cab9348-f06d-41bb-a9c7-806252b7ca1a tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8323383a-f91a-41fe-a6ee-23c6c19e4bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-9cab9348-f06d-41bb-a9c7-806252b7ca1a tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8323383a-f91a-41fe-a6ee-23c6c19e4bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-9cab9348-f06d-41bb-a9c7-806252b7ca1a tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c843af6-e537-4de1-86c9-f2275daecc43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:31 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-9cab9348-f06d-41bb-a9c7-806252b7ca1a tempest-ProjectReaderTests-745542355 None] Volume f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508', 'volume_size': 1}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-9cab9348-f06d-41bb-a9c7-806252b7ca1a tempest-ProjectReaderTests-745542355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-9cab9348-f06d-41bb-a9c7-806252b7ca1a tempest-ProjectReaderTests-745542355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-9cab9348-f06d-41bb-a9c7-806252b7ca1a tempest-ProjectReaderTests-745542355 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-654504225',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='324f832ed91d41c5891b98855382e88b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:31Z,use_quota=True,user_id='c72534133ab0445ca0b45d95d7c20347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-9cab9348-f06d-41bb-a9c7-806252b7ca1a tempest-ProjectReaderTests-745542355 None] Creating volume f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-9cab9348-f06d-41bb-a9c7-806252b7ca1a tempest-ProjectReaderTests-745542355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-9cab9348-f06d-41bb-a9c7-806252b7ca1a tempest-ProjectReaderTests-745542355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-9cab9348-f06d-41bb-a9c7-806252b7ca1a tempest-ProjectReaderTests-745542355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-9cab9348-f06d-41bb-a9c7-806252b7ca1a tempest-ProjectReaderTests-745542355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-9cab9348-f06d-41bb-a9c7-806252b7ca1a tempest-ProjectReaderTests-745542355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-9cab9348-f06d-41bb-a9c7-806252b7ca1a tempest-ProjectReaderTests-745542355 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:30:31 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-9cab9348-f06d-41bb-a9c7-806252b7ca1a tempest-ProjectReaderTests-745542355 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9cab9348-f06d-41bb-a9c7-806252b7ca1a tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:31 devstack sudo[107823]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508 1073741824
Nov 04 12:30:31 devstack sudo[107823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-be014c9e-36c4-44d4-a14c-b989b725fc7f tempest-ProjectReaderTests-1710404759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-be014c9e-36c4-44d4-a14c-b989b725fc7f tempest-ProjectReaderTests-1710404759 None] Flow 'volume_create_manager' (f4428875-8e96-4b02-bfa5-1f296ea83c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-be014c9e-36c4-44d4-a14c-b989b725fc7f tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (521b73d6-f942-4034-a465-b63b35078977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-be014c9e-36c4-44d4-a14c-b989b725fc7f tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (521b73d6-f942-4034-a465-b63b35078977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1763159553',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=157dec46-7a1a-44d9-ab14-ea2c6d47dd86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acea6ec1649b4cebaad9ac5925dcf8e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:31Z,use_quota=True,user_id='32c122b3b1f2421aab388e2afee84c8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-be014c9e-36c4-44d4-a14c-b989b725fc7f tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4474165-47d9-4dd5-8ab5-11e4b0b7c257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-be014c9e-36c4-44d4-a14c-b989b725fc7f tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4474165-47d9-4dd5-8ab5-11e4b0b7c257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-be014c9e-36c4-44d4-a14c-b989b725fc7f tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d80a07-ea85-4362-9940-062cc8b02746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-be014c9e-36c4-44d4-a14c-b989b725fc7f tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27d80a07-ea85-4362-9940-062cc8b02746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '157dec46-7a1a-44d9-ab14-ea2c6d47dd86', 'volume_name': 'volume-157dec46-7a1a-44d9-ab14-ea2c6d47dd86', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-be014c9e-36c4-44d4-a14c-b989b725fc7f tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f3a79e0-9bbd-4021-b46d-f9fb13cd0a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-be014c9e-36c4-44d4-a14c-b989b725fc7f tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f3a79e0-9bbd-4021-b46d-f9fb13cd0a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-be014c9e-36c4-44d4-a14c-b989b725fc7f tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a914dd6-c28e-49db-a86d-5b7f291b363d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:31 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-be014c9e-36c4-44d4-a14c-b989b725fc7f tempest-ProjectReaderTests-1710404759 None] Volume 157dec46-7a1a-44d9-ab14-ea2c6d47dd86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-157dec46-7a1a-44d9-ab14-ea2c6d47dd86', 'volume_size': 1}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-be014c9e-36c4-44d4-a14c-b989b725fc7f tempest-ProjectReaderTests-1710404759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-0d66797e-6ed8-4b20-a943-596006458821 tempest-CinderUnicodeTest-271981707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c217e20-ed64-4bd6-a041-4311bf06054c tempest-ProjectMemberTests-782019947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3c217e20-ed64-4bd6-a041-4311bf06054c tempest-ProjectMemberTests-782019947 None] Flow 'volume_create_manager' (7b7dd026-fc46-4452-8b3d-39611c62182b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3c217e20-ed64-4bd6-a041-4311bf06054c tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a777047d-3eaf-407a-8a5a-40b47c2cdc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3c217e20-ed64-4bd6-a041-4311bf06054c tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a777047d-3eaf-407a-8a5a-40b47c2cdc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1022168806',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5a80a035d04be496795229f2e16378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:31Z,use_quota=True,user_id='4f258b2e50a741e4b75bd5ecf8d3039a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3c217e20-ed64-4bd6-a041-4311bf06054c tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ef4a7d5-5717-4053-b74d-4ad702911e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3c217e20-ed64-4bd6-a041-4311bf06054c tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ef4a7d5-5717-4053-b74d-4ad702911e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3c217e20-ed64-4bd6-a041-4311bf06054c tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47eeda58-168b-4790-bf92-9b3922acf153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3c217e20-ed64-4bd6-a041-4311bf06054c tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47eeda58-168b-4790-bf92-9b3922acf153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f', 'volume_name': 'volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3c217e20-ed64-4bd6-a041-4311bf06054c tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e41fbdf5-e0a0-44dd-b100-9817fc691582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3c217e20-ed64-4bd6-a041-4311bf06054c tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e41fbdf5-e0a0-44dd-b100-9817fc691582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3c217e20-ed64-4bd6-a041-4311bf06054c tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1c19977-87aa-4224-86e2-5729e89fc0f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:31 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-3c217e20-ed64-4bd6-a041-4311bf06054c tempest-ProjectMemberTests-782019947 None] Volume fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f', 'volume_size': 1}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3c217e20-ed64-4bd6-a041-4311bf06054c tempest-ProjectMemberTests-782019947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:31 devstack sudo[107823]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9cab9348-f06d-41bb-a9c7-806252b7ca1a tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508 1073741824" returned: 0 in 0.440s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9cab9348-f06d-41bb-a9c7-806252b7ca1a tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:31 devstack sudo[107829]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508
Nov 04 12:30:31 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:31 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9cab9348-f06d-41bb-a9c7-806252b7ca1a tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508" returned: 0 in 0.249s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-9cab9348-f06d-41bb-a9c7-806252b7ca1a tempest-ProjectReaderTests-745542355 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-9cab9348-f06d-41bb-a9c7-806252b7ca1a tempest-ProjectReaderTests-745542355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-be014c9e-36c4-44d4-a14c-b989b725fc7f tempest-ProjectReaderTests-1710404759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.472s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-be014c9e-36c4-44d4-a14c-b989b725fc7f tempest-ProjectReaderTests-1710404759 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:30:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1763159553',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=157dec46-7a1a-44d9-ab14-ea2c6d47dd86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acea6ec1649b4cebaad9ac5925dcf8e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:31Z,use_quota=True,user_id='32c122b3b1f2421aab388e2afee84c8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-be014c9e-36c4-44d4-a14c-b989b725fc7f tempest-ProjectReaderTests-1710404759 None] Creating volume 157dec46-7a1a-44d9-ab14-ea2c6d47dd86 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-be014c9e-36c4-44d4-a14c-b989b725fc7f tempest-ProjectReaderTests-1710404759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-be014c9e-36c4-44d4-a14c-b989b725fc7f tempest-ProjectReaderTests-1710404759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-be014c9e-36c4-44d4-a14c-b989b725fc7f tempest-ProjectReaderTests-1710404759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-be014c9e-36c4-44d4-a14c-b989b725fc7f tempest-ProjectReaderTests-1710404759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-be014c9e-36c4-44d4-a14c-b989b725fc7f tempest-ProjectReaderTests-1710404759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-be014c9e-36c4-44d4-a14c-b989b725fc7f tempest-ProjectReaderTests-1710404759 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:30:31 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-be014c9e-36c4-44d4-a14c-b989b725fc7f tempest-ProjectReaderTests-1710404759 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-be014c9e-36c4-44d4-a14c-b989b725fc7f tempest-ProjectReaderTests-1710404759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-157dec46-7a1a-44d9-ab14-ea2c6d47dd86 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-9cab9348-f06d-41bb-a9c7-806252b7ca1a tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c843af6-e537-4de1-86c9-f2275daecc43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:31 devstack sudo[107833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-157dec46-7a1a-44d9-ab14-ea2c6d47dd86 1073741824
Nov 04 12:30:31 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-9cab9348-f06d-41bb-a9c7-806252b7ca1a tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10085a12-5df1-4dce-b11c-9d3278d0b984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:31 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-9cab9348-f06d-41bb-a9c7-806252b7ca1a tempest-ProjectReaderTests-745542355 None] Volume volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508 (f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508): created successfully
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-9cab9348-f06d-41bb-a9c7-806252b7ca1a tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10085a12-5df1-4dce-b11c-9d3278d0b984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:31 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-9cab9348-f06d-41bb-a9c7-806252b7ca1a tempest-ProjectReaderTests-745542355 None] Flow 'volume_create_manager' (e021b56b-e3ba-43bd-a890-f32d9c0d2b1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:30:31 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-9cab9348-f06d-41bb-a9c7-806252b7ca1a tempest-ProjectReaderTests-745542355 None] Created volume successfully.
Nov 04 12:30:32 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-be014c9e-36c4-44d4-a14c-b989b725fc7f tempest-ProjectReaderTests-1710404759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-157dec46-7a1a-44d9-ab14-ea2c6d47dd86 1073741824" returned: 0 in 0.409s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-be014c9e-36c4-44d4-a14c-b989b725fc7f tempest-ProjectReaderTests-1710404759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-157dec46-7a1a-44d9-ab14-ea2c6d47dd86 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:32 devstack sudo[107839]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-157dec46-7a1a-44d9-ab14-ea2c6d47dd86
Nov 04 12:30:32 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:32 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-be014c9e-36c4-44d4-a14c-b989b725fc7f tempest-ProjectReaderTests-1710404759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-157dec46-7a1a-44d9-ab14-ea2c6d47dd86" returned: 0 in 0.234s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:32 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-be014c9e-36c4-44d4-a14c-b989b725fc7f tempest-ProjectReaderTests-1710404759 None] <== create_volume: return (680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:30:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-be014c9e-36c4-44d4-a14c-b989b725fc7f tempest-ProjectReaderTests-1710404759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.684s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-0d66797e-6ed8-4b20-a943-596006458821 tempest-CinderUnicodeTest-271981707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.143s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-be014c9e-36c4-44d4-a14c-b989b725fc7f tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a914dd6-c28e-49db-a86d-5b7f291b363d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-157dec46-7a1a-44d9-ab14-ea2c6d47dd86', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-be014c9e-36c4-44d4-a14c-b989b725fc7f tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa28db28-eea8-465c-9031-9b5facd06e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:32 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-0d66797e-6ed8-4b20-a943-596006458821 tempest-CinderUnicodeTest-271981707 None] Creating offline snapshot adc790e4-e3c2-4ca6-9957-9ddeef9ae2ff of volume e61974e6-018a-4e5b-b4a7-36df3b2de7c9 {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:30:32 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-be014c9e-36c4-44d4-a14c-b989b725fc7f tempest-ProjectReaderTests-1710404759 None] Volume volume-157dec46-7a1a-44d9-ab14-ea2c6d47dd86 (157dec46-7a1a-44d9-ab14-ea2c6d47dd86): created successfully
Nov 04 12:30:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-be014c9e-36c4-44d4-a14c-b989b725fc7f tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa28db28-eea8-465c-9031-9b5facd06e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:32 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-be014c9e-36c4-44d4-a14c-b989b725fc7f tempest-ProjectReaderTests-1710404759 None] Flow 'volume_create_manager' (f4428875-8e96-4b02-bfa5-1f296ea83c7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:30:32 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[703426e5-0b4d-47e7-84ba-3a73356e1459]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0d66797e-6ed8-4b20-a943-596006458821 tempest-CinderUnicodeTest-271981707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:32 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-be014c9e-36c4-44d4-a14c-b989b725fc7f tempest-ProjectReaderTests-1710404759 None] Created volume successfully.
Nov 04 12:30:32 devstack sudo[107842]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9
Nov 04 12:30:32 devstack sudo[107842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2ffffcac-45a0-4e36-b4fc-81c55cd525d2 tempest-ProjectReaderTests-745542355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:32 devstack sudo[107842]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0d66797e-6ed8-4b20-a943-596006458821 tempest-CinderUnicodeTest-271981707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9" returned: 0 in 0.401s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0d66797e-6ed8-4b20-a943-596006458821 tempest-CinderUnicodeTest-271981707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9.adc790e4-e3c2-4ca6-9957-9ddeef9ae2ff 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:32 devstack sudo[107853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9.adc790e4-e3c2-4ca6-9957-9ddeef9ae2ff 1G
Nov 04 12:30:32 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:32 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3aeae114-9f40-4907-bb81-fb100043204c tempest-ProjectReaderTests-1710404759 None] Acquiring lock "cinder-157dec46-7a1a-44d9-ab14-ea2c6d47dd86-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:32 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3aeae114-9f40-4907-bb81-fb100043204c tempest-ProjectReaderTests-1710404759 None] Lock "cinder-157dec46-7a1a-44d9-ab14-ea2c6d47dd86-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:32 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3aeae114-9f40-4907-bb81-fb100043204c tempest-ProjectReaderTests-1710404759 None] Acquiring lock "cinder-quobyte-157dec46-7a1a-44d9-ab14-ea2c6d47dd86" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:33 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3aeae114-9f40-4907-bb81-fb100043204c tempest-ProjectReaderTests-1710404759 None] Lock "cinder-quobyte-157dec46-7a1a-44d9-ab14-ea2c6d47dd86" acquired by "delete_volume" :: waited 0.017s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:33 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2ddf39-fee5-4434-995e-5bb52fff32c4]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3aeae114-9f40-4907-bb81-fb100043204c tempest-ProjectReaderTests-1710404759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-157dec46-7a1a-44d9-ab14-ea2c6d47dd86 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:33 devstack sudo[107855]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-157dec46-7a1a-44d9-ab14-ea2c6d47dd86
Nov 04 12:30:33 devstack sudo[107855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:33 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0d66797e-6ed8-4b20-a943-596006458821 tempest-CinderUnicodeTest-271981707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9.adc790e4-e3c2-4ca6-9957-9ddeef9ae2ff 1G" returned: 0 in 0.422s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0d66797e-6ed8-4b20-a943-596006458821 tempest-CinderUnicodeTest-271981707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9.adc790e4-e3c2-4ca6-9957-9ddeef9ae2ff {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:33 devstack sudo[107860]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9.adc790e4-e3c2-4ca6-9957-9ddeef9ae2ff
Nov 04 12:30:33 devstack sudo[107860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:33 devstack sudo[107855]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3aeae114-9f40-4907-bb81-fb100043204c tempest-ProjectReaderTests-1710404759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-157dec46-7a1a-44d9-ab14-ea2c6d47dd86" returned: 0 in 0.397s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3aeae114-9f40-4907-bb81-fb100043204c tempest-ProjectReaderTests-1710404759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-157dec46-7a1a-44d9-ab14-ea2c6d47dd86 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:33 devstack sudo[107865]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-157dec46-7a1a-44d9-ab14-ea2c6d47dd86
Nov 04 12:30:33 devstack sudo[107865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:33 devstack sudo[107860]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0d66797e-6ed8-4b20-a943-596006458821 tempest-CinderUnicodeTest-271981707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9.adc790e4-e3c2-4ca6-9957-9ddeef9ae2ff" returned: 0 in 0.299s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:33 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-0d66797e-6ed8-4b20-a943-596006458821 tempest-CinderUnicodeTest-271981707 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9.adc790e4-e3c2-4ca6-9957-9ddeef9ae2ff is being set with open permissions: ugo+rw
Nov 04 12:30:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0d66797e-6ed8-4b20-a943-596006458821 tempest-CinderUnicodeTest-271981707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9.adc790e4-e3c2-4ca6-9957-9ddeef9ae2ff {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:33 devstack sudo[107870]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9.adc790e4-e3c2-4ca6-9957-9ddeef9ae2ff
Nov 04 12:30:33 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:33 devstack sudo[107865]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3aeae114-9f40-4907-bb81-fb100043204c tempest-ProjectReaderTests-1710404759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-157dec46-7a1a-44d9-ab14-ea2c6d47dd86" returned: 0 in 0.260s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:33 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3aeae114-9f40-4907-bb81-fb100043204c tempest-ProjectReaderTests-1710404759 None] Lock "cinder-quobyte-157dec46-7a1a-44d9-ab14-ea2c6d47dd86" released by "delete_volume" :: held 0.712s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:33 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-3aeae114-9f40-4907-bb81-fb100043204c tempest-ProjectReaderTests-1710404759 None] Created reservations ['721822c2-f2ef-48cc-8e77-809624670c9a', '39d47e57-7bfa-4bc6-803c-869360ad528f', 'c3eaefcf-0e09-4b6b-889d-cf95a935242e', '48486ad8-4a3a-4ac0-b9df-d6041d02a697'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:30:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3aeae114-9f40-4907-bb81-fb100043204c tempest-ProjectReaderTests-1710404759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3aeae114-9f40-4907-bb81-fb100043204c tempest-ProjectReaderTests-1710404759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:33 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3aeae114-9f40-4907-bb81-fb100043204c tempest-ProjectReaderTests-1710404759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:30:33 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3aeae114-9f40-4907-bb81-fb100043204c tempest-ProjectReaderTests-1710404759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:30:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3aeae114-9f40-4907-bb81-fb100043204c tempest-ProjectReaderTests-1710404759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3aeae114-9f40-4907-bb81-fb100043204c tempest-ProjectReaderTests-1710404759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:33 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0d66797e-6ed8-4b20-a943-596006458821 tempest-CinderUnicodeTest-271981707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9.adc790e4-e3c2-4ca6-9957-9ddeef9ae2ff" returned: 0 in 0.256s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:33 devstack sudo[107874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:30:33 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0d66797e-6ed8-4b20-a943-596006458821 tempest-CinderUnicodeTest-271981707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:33 devstack sudo[107876]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9.info
Nov 04 12:30:33 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:34 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3aeae114-9f40-4907-bb81-fb100043204c tempest-ProjectReaderTests-1710404759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.290s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:34 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-3aeae114-9f40-4907-bb81-fb100043204c tempest-ProjectReaderTests-1710404759 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:30:34 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-3aeae114-9f40-4907-bb81-fb100043204c tempest-ProjectReaderTests-1710404759 None] Deleted volume successfully.
Nov 04 12:30:34 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3aeae114-9f40-4907-bb81-fb100043204c tempest-ProjectReaderTests-1710404759 None] Lock "cinder-157dec46-7a1a-44d9-ab14-ea2c6d47dd86-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:34 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0d66797e-6ed8-4b20-a943-596006458821 tempest-CinderUnicodeTest-271981707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9.info" returned: 0 in 0.307s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:34 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-0d66797e-6ed8-4b20-a943-596006458821 tempest-CinderUnicodeTest-271981707 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9.info is being set with open permissions: ugo+rw
Nov 04 12:30:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0d66797e-6ed8-4b20-a943-596006458821 tempest-CinderUnicodeTest-271981707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:34 devstack sudo[107880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9.info
Nov 04 12:30:34 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:34 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0d66797e-6ed8-4b20-a943-596006458821 tempest-CinderUnicodeTest-271981707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9.info" returned: 0 in 0.255s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-0d66797e-6ed8-4b20-a943-596006458821 tempest-CinderUnicodeTest-271981707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.048s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3c217e20-ed64-4bd6-a041-4311bf06054c tempest-ProjectMemberTests-782019947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.107s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:34 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3c217e20-ed64-4bd6-a041-4311bf06054c tempest-ProjectMemberTests-782019947 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:30:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1022168806',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5a80a035d04be496795229f2e16378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:31Z,use_quota=True,user_id='4f258b2e50a741e4b75bd5ecf8d3039a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:30:34 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-3c217e20-ed64-4bd6-a041-4311bf06054c tempest-ProjectMemberTests-782019947 None] Creating volume fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:30:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3c217e20-ed64-4bd6-a041-4311bf06054c tempest-ProjectMemberTests-782019947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3c217e20-ed64-4bd6-a041-4311bf06054c tempest-ProjectMemberTests-782019947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:34 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3c217e20-ed64-4bd6-a041-4311bf06054c tempest-ProjectMemberTests-782019947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:30:34 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3c217e20-ed64-4bd6-a041-4311bf06054c tempest-ProjectMemberTests-782019947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:30:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3c217e20-ed64-4bd6-a041-4311bf06054c tempest-ProjectMemberTests-782019947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:34 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3c217e20-ed64-4bd6-a041-4311bf06054c tempest-ProjectMemberTests-782019947 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:30:34 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-3c217e20-ed64-4bd6-a041-4311bf06054c tempest-ProjectMemberTests-782019947 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:30:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3c217e20-ed64-4bd6-a041-4311bf06054c tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:34 devstack sudo[107883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f 1073741824
Nov 04 12:30:34 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:34 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-0d66797e-6ed8-4b20-a943-596006458821 tempest-CinderUnicodeTest-271981707 None] Create snapshot completed successfully
Nov 04 12:30:34 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1a5112e-bbe0-41ce-b7d6-89de9078c546 tempest-ProjectReaderTests-1710404759 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:30:34 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b1a5112e-bbe0-41ce-b7d6-89de9078c546 tempest-ProjectReaderTests-1710404759 None] Flow 'volume_create_manager' (4c9d2468-422f-4a3d-b545-7a5692890d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:30:34 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b1a5112e-bbe0-41ce-b7d6-89de9078c546 tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f314c91-b27b-4c49-ac6f-0d6237d35a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:34 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b1a5112e-bbe0-41ce-b7d6-89de9078c546 tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f314c91-b27b-4c49-ac6f-0d6237d35a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-223417221',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=553ab5b4-54d3-4006-af07-07f58983c5d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acea6ec1649b4cebaad9ac5925dcf8e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:35Z,use_quota=True,user_id='32c122b3b1f2421aab388e2afee84c8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:34 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b1a5112e-bbe0-41ce-b7d6-89de9078c546 tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (492ae196-81fb-4ab6-910f-fb351760e1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:34 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b1a5112e-bbe0-41ce-b7d6-89de9078c546 tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (492ae196-81fb-4ab6-910f-fb351760e1e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:34 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b1a5112e-bbe0-41ce-b7d6-89de9078c546 tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f192914-653b-4bd2-a8bc-03c4dcad706b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:34 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b1a5112e-bbe0-41ce-b7d6-89de9078c546 tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f192914-653b-4bd2-a8bc-03c4dcad706b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '553ab5b4-54d3-4006-af07-07f58983c5d2', 'volume_name': 'volume-553ab5b4-54d3-4006-af07-07f58983c5d2', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:34 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b1a5112e-bbe0-41ce-b7d6-89de9078c546 tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (660fc192-416c-4523-b29e-119560bf74c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:34 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b1a5112e-bbe0-41ce-b7d6-89de9078c546 tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (660fc192-416c-4523-b29e-119560bf74c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:34 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b1a5112e-bbe0-41ce-b7d6-89de9078c546 tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92a2ed2a-6a3b-4891-8727-5c34b0a845ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:34 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-b1a5112e-bbe0-41ce-b7d6-89de9078c546 tempest-ProjectReaderTests-1710404759 None] Volume 553ab5b4-54d3-4006-af07-07f58983c5d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-553ab5b4-54d3-4006-af07-07f58983c5d2', 'volume_size': 1}
Nov 04 12:30:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b1a5112e-bbe0-41ce-b7d6-89de9078c546 tempest-ProjectReaderTests-1710404759 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:34 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3c217e20-ed64-4bd6-a041-4311bf06054c tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f 1073741824" returned: 0 in 0.408s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3c217e20-ed64-4bd6-a041-4311bf06054c tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:34 devstack sudo[107889]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f
Nov 04 12:30:34 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:35 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3c217e20-ed64-4bd6-a041-4311bf06054c tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f" returned: 0 in 0.236s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:35 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3c217e20-ed64-4bd6-a041-4311bf06054c tempest-ProjectMemberTests-782019947 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:30:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3c217e20-ed64-4bd6-a041-4311bf06054c tempest-ProjectMemberTests-782019947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2ffffcac-45a0-4e36-b4fc-81c55cd525d2 tempest-ProjectReaderTests-745542355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.376s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:35 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3c217e20-ed64-4bd6-a041-4311bf06054c tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1c19977-87aa-4224-86e2-5729e89fc0f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:35 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3c217e20-ed64-4bd6-a041-4311bf06054c tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d627707-8ba1-4a7d-8613-87c6c23cc2c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:35 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-2ffffcac-45a0-4e36-b4fc-81c55cd525d2 tempest-ProjectReaderTests-745542355 None] Creating offline snapshot 906f5d3b-15b2-42cf-9843-68f8bfd02abb of volume f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508 {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:30:35 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-3c217e20-ed64-4bd6-a041-4311bf06054c tempest-ProjectMemberTests-782019947 None] Volume volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f (fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f): created successfully
Nov 04 12:30:35 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3c217e20-ed64-4bd6-a041-4311bf06054c tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d627707-8ba1-4a7d-8613-87c6c23cc2c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:35 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3c217e20-ed64-4bd6-a041-4311bf06054c tempest-ProjectMemberTests-782019947 None] Flow 'volume_create_manager' (7b7dd026-fc46-4452-8b3d-39611c62182b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:30:35 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d74183-1098-4c0e-b9b5-e95bd425f416]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2ffffcac-45a0-4e36-b4fc-81c55cd525d2 tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:35 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-3c217e20-ed64-4bd6-a041-4311bf06054c tempest-ProjectMemberTests-782019947 None] Created volume successfully.
Nov 04 12:30:35 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-61865406-9900-47dc-bc59-dbcd498265dd tempest-CinderUnicodeTest-271981707 None] Acquiring lock "cinder-adc790e4-e3c2-4ca6-9957-9ddeef9ae2ff-delete_snapshot" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:35 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-61865406-9900-47dc-bc59-dbcd498265dd tempest-CinderUnicodeTest-271981707 None] Lock "cinder-adc790e4-e3c2-4ca6-9957-9ddeef9ae2ff-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:35 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-61865406-9900-47dc-bc59-dbcd498265dd tempest-CinderUnicodeTest-271981707 None] Acquiring lock "cinder-quobyte-e61974e6-018a-4e5b-b4a7-36df3b2de7c9" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:35 devstack sudo[107892]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508
Nov 04 12:30:35 devstack sudo[107892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:35 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-61865406-9900-47dc-bc59-dbcd498265dd tempest-CinderUnicodeTest-271981707 None] Lock "cinder-quobyte-e61974e6-018a-4e5b-b4a7-36df3b2de7c9" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:35 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-61865406-9900-47dc-bc59-dbcd498265dd tempest-CinderUnicodeTest-271981707 None] Acquiring lock "cinder-quobyte-adc790e4-e3c2-4ca6-9957-9ddeef9ae2ff" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:35 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-61865406-9900-47dc-bc59-dbcd498265dd tempest-CinderUnicodeTest-271981707 None] Lock "cinder-quobyte-adc790e4-e3c2-4ca6-9957-9ddeef9ae2ff" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:35 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-61865406-9900-47dc-bc59-dbcd498265dd tempest-CinderUnicodeTest-271981707 None] Deleting offline snapshot adc790e4-e3c2-4ca6-9957-9ddeef9ae2ff of volume e61974e6-018a-4e5b-b4a7-36df3b2de7c9 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:30:35 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-61865406-9900-47dc-bc59-dbcd498265dd tempest-CinderUnicodeTest-271981707 None] snapshot_file for this snap is: volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9.adc790e4-e3c2-4ca6-9957-9ddeef9ae2ff {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:30:35 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e9ae34-c266-4b0f-a2c4-7562c1233178]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-61865406-9900-47dc-bc59-dbcd498265dd tempest-CinderUnicodeTest-271981707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9.adc790e4-e3c2-4ca6-9957-9ddeef9ae2ff {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:35 devstack sudo[107894]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9.adc790e4-e3c2-4ca6-9957-9ddeef9ae2ff
Nov 04 12:30:35 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:35 devstack sudo[107892]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2ffffcac-45a0-4e36-b4fc-81c55cd525d2 tempest-ProjectReaderTests-745542355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508" returned: 0 in 0.386s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2ffffcac-45a0-4e36-b4fc-81c55cd525d2 tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508.906f5d3b-15b2-42cf-9843-68f8bfd02abb 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:35 devstack sudo[107900]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508.906f5d3b-15b2-42cf-9843-68f8bfd02abb 1G
Nov 04 12:30:35 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:35 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-61865406-9900-47dc-bc59-dbcd498265dd tempest-CinderUnicodeTest-271981707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9.adc790e4-e3c2-4ca6-9957-9ddeef9ae2ff" returned: 0 in 0.374s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:35 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-61865406-9900-47dc-bc59-dbcd498265dd tempest-CinderUnicodeTest-271981707 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:30:35 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5cb6df-ac5e-4f14-827c-6f40cb4814ee]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-61865406-9900-47dc-bc59-dbcd498265dd tempest-CinderUnicodeTest-271981707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:35 devstack sudo[107905]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9
Nov 04 12:30:35 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:36 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2ffffcac-45a0-4e36-b4fc-81c55cd525d2 tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508.906f5d3b-15b2-42cf-9843-68f8bfd02abb 1G" returned: 0 in 0.404s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2ffffcac-45a0-4e36-b4fc-81c55cd525d2 tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508.906f5d3b-15b2-42cf-9843-68f8bfd02abb {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:36 devstack sudo[107910]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508.906f5d3b-15b2-42cf-9843-68f8bfd02abb
Nov 04 12:30:36 devstack sudo[107910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:36 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-61865406-9900-47dc-bc59-dbcd498265dd tempest-CinderUnicodeTest-271981707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9" returned: 0 in 0.370s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-61865406-9900-47dc-bc59-dbcd498265dd tempest-CinderUnicodeTest-271981707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9.adc790e4-e3c2-4ca6-9957-9ddeef9ae2ff {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:36 devstack sudo[107915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9.adc790e4-e3c2-4ca6-9957-9ddeef9ae2ff
Nov 04 12:30:36 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:36 devstack sudo[107910]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2ffffcac-45a0-4e36-b4fc-81c55cd525d2 tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508.906f5d3b-15b2-42cf-9843-68f8bfd02abb" returned: 0 in 0.305s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:36 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-2ffffcac-45a0-4e36-b4fc-81c55cd525d2 tempest-ProjectReaderTests-745542355 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508.906f5d3b-15b2-42cf-9843-68f8bfd02abb is being set with open permissions: ugo+rw
Nov 04 12:30:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2ffffcac-45a0-4e36-b4fc-81c55cd525d2 tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508.906f5d3b-15b2-42cf-9843-68f8bfd02abb {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:36 devstack sudo[107920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508.906f5d3b-15b2-42cf-9843-68f8bfd02abb
Nov 04 12:30:36 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e07ec35e-1dbf-4375-96f9-2773ccba1ad4 tempest-ProjectMemberTests-782019947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:36 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-61865406-9900-47dc-bc59-dbcd498265dd tempest-CinderUnicodeTest-271981707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9.adc790e4-e3c2-4ca6-9957-9ddeef9ae2ff" returned: 0 in 0.410s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-61865406-9900-47dc-bc59-dbcd498265dd tempest-CinderUnicodeTest-271981707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9.adc790e4-e3c2-4ca6-9957-9ddeef9ae2ff {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:36 devstack sudo[107926]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9.adc790e4-e3c2-4ca6-9957-9ddeef9ae2ff
Nov 04 12:30:36 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:36 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2ffffcac-45a0-4e36-b4fc-81c55cd525d2 tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508.906f5d3b-15b2-42cf-9843-68f8bfd02abb" returned: 0 in 0.316s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2ffffcac-45a0-4e36-b4fc-81c55cd525d2 tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:36 devstack sudo[107928]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508.info
Nov 04 12:30:36 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:36 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-61865406-9900-47dc-bc59-dbcd498265dd tempest-CinderUnicodeTest-271981707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9.adc790e4-e3c2-4ca6-9957-9ddeef9ae2ff" returned: 0 in 0.252s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:36 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-61865406-9900-47dc-bc59-dbcd498265dd tempest-CinderUnicodeTest-271981707 None] Lock "cinder-quobyte-adc790e4-e3c2-4ca6-9957-9ddeef9ae2ff" released by "_delete_snapshot" :: held 1.517s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:36 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-61865406-9900-47dc-bc59-dbcd498265dd tempest-CinderUnicodeTest-271981707 None] Lock "cinder-quobyte-e61974e6-018a-4e5b-b4a7-36df3b2de7c9" released by "delete_snapshot" :: held 1.542s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:36 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2ffffcac-45a0-4e36-b4fc-81c55cd525d2 tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508.info" returned: 0 in 0.266s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:36 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-2ffffcac-45a0-4e36-b4fc-81c55cd525d2 tempest-ProjectReaderTests-745542355 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508.info is being set with open permissions: ugo+rw
Nov 04 12:30:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2ffffcac-45a0-4e36-b4fc-81c55cd525d2 tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:36 devstack sudo[107932]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508.info
Nov 04 12:30:36 devstack sudo[107932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:36 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-61865406-9900-47dc-bc59-dbcd498265dd tempest-CinderUnicodeTest-271981707 None] Created reservations ['5a665c2c-6c61-466e-8160-b28b3b481599', 'c80f9744-0186-4a5a-a1a8-9f37e759a059', '22af44c7-aa44-4c68-b8d7-06d1f2be2d5a', '519cf0a6-d148-49e2-8c58-22c587f75d92'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:30:37 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-61865406-9900-47dc-bc59-dbcd498265dd tempest-CinderUnicodeTest-271981707 None] Delete snapshot completed successfully.
Nov 04 12:30:37 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-61865406-9900-47dc-bc59-dbcd498265dd tempest-CinderUnicodeTest-271981707 None] Lock "cinder-adc790e4-e3c2-4ca6-9957-9ddeef9ae2ff-delete_snapshot" released by "delete_snapshot" :: held 1.694s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:37 devstack sudo[107932]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2ffffcac-45a0-4e36-b4fc-81c55cd525d2 tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508.info" returned: 0 in 0.251s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2ffffcac-45a0-4e36-b4fc-81c55cd525d2 tempest-ProjectReaderTests-745542355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.033s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b1a5112e-bbe0-41ce-b7d6-89de9078c546 tempest-ProjectReaderTests-1710404759 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.515s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:37 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-b1a5112e-bbe0-41ce-b7d6-89de9078c546 tempest-ProjectReaderTests-1710404759 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:30:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-223417221',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=553ab5b4-54d3-4006-af07-07f58983c5d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acea6ec1649b4cebaad9ac5925dcf8e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:35Z,use_quota=True,user_id='32c122b3b1f2421aab388e2afee84c8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:30:37 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-b1a5112e-bbe0-41ce-b7d6-89de9078c546 tempest-ProjectReaderTests-1710404759 None] Creating volume 553ab5b4-54d3-4006-af07-07f58983c5d2 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:30:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b1a5112e-bbe0-41ce-b7d6-89de9078c546 tempest-ProjectReaderTests-1710404759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b1a5112e-bbe0-41ce-b7d6-89de9078c546 tempest-ProjectReaderTests-1710404759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:37 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-b1a5112e-bbe0-41ce-b7d6-89de9078c546 tempest-ProjectReaderTests-1710404759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:30:37 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-b1a5112e-bbe0-41ce-b7d6-89de9078c546 tempest-ProjectReaderTests-1710404759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:30:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b1a5112e-bbe0-41ce-b7d6-89de9078c546 tempest-ProjectReaderTests-1710404759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:37 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-b1a5112e-bbe0-41ce-b7d6-89de9078c546 tempest-ProjectReaderTests-1710404759 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:30:37 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-b1a5112e-bbe0-41ce-b7d6-89de9078c546 tempest-ProjectReaderTests-1710404759 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:30:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b1a5112e-bbe0-41ce-b7d6-89de9078c546 tempest-ProjectReaderTests-1710404759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553ab5b4-54d3-4006-af07-07f58983c5d2 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:37 devstack sudo[107935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553ab5b4-54d3-4006-af07-07f58983c5d2 1073741824
Nov 04 12:30:37 devstack sudo[107935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:37 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-2ffffcac-45a0-4e36-b4fc-81c55cd525d2 tempest-ProjectReaderTests-745542355 None] Create snapshot completed successfully
Nov 04 12:30:37 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-118c7ab4-d76f-425e-9610-6f02da84e048 tempest-CinderUnicodeTest-271981707 None] Acquiring lock "cinder-e61974e6-018a-4e5b-b4a7-36df3b2de7c9-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:37 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-118c7ab4-d76f-425e-9610-6f02da84e048 tempest-CinderUnicodeTest-271981707 None] Lock "cinder-e61974e6-018a-4e5b-b4a7-36df3b2de7c9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:37 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-118c7ab4-d76f-425e-9610-6f02da84e048 tempest-CinderUnicodeTest-271981707 None] Acquiring lock "cinder-quobyte-e61974e6-018a-4e5b-b4a7-36df3b2de7c9" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:37 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-118c7ab4-d76f-425e-9610-6f02da84e048 tempest-CinderUnicodeTest-271981707 None] Lock "cinder-quobyte-e61974e6-018a-4e5b-b4a7-36df3b2de7c9" acquired by "delete_volume" :: waited 0.016s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:37 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6170568-dbcb-49bd-8075-053017336c81]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-118c7ab4-d76f-425e-9610-6f02da84e048 tempest-CinderUnicodeTest-271981707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:37 devstack sudo[107935]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b1a5112e-bbe0-41ce-b7d6-89de9078c546 tempest-ProjectReaderTests-1710404759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553ab5b4-54d3-4006-af07-07f58983c5d2 1073741824" returned: 0 in 0.467s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:37 devstack sudo[107941]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9
Nov 04 12:30:37 devstack sudo[107941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b1a5112e-bbe0-41ce-b7d6-89de9078c546 tempest-ProjectReaderTests-1710404759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553ab5b4-54d3-4006-af07-07f58983c5d2 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:37 devstack sudo[107943]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553ab5b4-54d3-4006-af07-07f58983c5d2
Nov 04 12:30:37 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:38 devstack sudo[107941]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-118c7ab4-d76f-425e-9610-6f02da84e048 tempest-CinderUnicodeTest-271981707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9" returned: 0 in 0.394s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-118c7ab4-d76f-425e-9610-6f02da84e048 tempest-CinderUnicodeTest-271981707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:38 devstack sudo[107948]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9
Nov 04 12:30:38 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:38 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b1a5112e-bbe0-41ce-b7d6-89de9078c546 tempest-ProjectReaderTests-1710404759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553ab5b4-54d3-4006-af07-07f58983c5d2" returned: 0 in 0.270s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-b1a5112e-bbe0-41ce-b7d6-89de9078c546 tempest-ProjectReaderTests-1710404759 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b1a5112e-bbe0-41ce-b7d6-89de9078c546 tempest-ProjectReaderTests-1710404759 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e07ec35e-1dbf-4375-96f9-2773ccba1ad4 tempest-ProjectMemberTests-782019947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.577s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-e07ec35e-1dbf-4375-96f9-2773ccba1ad4 tempest-ProjectMemberTests-782019947 None] Creating offline snapshot 219466cc-ec20-4e1f-a14e-d7c80e86efc6 of volume fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b1a5112e-bbe0-41ce-b7d6-89de9078c546 tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92a2ed2a-6a3b-4891-8727-5c34b0a845ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-553ab5b4-54d3-4006-af07-07f58983c5d2', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b1a5112e-bbe0-41ce-b7d6-89de9078c546 tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b81e316-9027-43d1-a976-fec37a15dac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-adf8ca82-5a28-4f74-a21c-fe87c1e9070f tempest-ProjectReaderTests-745542355 None] Acquiring lock "cinder-906f5d3b-15b2-42cf-9843-68f8bfd02abb-delete_snapshot" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90a743b-0d57-44e8-a70b-78280c409ea8]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e07ec35e-1dbf-4375-96f9-2773ccba1ad4 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:38 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-b1a5112e-bbe0-41ce-b7d6-89de9078c546 tempest-ProjectReaderTests-1710404759 None] Volume volume-553ab5b4-54d3-4006-af07-07f58983c5d2 (553ab5b4-54d3-4006-af07-07f58983c5d2): created successfully
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b1a5112e-bbe0-41ce-b7d6-89de9078c546 tempest-ProjectReaderTests-1710404759 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b81e316-9027-43d1-a976-fec37a15dac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b1a5112e-bbe0-41ce-b7d6-89de9078c546 tempest-ProjectReaderTests-1710404759 None] Flow 'volume_create_manager' (4c9d2468-422f-4a3d-b545-7a5692890d4a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-adf8ca82-5a28-4f74-a21c-fe87c1e9070f tempest-ProjectReaderTests-745542355 None] Lock "cinder-906f5d3b-15b2-42cf-9843-68f8bfd02abb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.056s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-adf8ca82-5a28-4f74-a21c-fe87c1e9070f tempest-ProjectReaderTests-745542355 None] Acquiring lock "cinder-quobyte-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-adf8ca82-5a28-4f74-a21c-fe87c1e9070f tempest-ProjectReaderTests-745542355 None] Lock "cinder-quobyte-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-adf8ca82-5a28-4f74-a21c-fe87c1e9070f tempest-ProjectReaderTests-745542355 None] Acquiring lock "cinder-quobyte-906f5d3b-15b2-42cf-9843-68f8bfd02abb" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:38 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-b1a5112e-bbe0-41ce-b7d6-89de9078c546 tempest-ProjectReaderTests-1710404759 None] Created volume successfully.
Nov 04 12:30:38 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-adf8ca82-5a28-4f74-a21c-fe87c1e9070f tempest-ProjectReaderTests-745542355 None] Lock "cinder-quobyte-906f5d3b-15b2-42cf-9843-68f8bfd02abb" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-adf8ca82-5a28-4f74-a21c-fe87c1e9070f tempest-ProjectReaderTests-745542355 None] Deleting offline snapshot 906f5d3b-15b2-42cf-9843-68f8bfd02abb of volume f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-adf8ca82-5a28-4f74-a21c-fe87c1e9070f tempest-ProjectReaderTests-745542355 None] snapshot_file for this snap is: volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508.906f5d3b-15b2-42cf-9843-68f8bfd02abb {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-118c7ab4-d76f-425e-9610-6f02da84e048 tempest-CinderUnicodeTest-271981707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-e61974e6-018a-4e5b-b4a7-36df3b2de7c9" returned: 0 in 0.309s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:38 devstack sudo[107951]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f
Nov 04 12:30:38 devstack sudo[107951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[f54537a7-3296-4322-814c-655c7c67d10a]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-adf8ca82-5a28-4f74-a21c-fe87c1e9070f tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508.906f5d3b-15b2-42cf-9843-68f8bfd02abb {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-118c7ab4-d76f-425e-9610-6f02da84e048 tempest-CinderUnicodeTest-271981707 None] Lock "cinder-quobyte-e61974e6-018a-4e5b-b4a7-36df3b2de7c9" released by "delete_volume" :: held 0.787s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-118c7ab4-d76f-425e-9610-6f02da84e048 tempest-CinderUnicodeTest-271981707 None] Created reservations ['8808b623-ff37-4efd-951a-5f103685fdd6', '3eccf6e2-aa16-4357-a2ad-7c727a32d5ff', '6334bb6b-81c3-4742-abb6-b27dbad86a10', '649fd4a8-705c-4da3-af74-2f21c32d1cd1'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:30:38 devstack sudo[107954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508.906f5d3b-15b2-42cf-9843-68f8bfd02abb
Nov 04 12:30:38 devstack sudo[107954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-118c7ab4-d76f-425e-9610-6f02da84e048 tempest-CinderUnicodeTest-271981707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-118c7ab4-d76f-425e-9610-6f02da84e048 tempest-CinderUnicodeTest-271981707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-118c7ab4-d76f-425e-9610-6f02da84e048 tempest-CinderUnicodeTest-271981707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-118c7ab4-d76f-425e-9610-6f02da84e048 tempest-CinderUnicodeTest-271981707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-118c7ab4-d76f-425e-9610-6f02da84e048 tempest-CinderUnicodeTest-271981707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-118c7ab4-d76f-425e-9610-6f02da84e048 tempest-CinderUnicodeTest-271981707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:38 devstack sudo[107956]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:30:38 devstack sudo[107956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:38 devstack sudo[107951]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e07ec35e-1dbf-4375-96f9-2773ccba1ad4 tempest-ProjectMemberTests-782019947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f" returned: 0 in 0.457s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e07ec35e-1dbf-4375-96f9-2773ccba1ad4 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f.219466cc-ec20-4e1f-a14e-d7c80e86efc6 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-2739b383-e3ad-4f78-8530-d2de22637b7e tempest-CinderUnicodeTest-271981707 None] Acquiring lock "cinder-fe6ae517-678d-4440-9b4d-682af2ba468b-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:38 devstack sudo[107962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f.219466cc-ec20-4e1f-a14e-d7c80e86efc6 1G
Nov 04 12:30:38 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-2739b383-e3ad-4f78-8530-d2de22637b7e tempest-CinderUnicodeTest-271981707 None] Lock "cinder-fe6ae517-678d-4440-9b4d-682af2ba468b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-2739b383-e3ad-4f78-8530-d2de22637b7e tempest-CinderUnicodeTest-271981707 None] Acquiring lock "cinder-quobyte-fe6ae517-678d-4440-9b4d-682af2ba468b" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-2739b383-e3ad-4f78-8530-d2de22637b7e tempest-CinderUnicodeTest-271981707 None] Lock "cinder-quobyte-fe6ae517-678d-4440-9b4d-682af2ba468b" acquired by "delete_volume" :: waited 0.019s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:38 devstack sudo[107954]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-adf8ca82-5a28-4f74-a21c-fe87c1e9070f tempest-ProjectReaderTests-745542355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508.906f5d3b-15b2-42cf-9843-68f8bfd02abb" returned: 0 in 0.495s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-adf8ca82-5a28-4f74-a21c-fe87c1e9070f tempest-ProjectReaderTests-745542355 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd5e993-887b-4770-a17f-514bc7b17b1d]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2739b383-e3ad-4f78-8530-d2de22637b7e tempest-CinderUnicodeTest-271981707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fe6ae517-678d-4440-9b4d-682af2ba468b {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:38 devstack sudo[107956]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddcc396-63aa-4f7d-8126-81f728737e5f]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-adf8ca82-5a28-4f74-a21c-fe87c1e9070f tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-118c7ab4-d76f-425e-9610-6f02da84e048 tempest-CinderUnicodeTest-271981707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.409s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-118c7ab4-d76f-425e-9610-6f02da84e048 tempest-CinderUnicodeTest-271981707 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:30:38 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-118c7ab4-d76f-425e-9610-6f02da84e048 tempest-CinderUnicodeTest-271981707 None] Deleted volume successfully.
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-118c7ab4-d76f-425e-9610-6f02da84e048 tempest-CinderUnicodeTest-271981707 None] Lock "cinder-e61974e6-018a-4e5b-b4a7-36df3b2de7c9-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c4b11acc-49cd-43e4-b24c-9a72ad8990f5 tempest-ProjectReaderTests-1710404759 None] Acquiring lock "cinder-553ab5b4-54d3-4006-af07-07f58983c5d2-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:38 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c4b11acc-49cd-43e4-b24c-9a72ad8990f5 tempest-ProjectReaderTests-1710404759 None] Lock "cinder-553ab5b4-54d3-4006-af07-07f58983c5d2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:39 devstack sudo[107967]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fe6ae517-678d-4440-9b4d-682af2ba468b
Nov 04 12:30:39 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:39 devstack sudo[107968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508
Nov 04 12:30:39 devstack sudo[107968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:39 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c4b11acc-49cd-43e4-b24c-9a72ad8990f5 tempest-ProjectReaderTests-1710404759 None] Acquiring lock "cinder-quobyte-553ab5b4-54d3-4006-af07-07f58983c5d2" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:39 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c4b11acc-49cd-43e4-b24c-9a72ad8990f5 tempest-ProjectReaderTests-1710404759 None] Lock "cinder-quobyte-553ab5b4-54d3-4006-af07-07f58983c5d2" acquired by "delete_volume" :: waited 0.041s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:39 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1874ee-8810-466b-a879-5d43d3935e3c]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c4b11acc-49cd-43e4-b24c-9a72ad8990f5 tempest-ProjectReaderTests-1710404759 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553ab5b4-54d3-4006-af07-07f58983c5d2 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:39 devstack sudo[107988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553ab5b4-54d3-4006-af07-07f58983c5d2
Nov 04 12:30:39 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:39 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e07ec35e-1dbf-4375-96f9-2773ccba1ad4 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f.219466cc-ec20-4e1f-a14e-d7c80e86efc6 1G" returned: 0 in 0.686s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e07ec35e-1dbf-4375-96f9-2773ccba1ad4 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f.219466cc-ec20-4e1f-a14e-d7c80e86efc6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:39 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:39 devstack sudo[108015]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f.219466cc-ec20-4e1f-a14e-d7c80e86efc6
Nov 04 12:30:39 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2739b383-e3ad-4f78-8530-d2de22637b7e tempest-CinderUnicodeTest-271981707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fe6ae517-678d-4440-9b4d-682af2ba468b" returned: 0 in 0.523s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2739b383-e3ad-4f78-8530-d2de22637b7e tempest-CinderUnicodeTest-271981707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fe6ae517-678d-4440-9b4d-682af2ba468b {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:39 devstack sudo[108018]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fe6ae517-678d-4440-9b4d-682af2ba468b
Nov 04 12:30:39 devstack sudo[107968]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:39 devstack sudo[108018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-adf8ca82-5a28-4f74-a21c-fe87c1e9070f tempest-ProjectReaderTests-745542355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508" returned: 0 in 0.551s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-adf8ca82-5a28-4f74-a21c-fe87c1e9070f tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508.906f5d3b-15b2-42cf-9843-68f8bfd02abb {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:39 devstack sudo[108020]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508.906f5d3b-15b2-42cf-9843-68f8bfd02abb
Nov 04 12:30:39 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:39 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c4b11acc-49cd-43e4-b24c-9a72ad8990f5 tempest-ProjectReaderTests-1710404759 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553ab5b4-54d3-4006-af07-07f58983c5d2" returned: 0 in 0.543s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c4b11acc-49cd-43e4-b24c-9a72ad8990f5 tempest-ProjectReaderTests-1710404759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553ab5b4-54d3-4006-af07-07f58983c5d2 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:39 devstack sudo[108031]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553ab5b4-54d3-4006-af07-07f58983c5d2
Nov 04 12:30:39 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:39 devstack sudo[108018]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2739b383-e3ad-4f78-8530-d2de22637b7e tempest-CinderUnicodeTest-271981707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fe6ae517-678d-4440-9b4d-682af2ba468b" returned: 0 in 0.320s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:39 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-2739b383-e3ad-4f78-8530-d2de22637b7e tempest-CinderUnicodeTest-271981707 None] Lock "cinder-quobyte-fe6ae517-678d-4440-9b4d-682af2ba468b" released by "delete_volume" :: held 0.929s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:39 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e07ec35e-1dbf-4375-96f9-2773ccba1ad4 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f.219466cc-ec20-4e1f-a14e-d7c80e86efc6" returned: 0 in 0.418s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:39 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-e07ec35e-1dbf-4375-96f9-2773ccba1ad4 tempest-ProjectMemberTests-782019947 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f.219466cc-ec20-4e1f-a14e-d7c80e86efc6 is being set with open permissions: ugo+rw
Nov 04 12:30:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e07ec35e-1dbf-4375-96f9-2773ccba1ad4 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f.219466cc-ec20-4e1f-a14e-d7c80e86efc6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:39 devstack sudo[108038]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f.219466cc-ec20-4e1f-a14e-d7c80e86efc6
Nov 04 12:30:39 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:39 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-2739b383-e3ad-4f78-8530-d2de22637b7e tempest-CinderUnicodeTest-271981707 None] Created reservations ['9467cda8-9d78-40ff-b29d-ab130ada9f1f', '5a18b683-9613-4553-8c96-cae4bd9c609e', '5c59dece-8be6-4a52-ad6a-df987283c96a', '089cef7a-d3af-4024-9458-3d96d1b5a1c7'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:30:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2739b383-e3ad-4f78-8530-d2de22637b7e tempest-CinderUnicodeTest-271981707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2739b383-e3ad-4f78-8530-d2de22637b7e tempest-CinderUnicodeTest-271981707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:39 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-2739b383-e3ad-4f78-8530-d2de22637b7e tempest-CinderUnicodeTest-271981707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:30:39 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-2739b383-e3ad-4f78-8530-d2de22637b7e tempest-CinderUnicodeTest-271981707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:30:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2739b383-e3ad-4f78-8530-d2de22637b7e tempest-CinderUnicodeTest-271981707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2739b383-e3ad-4f78-8530-d2de22637b7e tempest-CinderUnicodeTest-271981707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:39 devstack sudo[108041]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:30:39 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:39 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-adf8ca82-5a28-4f74-a21c-fe87c1e9070f tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508.906f5d3b-15b2-42cf-9843-68f8bfd02abb" returned: 0 in 0.533s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-adf8ca82-5a28-4f74-a21c-fe87c1e9070f tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508.906f5d3b-15b2-42cf-9843-68f8bfd02abb {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:40 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c4b11acc-49cd-43e4-b24c-9a72ad8990f5 tempest-ProjectReaderTests-1710404759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-553ab5b4-54d3-4006-af07-07f58983c5d2" returned: 0 in 0.335s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:40 devstack sudo[108044]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508.906f5d3b-15b2-42cf-9843-68f8bfd02abb
Nov 04 12:30:40 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:40 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c4b11acc-49cd-43e4-b24c-9a72ad8990f5 tempest-ProjectReaderTests-1710404759 None] Lock "cinder-quobyte-553ab5b4-54d3-4006-af07-07f58983c5d2" released by "delete_volume" :: held 0.939s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:40 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-c4b11acc-49cd-43e4-b24c-9a72ad8990f5 tempest-ProjectReaderTests-1710404759 None] Created reservations ['ec266414-202f-4eb8-acc7-d5e513f62c08', '7119b44b-26de-4284-b453-8a8d7b688609', 'b8864904-0e0d-43a8-9f9d-2429021eb081', '16ae9a77-14ed-4b2d-b7bb-32777436115b'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:30:40 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e07ec35e-1dbf-4375-96f9-2773ccba1ad4 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f.219466cc-ec20-4e1f-a14e-d7c80e86efc6" returned: 0 in 0.367s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e07ec35e-1dbf-4375-96f9-2773ccba1ad4 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c4b11acc-49cd-43e4-b24c-9a72ad8990f5 tempest-ProjectReaderTests-1710404759 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c4b11acc-49cd-43e4-b24c-9a72ad8990f5 tempest-ProjectReaderTests-1710404759 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:40 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c4b11acc-49cd-43e4-b24c-9a72ad8990f5 tempest-ProjectReaderTests-1710404759 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:30:40 devstack sudo[108048]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f.info
Nov 04 12:30:40 devstack sudo[108048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:40 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-c4b11acc-49cd-43e4-b24c-9a72ad8990f5 tempest-ProjectReaderTests-1710404759 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:30:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-c4b11acc-49cd-43e4-b24c-9a72ad8990f5 tempest-ProjectReaderTests-1710404759 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c4b11acc-49cd-43e4-b24c-9a72ad8990f5 tempest-ProjectReaderTests-1710404759 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:40 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2739b383-e3ad-4f78-8530-d2de22637b7e tempest-CinderUnicodeTest-271981707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.309s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:40 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-2739b383-e3ad-4f78-8530-d2de22637b7e tempest-CinderUnicodeTest-271981707 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:30:40 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-2739b383-e3ad-4f78-8530-d2de22637b7e tempest-CinderUnicodeTest-271981707 None] Deleted volume successfully.
Nov 04 12:30:40 devstack sudo[108050]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:30:40 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:40 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-2739b383-e3ad-4f78-8530-d2de22637b7e tempest-CinderUnicodeTest-271981707 None] Lock "cinder-fe6ae517-678d-4440-9b4d-682af2ba468b-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:40 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-adf8ca82-5a28-4f74-a21c-fe87c1e9070f tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508.906f5d3b-15b2-42cf-9843-68f8bfd02abb" returned: 0 in 0.335s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:40 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-adf8ca82-5a28-4f74-a21c-fe87c1e9070f tempest-ProjectReaderTests-745542355 None] Lock "cinder-quobyte-906f5d3b-15b2-42cf-9843-68f8bfd02abb" released by "_delete_snapshot" :: held 2.041s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:40 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-adf8ca82-5a28-4f74-a21c-fe87c1e9070f tempest-ProjectReaderTests-745542355 None] Lock "cinder-quobyte-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508" released by "delete_snapshot" :: held 2.077s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:40 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-adf8ca82-5a28-4f74-a21c-fe87c1e9070f tempest-ProjectReaderTests-745542355 None] Created reservations ['01c42ede-1b7b-4948-9597-32e5d0582090', 'd78f5f81-cb79-41b8-a9cd-9e0f83be43d8', 'c8ec49fe-ac5d-4682-9474-701e748df8d7', 'c99b840d-2a7b-434c-9af1-4fe1c0669378'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:30:40 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-adf8ca82-5a28-4f74-a21c-fe87c1e9070f tempest-ProjectReaderTests-745542355 None] Delete snapshot completed successfully.
Nov 04 12:30:40 devstack sudo[108048]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e07ec35e-1dbf-4375-96f9-2773ccba1ad4 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f.info" returned: 0 in 0.308s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:40 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-e07ec35e-1dbf-4375-96f9-2773ccba1ad4 tempest-ProjectMemberTests-782019947 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f.info is being set with open permissions: ugo+rw
Nov 04 12:30:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e07ec35e-1dbf-4375-96f9-2773ccba1ad4 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:40 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:40 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-adf8ca82-5a28-4f74-a21c-fe87c1e9070f tempest-ProjectReaderTests-745542355 None] Lock "cinder-906f5d3b-15b2-42cf-9843-68f8bfd02abb-delete_snapshot" released by "delete_snapshot" :: held 2.237s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c4b11acc-49cd-43e4-b24c-9a72ad8990f5 tempest-ProjectReaderTests-1710404759 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.286s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:40 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-c4b11acc-49cd-43e4-b24c-9a72ad8990f5 tempest-ProjectReaderTests-1710404759 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:30:40 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-c4b11acc-49cd-43e4-b24c-9a72ad8990f5 tempest-ProjectReaderTests-1710404759 None] Deleted volume successfully.
Nov 04 12:30:40 devstack sudo[108055]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f.info
Nov 04 12:30:40 devstack sudo[108055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:40 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c4b11acc-49cd-43e4-b24c-9a72ad8990f5 tempest-ProjectReaderTests-1710404759 None] Lock "cinder-553ab5b4-54d3-4006-af07-07f58983c5d2-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:40 devstack sudo[108055]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e07ec35e-1dbf-4375-96f9-2773ccba1ad4 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f.info" returned: 0 in 0.254s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e07ec35e-1dbf-4375-96f9-2773ccba1ad4 tempest-ProjectMemberTests-782019947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.608s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:40 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-e07ec35e-1dbf-4375-96f9-2773ccba1ad4 tempest-ProjectMemberTests-782019947 None] Create snapshot completed successfully
Nov 04 12:30:41 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a4b88019-ef46-4b4b-962b-d7c971cf0c23 tempest-ProjectReaderTests-745542355 None] Acquiring lock "cinder-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:41 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a4b88019-ef46-4b4b-962b-d7c971cf0c23 tempest-ProjectReaderTests-745542355 None] Lock "cinder-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:41 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a4b88019-ef46-4b4b-962b-d7c971cf0c23 tempest-ProjectReaderTests-745542355 None] Acquiring lock "cinder-quobyte-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:41 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a4b88019-ef46-4b4b-962b-d7c971cf0c23 tempest-ProjectReaderTests-745542355 None] Lock "cinder-quobyte-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508" acquired by "delete_volume" :: waited 0.020s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:41 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea413b7f-6ad0-48a6-accd-0ce6b34cd00a]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a4b88019-ef46-4b4b-962b-d7c971cf0c23 tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:41 devstack sudo[108059]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508
Nov 04 12:30:41 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:41 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-56271462-c86b-44b9-b4cf-56c79068cbae tempest-ProjectMemberTests-782019947 None] Acquiring lock "cinder-219466cc-ec20-4e1f-a14e-d7c80e86efc6-delete_snapshot" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:41 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-56271462-c86b-44b9-b4cf-56c79068cbae tempest-ProjectMemberTests-782019947 None] Lock "cinder-219466cc-ec20-4e1f-a14e-d7c80e86efc6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:41 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-56271462-c86b-44b9-b4cf-56c79068cbae tempest-ProjectMemberTests-782019947 None] Acquiring lock "cinder-quobyte-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:41 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-56271462-c86b-44b9-b4cf-56c79068cbae tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:41 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-56271462-c86b-44b9-b4cf-56c79068cbae tempest-ProjectMemberTests-782019947 None] Acquiring lock "cinder-quobyte-219466cc-ec20-4e1f-a14e-d7c80e86efc6" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:41 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-56271462-c86b-44b9-b4cf-56c79068cbae tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-219466cc-ec20-4e1f-a14e-d7c80e86efc6" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:41 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-56271462-c86b-44b9-b4cf-56c79068cbae tempest-ProjectMemberTests-782019947 None] Deleting offline snapshot 219466cc-ec20-4e1f-a14e-d7c80e86efc6 of volume fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:30:42 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-56271462-c86b-44b9-b4cf-56c79068cbae tempest-ProjectMemberTests-782019947 None] snapshot_file for this snap is: volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f.219466cc-ec20-4e1f-a14e-d7c80e86efc6 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:30:42 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb354c60-de43-4dc9-9d75-e851996cd201]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-56271462-c86b-44b9-b4cf-56c79068cbae tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f.219466cc-ec20-4e1f-a14e-d7c80e86efc6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:42 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a4b88019-ef46-4b4b-962b-d7c971cf0c23 tempest-ProjectReaderTests-745542355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508" returned: 0 in 0.511s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a4b88019-ef46-4b4b-962b-d7c971cf0c23 tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:42 devstack sudo[108065]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508
Nov 04 12:30:42 devstack sudo[108065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:42 devstack sudo[108063]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f.219466cc-ec20-4e1f-a14e-d7c80e86efc6
Nov 04 12:30:42 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:42 devstack sudo[108065]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a4b88019-ef46-4b4b-962b-d7c971cf0c23 tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508" returned: 0 in 0.347s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:42 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:42 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a4b88019-ef46-4b4b-962b-d7c971cf0c23 tempest-ProjectReaderTests-745542355 None] Lock "cinder-quobyte-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508" released by "delete_volume" :: held 0.944s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-56271462-c86b-44b9-b4cf-56c79068cbae tempest-ProjectMemberTests-782019947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f.219466cc-ec20-4e1f-a14e-d7c80e86efc6" returned: 0 in 0.484s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:42 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-56271462-c86b-44b9-b4cf-56c79068cbae tempest-ProjectMemberTests-782019947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:30:42 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2551f0-052e-4bc4-9717-20184dbb3157]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-56271462-c86b-44b9-b4cf-56c79068cbae tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:42 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-a4b88019-ef46-4b4b-962b-d7c971cf0c23 tempest-ProjectReaderTests-745542355 None] Created reservations ['f17c2e6d-b285-483e-96e6-72941dd06310', 'd51de33d-29d6-4615-babc-d87983b0f8aa', 'f44a179e-876d-4c50-b848-6013154ef945', '5cbccca3-126a-42e5-aaa6-695f34d31e94'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:30:42 devstack sudo[108072]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f
Nov 04 12:30:42 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a4b88019-ef46-4b4b-962b-d7c971cf0c23 tempest-ProjectReaderTests-745542355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a4b88019-ef46-4b4b-962b-d7c971cf0c23 tempest-ProjectReaderTests-745542355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:42 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a4b88019-ef46-4b4b-962b-d7c971cf0c23 tempest-ProjectReaderTests-745542355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:30:42 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a4b88019-ef46-4b4b-962b-d7c971cf0c23 tempest-ProjectReaderTests-745542355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:30:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a4b88019-ef46-4b4b-962b-d7c971cf0c23 tempest-ProjectReaderTests-745542355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a4b88019-ef46-4b4b-962b-d7c971cf0c23 tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:42 devstack sudo[108074]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:30:42 devstack sudo[108074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:43 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-56271462-c86b-44b9-b4cf-56c79068cbae tempest-ProjectMemberTests-782019947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f" returned: 0 in 0.477s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-56271462-c86b-44b9-b4cf-56c79068cbae tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f.219466cc-ec20-4e1f-a14e-d7c80e86efc6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:43 devstack sudo[108074]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a4b88019-ef46-4b4b-962b-d7c971cf0c23 tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.301s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:43 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-a4b88019-ef46-4b4b-962b-d7c971cf0c23 tempest-ProjectReaderTests-745542355 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:30:43 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-a4b88019-ef46-4b4b-962b-d7c971cf0c23 tempest-ProjectReaderTests-745542355 None] Deleted volume successfully.
Nov 04 12:30:43 devstack sudo[108081]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f.219466cc-ec20-4e1f-a14e-d7c80e86efc6
Nov 04 12:30:43 devstack sudo[108081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:43 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a4b88019-ef46-4b4b-962b-d7c971cf0c23 tempest-ProjectReaderTests-745542355 None] Lock "cinder-f18eb8c0-2c5a-4e0c-a9b5-59cc9d6da508-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:43 devstack sudo[108081]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-56271462-c86b-44b9-b4cf-56c79068cbae tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f.219466cc-ec20-4e1f-a14e-d7c80e86efc6" returned: 0 in 0.423s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-56271462-c86b-44b9-b4cf-56c79068cbae tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f.219466cc-ec20-4e1f-a14e-d7c80e86efc6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:43 devstack sudo[108086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f.219466cc-ec20-4e1f-a14e-d7c80e86efc6
Nov 04 12:30:43 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:43 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-56271462-c86b-44b9-b4cf-56c79068cbae tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f.219466cc-ec20-4e1f-a14e-d7c80e86efc6" returned: 0 in 0.276s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:43 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-56271462-c86b-44b9-b4cf-56c79068cbae tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-219466cc-ec20-4e1f-a14e-d7c80e86efc6" released by "_delete_snapshot" :: held 1.847s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:43 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-56271462-c86b-44b9-b4cf-56c79068cbae tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f" released by "delete_snapshot" :: held 1.879s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:43 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-56271462-c86b-44b9-b4cf-56c79068cbae tempest-ProjectMemberTests-782019947 None] Created reservations ['dcf813d2-7542-493a-8c0a-f32101049579', 'e1f4c2ef-39a6-4c4f-b830-6375a7fe0cd1', '8f4a22bc-d1b7-4b20-9db1-6434d7f931de', '7780a469-2180-4b3c-ab6b-b88e8ca5dc62'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:30:43 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-56271462-c86b-44b9-b4cf-56c79068cbae tempest-ProjectMemberTests-782019947 None] Delete snapshot completed successfully.
Nov 04 12:30:43 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-56271462-c86b-44b9-b4cf-56c79068cbae tempest-ProjectMemberTests-782019947 None] Lock "cinder-219466cc-ec20-4e1f-a14e-d7c80e86efc6-delete_snapshot" released by "delete_snapshot" :: held 2.059s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:44 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-2f5c6a81-7bcc-4df4-bd60-84afced8e1d0 tempest-ProjectMemberTests-782019947 None] Acquiring lock "cinder-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:44 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-2f5c6a81-7bcc-4df4-bd60-84afced8e1d0 tempest-ProjectMemberTests-782019947 None] Lock "cinder-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:44 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-2f5c6a81-7bcc-4df4-bd60-84afced8e1d0 tempest-ProjectMemberTests-782019947 None] Acquiring lock "cinder-quobyte-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:44 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-2f5c6a81-7bcc-4df4-bd60-84afced8e1d0 tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f" acquired by "delete_volume" :: waited 0.024s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:44 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-5050a800-f5b1-4da6-a1da-0d699e4cac61 tempest-ProjectReaderTests-745542355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:30:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5050a800-f5b1-4da6-a1da-0d699e4cac61 tempest-ProjectReaderTests-745542355 None] Flow 'volume_create_manager' (37dc10d5-9c8c-438c-bfbd-4f90fc23f286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:30:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5050a800-f5b1-4da6-a1da-0d699e4cac61 tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cb81e25-b206-4d51-8573-7981ec46ffb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:44 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[26041134-6d5a-41e0-9ef6-bf7110db0a62]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2f5c6a81-7bcc-4df4-bd60-84afced8e1d0 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5050a800-f5b1-4da6-a1da-0d699e4cac61 tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cb81e25-b206-4d51-8573-7981ec46ffb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-517315992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16cdaeeb-4285-42d7-aae7-1e395013a96e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='324f832ed91d41c5891b98855382e88b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:44Z,use_quota=True,user_id='c72534133ab0445ca0b45d95d7c20347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5050a800-f5b1-4da6-a1da-0d699e4cac61 tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e32e0ae-68e9-4223-9300-aed9d738a4d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5050a800-f5b1-4da6-a1da-0d699e4cac61 tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e32e0ae-68e9-4223-9300-aed9d738a4d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5050a800-f5b1-4da6-a1da-0d699e4cac61 tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7a64da3-a05c-4930-a424-ff6a78667c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5050a800-f5b1-4da6-a1da-0d699e4cac61 tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7a64da3-a05c-4930-a424-ff6a78667c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16cdaeeb-4285-42d7-aae7-1e395013a96e', 'volume_name': 'volume-16cdaeeb-4285-42d7-aae7-1e395013a96e', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5050a800-f5b1-4da6-a1da-0d699e4cac61 tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e156cc9-da70-4adc-bbae-89e6b4fb70bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5050a800-f5b1-4da6-a1da-0d699e4cac61 tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e156cc9-da70-4adc-bbae-89e6b4fb70bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:44 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5050a800-f5b1-4da6-a1da-0d699e4cac61 tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fa5ce5c-526e-42fa-af39-5d99e49f51e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:44 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-5050a800-f5b1-4da6-a1da-0d699e4cac61 tempest-ProjectReaderTests-745542355 None] Volume 16cdaeeb-4285-42d7-aae7-1e395013a96e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16cdaeeb-4285-42d7-aae7-1e395013a96e', 'volume_size': 1}
Nov 04 12:30:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5050a800-f5b1-4da6-a1da-0d699e4cac61 tempest-ProjectReaderTests-745542355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5050a800-f5b1-4da6-a1da-0d699e4cac61 tempest-ProjectReaderTests-745542355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:44 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5050a800-f5b1-4da6-a1da-0d699e4cac61 tempest-ProjectReaderTests-745542355 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-517315992',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16cdaeeb-4285-42d7-aae7-1e395013a96e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='324f832ed91d41c5891b98855382e88b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:44Z,use_quota=True,user_id='c72534133ab0445ca0b45d95d7c20347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:30:44 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-5050a800-f5b1-4da6-a1da-0d699e4cac61 tempest-ProjectReaderTests-745542355 None] Creating volume 16cdaeeb-4285-42d7-aae7-1e395013a96e {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:30:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5050a800-f5b1-4da6-a1da-0d699e4cac61 tempest-ProjectReaderTests-745542355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5050a800-f5b1-4da6-a1da-0d699e4cac61 tempest-ProjectReaderTests-745542355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:44 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5050a800-f5b1-4da6-a1da-0d699e4cac61 tempest-ProjectReaderTests-745542355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:30:44 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5050a800-f5b1-4da6-a1da-0d699e4cac61 tempest-ProjectReaderTests-745542355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:30:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5050a800-f5b1-4da6-a1da-0d699e4cac61 tempest-ProjectReaderTests-745542355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:44 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5050a800-f5b1-4da6-a1da-0d699e4cac61 tempest-ProjectReaderTests-745542355 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:30:44 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-5050a800-f5b1-4da6-a1da-0d699e4cac61 tempest-ProjectReaderTests-745542355 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:30:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5050a800-f5b1-4da6-a1da-0d699e4cac61 tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:44 devstack sudo[108090]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e 1073741824
Nov 04 12:30:44 devstack sudo[108090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:44 devstack sudo[108089]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f
Nov 04 12:30:44 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:44 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2f5c6a81-7bcc-4df4-bd60-84afced8e1d0 tempest-ProjectMemberTests-782019947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f" returned: 0 in 0.368s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2f5c6a81-7bcc-4df4-bd60-84afced8e1d0 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:44 devstack sudo[108099]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f
Nov 04 12:30:44 devstack sudo[108099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:44 devstack sudo[108090]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5050a800-f5b1-4da6-a1da-0d699e4cac61 tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e 1073741824" returned: 0 in 0.458s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5050a800-f5b1-4da6-a1da-0d699e4cac61 tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:44 devstack sudo[108101]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e
Nov 04 12:30:44 devstack sudo[108101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:44 devstack sudo[108099]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2f5c6a81-7bcc-4df4-bd60-84afced8e1d0 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f" returned: 0 in 0.275s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:44 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-2f5c6a81-7bcc-4df4-bd60-84afced8e1d0 tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f" released by "delete_volume" :: held 0.731s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:45 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-2f5c6a81-7bcc-4df4-bd60-84afced8e1d0 tempest-ProjectMemberTests-782019947 None] Created reservations ['5c4d2674-b689-4876-86d6-f3fee8c84d39', '7cf523b5-75d9-471b-a3ba-6b3ea1e627c3', '862fb8c3-2035-41ee-897a-dd43aadefd04', 'cbb3df18-3e17-4bff-9ad1-d43d275a5104'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:30:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2f5c6a81-7bcc-4df4-bd60-84afced8e1d0 tempest-ProjectMemberTests-782019947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2f5c6a81-7bcc-4df4-bd60-84afced8e1d0 tempest-ProjectMemberTests-782019947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:45 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-2f5c6a81-7bcc-4df4-bd60-84afced8e1d0 tempest-ProjectMemberTests-782019947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:30:45 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-2f5c6a81-7bcc-4df4-bd60-84afced8e1d0 tempest-ProjectMemberTests-782019947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:30:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-2f5c6a81-7bcc-4df4-bd60-84afced8e1d0 tempest-ProjectMemberTests-782019947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2f5c6a81-7bcc-4df4-bd60-84afced8e1d0 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:45 devstack sudo[108105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:30:45 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:45 devstack sudo[108101]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5050a800-f5b1-4da6-a1da-0d699e4cac61 tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e" returned: 0 in 0.266s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:45 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5050a800-f5b1-4da6-a1da-0d699e4cac61 tempest-ProjectReaderTests-745542355 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:30:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5050a800-f5b1-4da6-a1da-0d699e4cac61 tempest-ProjectReaderTests-745542355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:45 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5050a800-f5b1-4da6-a1da-0d699e4cac61 tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fa5ce5c-526e-42fa-af39-5d99e49f51e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16cdaeeb-4285-42d7-aae7-1e395013a96e', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:45 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5050a800-f5b1-4da6-a1da-0d699e4cac61 tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22077ffa-5f24-4eec-b019-5fddd3abdc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:45 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-5050a800-f5b1-4da6-a1da-0d699e4cac61 tempest-ProjectReaderTests-745542355 None] Volume volume-16cdaeeb-4285-42d7-aae7-1e395013a96e (16cdaeeb-4285-42d7-aae7-1e395013a96e): created successfully
Nov 04 12:30:45 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5050a800-f5b1-4da6-a1da-0d699e4cac61 tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22077ffa-5f24-4eec-b019-5fddd3abdc24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:45 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5050a800-f5b1-4da6-a1da-0d699e4cac61 tempest-ProjectReaderTests-745542355 None] Flow 'volume_create_manager' (37dc10d5-9c8c-438c-bfbd-4f90fc23f286) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:30:45 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-5050a800-f5b1-4da6-a1da-0d699e4cac61 tempest-ProjectReaderTests-745542355 None] Created volume successfully.
Nov 04 12:30:45 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-2f5c6a81-7bcc-4df4-bd60-84afced8e1d0 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.269s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:45 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-2f5c6a81-7bcc-4df4-bd60-84afced8e1d0 tempest-ProjectMemberTests-782019947 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:30:45 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-2f5c6a81-7bcc-4df4-bd60-84afced8e1d0 tempest-ProjectMemberTests-782019947 None] Deleted volume successfully.
Nov 04 12:30:45 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-2f5c6a81-7bcc-4df4-bd60-84afced8e1d0 tempest-ProjectMemberTests-782019947 None] Lock "cinder-fc092a4b-d7f9-4a4f-9a80-64734a5ecf6f-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:45 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e1be3af-9afc-436e-b8a4-e20806b9f19d tempest-ProjectMemberTests-782019947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:30:45 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1e1be3af-9afc-436e-b8a4-e20806b9f19d tempest-ProjectMemberTests-782019947 None] Flow 'volume_create_manager' (44636639-e6cb-4113-8ff8-1604ed24b84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:30:45 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1e1be3af-9afc-436e-b8a4-e20806b9f19d tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07b031e1-c791-424f-934c-8a7feb99071a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:45 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1e1be3af-9afc-436e-b8a4-e20806b9f19d tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07b031e1-c791-424f-934c-8a7feb99071a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-368548916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21b05c11-1c10-42c1-9c54-c46d7ddbc5e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5a80a035d04be496795229f2e16378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:46Z,use_quota=True,user_id='4f258b2e50a741e4b75bd5ecf8d3039a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:45 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1e1be3af-9afc-436e-b8a4-e20806b9f19d tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (762b07ff-cf0d-43ab-bdc4-cce2f9de3dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:45 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1e1be3af-9afc-436e-b8a4-e20806b9f19d tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (762b07ff-cf0d-43ab-bdc4-cce2f9de3dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:45 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1e1be3af-9afc-436e-b8a4-e20806b9f19d tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (507e310b-7a19-4a3c-9a36-5ba9664f4f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:45 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1e1be3af-9afc-436e-b8a4-e20806b9f19d tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (507e310b-7a19-4a3c-9a36-5ba9664f4f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21b05c11-1c10-42c1-9c54-c46d7ddbc5e6', 'volume_name': 'volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:45 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1e1be3af-9afc-436e-b8a4-e20806b9f19d tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22f404fc-248d-44a4-a833-0d2b1fcff742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:45 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1e1be3af-9afc-436e-b8a4-e20806b9f19d tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22f404fc-248d-44a4-a833-0d2b1fcff742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:45 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1e1be3af-9afc-436e-b8a4-e20806b9f19d tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f47fd509-efd9-4b92-b576-c23c9e75dd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:45 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-1e1be3af-9afc-436e-b8a4-e20806b9f19d tempest-ProjectMemberTests-782019947 None] Volume 21b05c11-1c10-42c1-9c54-c46d7ddbc5e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6', 'volume_size': 1}
Nov 04 12:30:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1e1be3af-9afc-436e-b8a4-e20806b9f19d tempest-ProjectMemberTests-782019947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1e1be3af-9afc-436e-b8a4-e20806b9f19d tempest-ProjectMemberTests-782019947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:45 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1e1be3af-9afc-436e-b8a4-e20806b9f19d tempest-ProjectMemberTests-782019947 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:30:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-368548916',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21b05c11-1c10-42c1-9c54-c46d7ddbc5e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5a80a035d04be496795229f2e16378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:46Z,use_quota=True,user_id='4f258b2e50a741e4b75bd5ecf8d3039a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:30:45 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-1e1be3af-9afc-436e-b8a4-e20806b9f19d tempest-ProjectMemberTests-782019947 None] Creating volume 21b05c11-1c10-42c1-9c54-c46d7ddbc5e6 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:30:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1e1be3af-9afc-436e-b8a4-e20806b9f19d tempest-ProjectMemberTests-782019947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1e1be3af-9afc-436e-b8a4-e20806b9f19d tempest-ProjectMemberTests-782019947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:45 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1e1be3af-9afc-436e-b8a4-e20806b9f19d tempest-ProjectMemberTests-782019947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:30:45 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1e1be3af-9afc-436e-b8a4-e20806b9f19d tempest-ProjectMemberTests-782019947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:30:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1e1be3af-9afc-436e-b8a4-e20806b9f19d tempest-ProjectMemberTests-782019947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:45 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1e1be3af-9afc-436e-b8a4-e20806b9f19d tempest-ProjectMemberTests-782019947 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:30:45 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-1e1be3af-9afc-436e-b8a4-e20806b9f19d tempest-ProjectMemberTests-782019947 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:30:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1e1be3af-9afc-436e-b8a4-e20806b9f19d tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:45 devstack sudo[108108]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6 1073741824
Nov 04 12:30:45 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:46 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1e1be3af-9afc-436e-b8a4-e20806b9f19d tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6 1073741824" returned: 0 in 0.421s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1e1be3af-9afc-436e-b8a4-e20806b9f19d tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:46 devstack sudo[108114]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6
Nov 04 12:30:46 devstack sudo[108114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7e4616ea-d167-488e-bd2d-394ba8f0051a tempest-ProjectReaderTests-745542355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:46 devstack sudo[108114]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1e1be3af-9afc-436e-b8a4-e20806b9f19d tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6" returned: 0 in 0.261s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:46 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1e1be3af-9afc-436e-b8a4-e20806b9f19d tempest-ProjectMemberTests-782019947 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:30:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1e1be3af-9afc-436e-b8a4-e20806b9f19d tempest-ProjectMemberTests-782019947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7e4616ea-d167-488e-bd2d-394ba8f0051a tempest-ProjectReaderTests-745542355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.068s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:46 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1e1be3af-9afc-436e-b8a4-e20806b9f19d tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f47fd509-efd9-4b92-b576-c23c9e75dd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:46 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1e1be3af-9afc-436e-b8a4-e20806b9f19d tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d274e19-6dce-448a-9389-baf3451b58ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:46 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-7e4616ea-d167-488e-bd2d-394ba8f0051a tempest-ProjectReaderTests-745542355 None] Creating offline snapshot 447f3d55-d264-43bd-a7a0-f53d1ddd518d of volume 16cdaeeb-4285-42d7-aae7-1e395013a96e {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:30:46 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-1e1be3af-9afc-436e-b8a4-e20806b9f19d tempest-ProjectMemberTests-782019947 None] Volume volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6 (21b05c11-1c10-42c1-9c54-c46d7ddbc5e6): created successfully
Nov 04 12:30:46 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1e1be3af-9afc-436e-b8a4-e20806b9f19d tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d274e19-6dce-448a-9389-baf3451b58ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:46 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1e1be3af-9afc-436e-b8a4-e20806b9f19d tempest-ProjectMemberTests-782019947 None] Flow 'volume_create_manager' (44636639-e6cb-4113-8ff8-1604ed24b84f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:30:46 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90a9fe2-5f16-4046-8de6-c08f06978041]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7e4616ea-d167-488e-bd2d-394ba8f0051a tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:46 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-1e1be3af-9afc-436e-b8a4-e20806b9f19d tempest-ProjectMemberTests-782019947 None] Created volume successfully.
Nov 04 12:30:46 devstack sudo[108117]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e
Nov 04 12:30:46 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-dfb3331a-7591-472f-8e73-4ec54156d748 tempest-ProjectMemberTests-782019947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:46 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7e4616ea-d167-488e-bd2d-394ba8f0051a tempest-ProjectReaderTests-745542355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e" returned: 0 in 0.370s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:46 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7e4616ea-d167-488e-bd2d-394ba8f0051a tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e.447f3d55-d264-43bd-a7a0-f53d1ddd518d 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:46 devstack sudo[108122]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e.447f3d55-d264-43bd-a7a0-f53d1ddd518d 1G
Nov 04 12:30:46 devstack sudo[108122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:47 devstack sudo[108122]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7e4616ea-d167-488e-bd2d-394ba8f0051a tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e.447f3d55-d264-43bd-a7a0-f53d1ddd518d 1G" returned: 0 in 0.393s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7e4616ea-d167-488e-bd2d-394ba8f0051a tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16cdaeeb-4285-42d7-aae7-1e395013a96e -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e.447f3d55-d264-43bd-a7a0-f53d1ddd518d {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:47 devstack sudo[108127]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16cdaeeb-4285-42d7-aae7-1e395013a96e -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e.447f3d55-d264-43bd-a7a0-f53d1ddd518d
Nov 04 12:30:47 devstack sudo[108127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:47 devstack sudo[108127]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7e4616ea-d167-488e-bd2d-394ba8f0051a tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-16cdaeeb-4285-42d7-aae7-1e395013a96e -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e.447f3d55-d264-43bd-a7a0-f53d1ddd518d" returned: 0 in 0.293s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:47 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-7e4616ea-d167-488e-bd2d-394ba8f0051a tempest-ProjectReaderTests-745542355 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e.447f3d55-d264-43bd-a7a0-f53d1ddd518d is being set with open permissions: ugo+rw
Nov 04 12:30:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7e4616ea-d167-488e-bd2d-394ba8f0051a tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e.447f3d55-d264-43bd-a7a0-f53d1ddd518d {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:47 devstack sudo[108132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e.447f3d55-d264-43bd-a7a0-f53d1ddd518d
Nov 04 12:30:47 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:47 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7e4616ea-d167-488e-bd2d-394ba8f0051a tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e.447f3d55-d264-43bd-a7a0-f53d1ddd518d" returned: 0 in 0.246s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:47 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7e4616ea-d167-488e-bd2d-394ba8f0051a tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:47 devstack sudo[108135]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e.info
Nov 04 12:30:47 devstack sudo[108135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:48 devstack sudo[108135]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7e4616ea-d167-488e-bd2d-394ba8f0051a tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e.info" returned: 0 in 0.256s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:48 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-7e4616ea-d167-488e-bd2d-394ba8f0051a tempest-ProjectReaderTests-745542355 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e.info is being set with open permissions: ugo+rw
Nov 04 12:30:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7e4616ea-d167-488e-bd2d-394ba8f0051a tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:48 devstack sudo[108138]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e.info
Nov 04 12:30:48 devstack sudo[108138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:48 devstack sudo[108138]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7e4616ea-d167-488e-bd2d-394ba8f0051a tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e.info" returned: 0 in 0.237s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7e4616ea-d167-488e-bd2d-394ba8f0051a tempest-ProjectReaderTests-745542355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.913s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-dfb3331a-7591-472f-8e73-4ec54156d748 tempest-ProjectMemberTests-782019947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.543s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:48 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-dfb3331a-7591-472f-8e73-4ec54156d748 tempest-ProjectMemberTests-782019947 None] Creating offline snapshot f8cc3c01-9699-4d36-8507-d1862cfffc86 of volume 21b05c11-1c10-42c1-9c54-c46d7ddbc5e6 {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:30:48 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-7e4616ea-d167-488e-bd2d-394ba8f0051a tempest-ProjectReaderTests-745542355 None] Create snapshot completed successfully
Nov 04 12:30:48 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3624fa-00e5-47d1-ac37-a62f03a9606a]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dfb3331a-7591-472f-8e73-4ec54156d748 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:48 devstack sudo[108141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6
Nov 04 12:30:48 devstack sudo[108141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:48 devstack sudo[108141]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dfb3331a-7591-472f-8e73-4ec54156d748 tempest-ProjectMemberTests-782019947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6" returned: 0 in 0.370s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:48 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dfb3331a-7591-472f-8e73-4ec54156d748 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6.f8cc3c01-9699-4d36-8507-d1862cfffc86 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:48 devstack sudo[108146]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6.f8cc3c01-9699-4d36-8507-d1862cfffc86 1G
Nov 04 12:30:48 devstack sudo[108146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:49 devstack sudo[108146]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dfb3331a-7591-472f-8e73-4ec54156d748 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6.f8cc3c01-9699-4d36-8507-d1862cfffc86 1G" returned: 0 in 0.397s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dfb3331a-7591-472f-8e73-4ec54156d748 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6.f8cc3c01-9699-4d36-8507-d1862cfffc86 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:49 devstack sudo[108151]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6.f8cc3c01-9699-4d36-8507-d1862cfffc86
Nov 04 12:30:49 devstack sudo[108151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:49 devstack sudo[108151]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dfb3331a-7591-472f-8e73-4ec54156d748 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6.f8cc3c01-9699-4d36-8507-d1862cfffc86" returned: 0 in 0.304s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:49 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-dfb3331a-7591-472f-8e73-4ec54156d748 tempest-ProjectMemberTests-782019947 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6.f8cc3c01-9699-4d36-8507-d1862cfffc86 is being set with open permissions: ugo+rw
Nov 04 12:30:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dfb3331a-7591-472f-8e73-4ec54156d748 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6.f8cc3c01-9699-4d36-8507-d1862cfffc86 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:49 devstack sudo[108156]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6.f8cc3c01-9699-4d36-8507-d1862cfffc86
Nov 04 12:30:49 devstack sudo[108156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:49 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-001bd9ea-cf98-4c95-9900-77719476fe0d tempest-ProjectReaderTests-745542355 None] Acquiring lock "cinder-447f3d55-d264-43bd-a7a0-f53d1ddd518d-delete_snapshot" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:49 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-001bd9ea-cf98-4c95-9900-77719476fe0d tempest-ProjectReaderTests-745542355 None] Lock "cinder-447f3d55-d264-43bd-a7a0-f53d1ddd518d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:49 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-001bd9ea-cf98-4c95-9900-77719476fe0d tempest-ProjectReaderTests-745542355 None] Acquiring lock "cinder-quobyte-16cdaeeb-4285-42d7-aae7-1e395013a96e" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:49 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-001bd9ea-cf98-4c95-9900-77719476fe0d tempest-ProjectReaderTests-745542355 None] Lock "cinder-quobyte-16cdaeeb-4285-42d7-aae7-1e395013a96e" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:49 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-001bd9ea-cf98-4c95-9900-77719476fe0d tempest-ProjectReaderTests-745542355 None] Acquiring lock "cinder-quobyte-447f3d55-d264-43bd-a7a0-f53d1ddd518d" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:49 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-001bd9ea-cf98-4c95-9900-77719476fe0d tempest-ProjectReaderTests-745542355 None] Lock "cinder-quobyte-447f3d55-d264-43bd-a7a0-f53d1ddd518d" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-001bd9ea-cf98-4c95-9900-77719476fe0d tempest-ProjectReaderTests-745542355 None] Deleting offline snapshot 447f3d55-d264-43bd-a7a0-f53d1ddd518d of volume 16cdaeeb-4285-42d7-aae7-1e395013a96e {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:30:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-001bd9ea-cf98-4c95-9900-77719476fe0d tempest-ProjectReaderTests-745542355 None] snapshot_file for this snap is: volume-16cdaeeb-4285-42d7-aae7-1e395013a96e.447f3d55-d264-43bd-a7a0-f53d1ddd518d {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:30:49 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[5894c026-7397-4f34-9aac-b8d544a448c6]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-001bd9ea-cf98-4c95-9900-77719476fe0d tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e.447f3d55-d264-43bd-a7a0-f53d1ddd518d {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:49 devstack sudo[108156]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dfb3331a-7591-472f-8e73-4ec54156d748 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6.f8cc3c01-9699-4d36-8507-d1862cfffc86" returned: 0 in 0.263s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:49 devstack sudo[108158]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e.447f3d55-d264-43bd-a7a0-f53d1ddd518d
Nov 04 12:30:49 devstack sudo[108158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dfb3331a-7591-472f-8e73-4ec54156d748 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:49 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:30:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:30:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:30:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:49 devstack sudo[108161]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6.info
Nov 04 12:30:49 devstack sudo[108161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:49 devstack sudo[108162]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:30:49 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:50 devstack sudo[108161]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dfb3331a-7591-472f-8e73-4ec54156d748 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6.info" returned: 0 in 0.265s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:50 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-dfb3331a-7591-472f-8e73-4ec54156d748 tempest-ProjectMemberTests-782019947 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6.info is being set with open permissions: ugo+rw
Nov 04 12:30:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dfb3331a-7591-472f-8e73-4ec54156d748 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:50 devstack sudo[108158]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-001bd9ea-cf98-4c95-9900-77719476fe0d tempest-ProjectReaderTests-745542355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e.447f3d55-d264-43bd-a7a0-f53d1ddd518d" returned: 0 in 0.424s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:50 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-001bd9ea-cf98-4c95-9900-77719476fe0d tempest-ProjectReaderTests-745542355 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-16cdaeeb-4285-42d7-aae7-1e395013a96e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:30:50 devstack sudo[108170]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6.info
Nov 04 12:30:50 devstack sudo[108170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:50 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.297s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:50 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:30:50 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager._thread_info {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:30:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread count: 28 {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 12:30:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread info: [<_MainThread(MainThread, started 137165867425920)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137165754678912)>, <Thread(Thread-3 (stat_writer), started daemon 137165754130752)>, <Thread(Rabbit-heartbeat, started daemon 137165752997504)>, <Thread(Thread-5 (_runner), started daemon 137165753227712)>, <Thread(Thread-7 (_runner), started daemon 137165751273856)>, <Thread(fd_logger, started daemon 137165755322048)>, <Thread(privsep_reader, started daemon 137165748896704)>, <Thread(tpool_thread_0, started daemon 137165742520000)>, <Thread(tpool_thread_1, started daemon 137165734127296)>, <Thread(tpool_thread_2, started daemon 137165725734592)>, <Thread(tpool_thread_3, started daemon 137165717341888)>, <Thread(tpool_thread_4, started daemon 137165708949184)>, <Thread(tpool_thread_5, started daemon 137165700556480)>, <Thread(tpool_thread_6, started daemon 137165692163776)>, <Thread(tpool_thread_7, started daemon 137165683771072)>, <Thread(tpool_thread_8, started daemon 137165675378368)>, <Thread(tpool_thread_9, started daemon 137165666985664)>, <Thread(tpool_thread_10, started daemon 137165658592960)>, <Thread(tpool_thread_11, started daemon 137165650183872)>, <Thread(tpool_thread_12, started daemon 137165641774784)>, <Thread(tpool_thread_13, started daemon 137165633365696)>, <Thread(tpool_thread_14, started daemon 137165624956608)>, <Thread(tpool_thread_15, started daemon 137165616547520)>, <Thread(tpool_thread_16, started daemon 137165608138432)>, <Thread(tpool_thread_17, started daemon 137165599729344)>, <Thread(tpool_thread_18, started daemon 137165591320256)>, <Thread(tpool_thread_19, started daemon 137165582911168)>] {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 12:30:50 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d2b4f4-3eeb-4be3-a1df-7be7db6c8ad6]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-001bd9ea-cf98-4c95-9900-77719476fe0d tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:50 devstack sudo[108172]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e
Nov 04 12:30:50 devstack sudo[108172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:50 devstack sudo[108170]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-dfb3331a-7591-472f-8e73-4ec54156d748 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6.info" returned: 0 in 0.277s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-dfb3331a-7591-472f-8e73-4ec54156d748 tempest-ProjectMemberTests-782019947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.979s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:50 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-dfb3331a-7591-472f-8e73-4ec54156d748 tempest-ProjectMemberTests-782019947 None] Create snapshot completed successfully
Nov 04 12:30:50 devstack sudo[108172]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-001bd9ea-cf98-4c95-9900-77719476fe0d tempest-ProjectReaderTests-745542355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e" returned: 0 in 0.382s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-001bd9ea-cf98-4c95-9900-77719476fe0d tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e.447f3d55-d264-43bd-a7a0-f53d1ddd518d {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:50 devstack sudo[108178]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e.447f3d55-d264-43bd-a7a0-f53d1ddd518d
Nov 04 12:30:50 devstack sudo[108178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:50 devstack sudo[108178]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-001bd9ea-cf98-4c95-9900-77719476fe0d tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e.447f3d55-d264-43bd-a7a0-f53d1ddd518d" returned: 0 in 0.321s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-001bd9ea-cf98-4c95-9900-77719476fe0d tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e.447f3d55-d264-43bd-a7a0-f53d1ddd518d {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:50 devstack sudo[108183]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e.447f3d55-d264-43bd-a7a0-f53d1ddd518d
Nov 04 12:30:50 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:51 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-40487325-d7ea-4958-9574-e83fdc653e2d tempest-ProjectMemberTests-782019947 None] Acquiring lock "cinder-f8cc3c01-9699-4d36-8507-d1862cfffc86-delete_snapshot" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:51 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-40487325-d7ea-4958-9574-e83fdc653e2d tempest-ProjectMemberTests-782019947 None] Lock "cinder-f8cc3c01-9699-4d36-8507-d1862cfffc86-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:51 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-40487325-d7ea-4958-9574-e83fdc653e2d tempest-ProjectMemberTests-782019947 None] Acquiring lock "cinder-quobyte-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:51 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-40487325-d7ea-4958-9574-e83fdc653e2d tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:51 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-40487325-d7ea-4958-9574-e83fdc653e2d tempest-ProjectMemberTests-782019947 None] Acquiring lock "cinder-quobyte-f8cc3c01-9699-4d36-8507-d1862cfffc86" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:51 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-40487325-d7ea-4958-9574-e83fdc653e2d tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-f8cc3c01-9699-4d36-8507-d1862cfffc86" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:51 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-40487325-d7ea-4958-9574-e83fdc653e2d tempest-ProjectMemberTests-782019947 None] Deleting offline snapshot f8cc3c01-9699-4d36-8507-d1862cfffc86 of volume 21b05c11-1c10-42c1-9c54-c46d7ddbc5e6 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:30:51 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-40487325-d7ea-4958-9574-e83fdc653e2d tempest-ProjectMemberTests-782019947 None] snapshot_file for this snap is: volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6.f8cc3c01-9699-4d36-8507-d1862cfffc86 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:30:51 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-001bd9ea-cf98-4c95-9900-77719476fe0d tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e.447f3d55-d264-43bd-a7a0-f53d1ddd518d" returned: 0 in 0.288s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:51 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12925d0-d5d8-404f-b0dc-176658682e5d]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-40487325-d7ea-4958-9574-e83fdc653e2d tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6.f8cc3c01-9699-4d36-8507-d1862cfffc86 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:51 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-001bd9ea-cf98-4c95-9900-77719476fe0d tempest-ProjectReaderTests-745542355 None] Lock "cinder-quobyte-447f3d55-d264-43bd-a7a0-f53d1ddd518d" released by "_delete_snapshot" :: held 1.544s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:51 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-001bd9ea-cf98-4c95-9900-77719476fe0d tempest-ProjectReaderTests-745542355 None] Lock "cinder-quobyte-16cdaeeb-4285-42d7-aae7-1e395013a96e" released by "delete_snapshot" :: held 1.567s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:51 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-001bd9ea-cf98-4c95-9900-77719476fe0d tempest-ProjectReaderTests-745542355 None] Created reservations ['91634632-3b0b-4e75-8663-d3c8222a2ad5', '11cfe108-cb15-4e9f-aff3-4f8fd55f8009', '9b63cfe1-c679-4435-adef-4f725f71726c', '83f41194-d3c5-4f9c-9520-80f6c9369c34'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:30:51 devstack sudo[108186]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6.f8cc3c01-9699-4d36-8507-d1862cfffc86
Nov 04 12:30:51 devstack sudo[108186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:51 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-001bd9ea-cf98-4c95-9900-77719476fe0d tempest-ProjectReaderTests-745542355 None] Delete snapshot completed successfully.
Nov 04 12:30:51 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-001bd9ea-cf98-4c95-9900-77719476fe0d tempest-ProjectReaderTests-745542355 None] Lock "cinder-447f3d55-d264-43bd-a7a0-f53d1ddd518d-delete_snapshot" released by "delete_snapshot" :: held 1.710s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:51 devstack sudo[108186]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-40487325-d7ea-4958-9574-e83fdc653e2d tempest-ProjectMemberTests-782019947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6.f8cc3c01-9699-4d36-8507-d1862cfffc86" returned: 0 in 0.378s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:51 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-40487325-d7ea-4958-9574-e83fdc653e2d tempest-ProjectMemberTests-782019947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:30:51 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[782845b4-7a78-4d15-becb-0b65394fcde1]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-40487325-d7ea-4958-9574-e83fdc653e2d tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:51 devstack sudo[108192]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6
Nov 04 12:30:51 devstack sudo[108192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:51 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-eee5a628-2d1a-474d-b232-defac644c0d2 tempest-ProjectReaderTests-745542355 None] Acquiring lock "cinder-16cdaeeb-4285-42d7-aae7-1e395013a96e-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:51 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-eee5a628-2d1a-474d-b232-defac644c0d2 tempest-ProjectReaderTests-745542355 None] Lock "cinder-16cdaeeb-4285-42d7-aae7-1e395013a96e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:51 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-eee5a628-2d1a-474d-b232-defac644c0d2 tempest-ProjectReaderTests-745542355 None] Acquiring lock "cinder-quobyte-16cdaeeb-4285-42d7-aae7-1e395013a96e" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:51 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-eee5a628-2d1a-474d-b232-defac644c0d2 tempest-ProjectReaderTests-745542355 None] Lock "cinder-quobyte-16cdaeeb-4285-42d7-aae7-1e395013a96e" acquired by "delete_volume" :: waited 0.023s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:51 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[00b4f6ee-f2a8-4f39-8d98-b7cd754820a3]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:51 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-eee5a628-2d1a-474d-b232-defac644c0d2 tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:52 devstack sudo[108192]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-40487325-d7ea-4958-9574-e83fdc653e2d tempest-ProjectMemberTests-782019947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6" returned: 0 in 0.388s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-40487325-d7ea-4958-9574-e83fdc653e2d tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6.f8cc3c01-9699-4d36-8507-d1862cfffc86 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:52 devstack sudo[108198]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6.f8cc3c01-9699-4d36-8507-d1862cfffc86
Nov 04 12:30:52 devstack sudo[108198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:52 devstack sudo[108196]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e
Nov 04 12:30:52 devstack sudo[108196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:52 devstack sudo[108196]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-eee5a628-2d1a-474d-b232-defac644c0d2 tempest-ProjectReaderTests-745542355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e" returned: 0 in 0.376s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-eee5a628-2d1a-474d-b232-defac644c0d2 tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:52 devstack sudo[108207]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e
Nov 04 12:30:52 devstack sudo[108207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:52 devstack sudo[108198]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-40487325-d7ea-4958-9574-e83fdc653e2d tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6.f8cc3c01-9699-4d36-8507-d1862cfffc86" returned: 0 in 0.385s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-40487325-d7ea-4958-9574-e83fdc653e2d tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6.f8cc3c01-9699-4d36-8507-d1862cfffc86 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:52 devstack sudo[108209]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6.f8cc3c01-9699-4d36-8507-d1862cfffc86
Nov 04 12:30:52 devstack sudo[108209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:52 devstack sudo[108207]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-eee5a628-2d1a-474d-b232-defac644c0d2 tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-16cdaeeb-4285-42d7-aae7-1e395013a96e" returned: 0 in 0.251s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:52 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-eee5a628-2d1a-474d-b232-defac644c0d2 tempest-ProjectReaderTests-745542355 None] Lock "cinder-quobyte-16cdaeeb-4285-42d7-aae7-1e395013a96e" released by "delete_volume" :: held 0.699s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:52 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-eee5a628-2d1a-474d-b232-defac644c0d2 tempest-ProjectReaderTests-745542355 None] Created reservations ['b566a4e5-e2a6-463b-b21f-9f3964b4c57d', 'b9256396-6414-43dd-ad0e-dc273c440b41', '201f9965-6937-4495-a0ee-539607847087', 'fe7da3ba-72b2-4144-a2d3-1ab309f8dffd'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:30:52 devstack sudo[108209]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-40487325-d7ea-4958-9574-e83fdc653e2d tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6.f8cc3c01-9699-4d36-8507-d1862cfffc86" returned: 0 in 0.257s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:52 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-40487325-d7ea-4958-9574-e83fdc653e2d tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-f8cc3c01-9699-4d36-8507-d1862cfffc86" released by "_delete_snapshot" :: held 1.534s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:52 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-40487325-d7ea-4958-9574-e83fdc653e2d tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6" released by "delete_snapshot" :: held 1.559s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-eee5a628-2d1a-474d-b232-defac644c0d2 tempest-ProjectReaderTests-745542355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-eee5a628-2d1a-474d-b232-defac644c0d2 tempest-ProjectReaderTests-745542355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:52 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-eee5a628-2d1a-474d-b232-defac644c0d2 tempest-ProjectReaderTests-745542355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:30:52 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-eee5a628-2d1a-474d-b232-defac644c0d2 tempest-ProjectReaderTests-745542355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:30:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-eee5a628-2d1a-474d-b232-defac644c0d2 tempest-ProjectReaderTests-745542355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:52 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-eee5a628-2d1a-474d-b232-defac644c0d2 tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:52 devstack sudo[108213]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:30:52 devstack sudo[108213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:52 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-40487325-d7ea-4958-9574-e83fdc653e2d tempest-ProjectMemberTests-782019947 None] Created reservations ['02abead6-63b7-41ec-acb1-4edd0806da57', '85984504-6472-41b8-b89b-919ea93eacdb', 'e92b399e-bf88-45b4-ba9e-e6da0d5b49c2', '90485023-427c-4d2e-ae9b-c73d0ef4711a'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:30:52 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-40487325-d7ea-4958-9574-e83fdc653e2d tempest-ProjectMemberTests-782019947 None] Delete snapshot completed successfully.
Nov 04 12:30:52 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-40487325-d7ea-4958-9574-e83fdc653e2d tempest-ProjectMemberTests-782019947 None] Lock "cinder-f8cc3c01-9699-4d36-8507-d1862cfffc86-delete_snapshot" released by "delete_snapshot" :: held 1.741s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:53 devstack sudo[108213]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-eee5a628-2d1a-474d-b232-defac644c0d2 tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.261s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:53 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-eee5a628-2d1a-474d-b232-defac644c0d2 tempest-ProjectReaderTests-745542355 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:30:53 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-eee5a628-2d1a-474d-b232-defac644c0d2 tempest-ProjectReaderTests-745542355 None] Deleted volume successfully.
Nov 04 12:30:53 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-eee5a628-2d1a-474d-b232-defac644c0d2 tempest-ProjectReaderTests-745542355 None] Lock "cinder-16cdaeeb-4285-42d7-aae7-1e395013a96e-delete_volume" released by "delete_volume" :: held 1.235s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:53 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-4c152d28-b61a-474f-9c67-20f981afa186 tempest-ProjectMemberTests-782019947 None] Acquiring lock "cinder-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:53 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-4c152d28-b61a-474f-9c67-20f981afa186 tempest-ProjectMemberTests-782019947 None] Lock "cinder-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:53 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-4c152d28-b61a-474f-9c67-20f981afa186 tempest-ProjectMemberTests-782019947 None] Acquiring lock "cinder-quobyte-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:53 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-4c152d28-b61a-474f-9c67-20f981afa186 tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6" acquired by "delete_volume" :: waited 0.020s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:53 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[b687e193-deeb-4da8-a260-f214af80a37e]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4c152d28-b61a-474f-9c67-20f981afa186 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:53 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-92207168-94ee-4516-9824-57ef4b0d1ba5 tempest-ProjectReaderTests-745542355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:30:53 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-92207168-94ee-4516-9824-57ef4b0d1ba5 tempest-ProjectReaderTests-745542355 None] Flow 'volume_create_manager' (9dc186fc-49a5-49e8-8de3-7aeb8628b519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:30:53 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-92207168-94ee-4516-9824-57ef4b0d1ba5 tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d62d812-03a9-4d7a-9bae-8c33a952ba59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:53 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-92207168-94ee-4516-9824-57ef4b0d1ba5 tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d62d812-03a9-4d7a-9bae-8c33a952ba59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:30:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-867246128',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=359da600-3b2b-4542-9469-c1b414fb7dc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='324f832ed91d41c5891b98855382e88b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:53Z,use_quota=True,user_id='c72534133ab0445ca0b45d95d7c20347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:53 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-92207168-94ee-4516-9824-57ef4b0d1ba5 tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c37ee38d-72c0-45ba-9b58-8a7cff698d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:53 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-92207168-94ee-4516-9824-57ef4b0d1ba5 tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c37ee38d-72c0-45ba-9b58-8a7cff698d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:53 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-92207168-94ee-4516-9824-57ef4b0d1ba5 tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cb62392-5174-4e6b-bf44-2e812178ecaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:53 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-92207168-94ee-4516-9824-57ef4b0d1ba5 tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cb62392-5174-4e6b-bf44-2e812178ecaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '359da600-3b2b-4542-9469-c1b414fb7dc6', 'volume_name': 'volume-359da600-3b2b-4542-9469-c1b414fb7dc6', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:53 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-92207168-94ee-4516-9824-57ef4b0d1ba5 tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b78def4-5686-4790-b601-1633f9627dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:53 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-92207168-94ee-4516-9824-57ef4b0d1ba5 tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b78def4-5686-4790-b601-1633f9627dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:53 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-92207168-94ee-4516-9824-57ef4b0d1ba5 tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66911687-5537-4272-9d06-c0c1f5be069f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:53 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-92207168-94ee-4516-9824-57ef4b0d1ba5 tempest-ProjectReaderTests-745542355 None] Volume 359da600-3b2b-4542-9469-c1b414fb7dc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-359da600-3b2b-4542-9469-c1b414fb7dc6', 'volume_size': 1}
Nov 04 12:30:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-92207168-94ee-4516-9824-57ef4b0d1ba5 tempest-ProjectReaderTests-745542355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:53 devstack sudo[108217]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6
Nov 04 12:30:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-92207168-94ee-4516-9824-57ef4b0d1ba5 tempest-ProjectReaderTests-745542355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:53 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:53 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-92207168-94ee-4516-9824-57ef4b0d1ba5 tempest-ProjectReaderTests-745542355 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:30:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-867246128',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=359da600-3b2b-4542-9469-c1b414fb7dc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='324f832ed91d41c5891b98855382e88b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:53Z,use_quota=True,user_id='c72534133ab0445ca0b45d95d7c20347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:30:53 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-92207168-94ee-4516-9824-57ef4b0d1ba5 tempest-ProjectReaderTests-745542355 None] Creating volume 359da600-3b2b-4542-9469-c1b414fb7dc6 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:30:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-92207168-94ee-4516-9824-57ef4b0d1ba5 tempest-ProjectReaderTests-745542355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-92207168-94ee-4516-9824-57ef4b0d1ba5 tempest-ProjectReaderTests-745542355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:53 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-92207168-94ee-4516-9824-57ef4b0d1ba5 tempest-ProjectReaderTests-745542355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:30:53 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-92207168-94ee-4516-9824-57ef4b0d1ba5 tempest-ProjectReaderTests-745542355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:30:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-92207168-94ee-4516-9824-57ef4b0d1ba5 tempest-ProjectReaderTests-745542355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:53 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-92207168-94ee-4516-9824-57ef4b0d1ba5 tempest-ProjectReaderTests-745542355 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:30:53 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-92207168-94ee-4516-9824-57ef4b0d1ba5 tempest-ProjectReaderTests-745542355 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:30:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-92207168-94ee-4516-9824-57ef4b0d1ba5 tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:53 devstack sudo[108219]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6 1073741824
Nov 04 12:30:53 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:53 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4c152d28-b61a-474f-9c67-20f981afa186 tempest-ProjectMemberTests-782019947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6" returned: 0 in 0.361s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4c152d28-b61a-474f-9c67-20f981afa186 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:53 devstack sudo[108227]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6
Nov 04 12:30:53 devstack sudo[108227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:53 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:53 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-92207168-94ee-4516-9824-57ef4b0d1ba5 tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6 1073741824" returned: 0 in 0.426s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-92207168-94ee-4516-9824-57ef4b0d1ba5 tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:54 devstack sudo[108227]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4c152d28-b61a-474f-9c67-20f981afa186 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6" returned: 0 in 0.248s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:54 devstack sudo[108232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6
Nov 04 12:30:54 devstack sudo[108232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:54 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-4c152d28-b61a-474f-9c67-20f981afa186 tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6" released by "delete_volume" :: held 0.686s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:54 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-4c152d28-b61a-474f-9c67-20f981afa186 tempest-ProjectMemberTests-782019947 None] Created reservations ['12e91645-df85-4c61-8b59-bd5d50c70d2d', '42014c19-2166-4b9f-bc08-6b42275706e6', '48438a1a-8616-420e-b175-10f535180fe6', '67af984f-a80a-4d88-9145-8cfc7e41a666'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:30:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-4c152d28-b61a-474f-9c67-20f981afa186 tempest-ProjectMemberTests-782019947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-4c152d28-b61a-474f-9c67-20f981afa186 tempest-ProjectMemberTests-782019947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:54 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-4c152d28-b61a-474f-9c67-20f981afa186 tempest-ProjectMemberTests-782019947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:30:54 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-4c152d28-b61a-474f-9c67-20f981afa186 tempest-ProjectMemberTests-782019947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:30:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-4c152d28-b61a-474f-9c67-20f981afa186 tempest-ProjectMemberTests-782019947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4c152d28-b61a-474f-9c67-20f981afa186 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:54 devstack sudo[108234]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:30:54 devstack sudo[108234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:54 devstack sudo[108232]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-92207168-94ee-4516-9824-57ef4b0d1ba5 tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6" returned: 0 in 0.264s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:54 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-92207168-94ee-4516-9824-57ef4b0d1ba5 tempest-ProjectReaderTests-745542355 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:30:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-92207168-94ee-4516-9824-57ef4b0d1ba5 tempest-ProjectReaderTests-745542355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:54 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-92207168-94ee-4516-9824-57ef4b0d1ba5 tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66911687-5537-4272-9d06-c0c1f5be069f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-359da600-3b2b-4542-9469-c1b414fb7dc6', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:54 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-92207168-94ee-4516-9824-57ef4b0d1ba5 tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62177536-ec82-44c7-ba6d-3c9dfa5e4287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:54 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-92207168-94ee-4516-9824-57ef4b0d1ba5 tempest-ProjectReaderTests-745542355 None] Volume volume-359da600-3b2b-4542-9469-c1b414fb7dc6 (359da600-3b2b-4542-9469-c1b414fb7dc6): created successfully
Nov 04 12:30:54 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-92207168-94ee-4516-9824-57ef4b0d1ba5 tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62177536-ec82-44c7-ba6d-3c9dfa5e4287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:54 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-92207168-94ee-4516-9824-57ef4b0d1ba5 tempest-ProjectReaderTests-745542355 None] Flow 'volume_create_manager' (9dc186fc-49a5-49e8-8de3-7aeb8628b519) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:30:54 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-92207168-94ee-4516-9824-57ef4b0d1ba5 tempest-ProjectReaderTests-745542355 None] Created volume successfully.
Nov 04 12:30:54 devstack sudo[108234]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4c152d28-b61a-474f-9c67-20f981afa186 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.271s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:54 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-4c152d28-b61a-474f-9c67-20f981afa186 tempest-ProjectMemberTests-782019947 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:30:54 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-4c152d28-b61a-474f-9c67-20f981afa186 tempest-ProjectMemberTests-782019947 None] Deleted volume successfully.
Nov 04 12:30:54 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-4c152d28-b61a-474f-9c67-20f981afa186 tempest-ProjectMemberTests-782019947 None] Lock "cinder-21b05c11-1c10-42c1-9c54-c46d7ddbc5e6-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-9b63dde1-c6d4-463b-879a-8cc36da1c5bc tempest-ProjectReaderTests-745542355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-9b63dde1-c6d4-463b-879a-8cc36da1c5bc tempest-ProjectReaderTests-745542355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:54 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-9b63dde1-c6d4-463b-879a-8cc36da1c5bc tempest-ProjectReaderTests-745542355 None] Creating offline snapshot 3005e630-5d99-4ada-87ee-d87dc3dc99f7 of volume 359da600-3b2b-4542-9469-c1b414fb7dc6 {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:30:54 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a60648-6c28-42cd-8ea7-4655cd33cf66]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:54 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9b63dde1-c6d4-463b-879a-8cc36da1c5bc tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:54 devstack sudo[108238]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6
Nov 04 12:30:54 devstack sudo[108238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:54 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-115a18b1-9a7a-428a-8d12-3729bc25219d tempest-ProjectMemberTests-782019947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:30:54 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-115a18b1-9a7a-428a-8d12-3729bc25219d tempest-ProjectMemberTests-782019947 None] Flow 'volume_create_manager' (040a375d-d600-4a7a-9c2c-39cd95f006e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:30:54 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-115a18b1-9a7a-428a-8d12-3729bc25219d tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb9709a1-d31e-4492-9ac2-782485634850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:54 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-115a18b1-9a7a-428a-8d12-3729bc25219d tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb9709a1-d31e-4492-9ac2-782485634850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1334337224',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=113f49bc-a1f5-4601-ad7c-044496ffc364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5a80a035d04be496795229f2e16378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:55Z,use_quota=True,user_id='4f258b2e50a741e4b75bd5ecf8d3039a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:54 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-115a18b1-9a7a-428a-8d12-3729bc25219d tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0297e8b-2a09-4e8d-9ee8-2a7665f5ca5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:54 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-115a18b1-9a7a-428a-8d12-3729bc25219d tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0297e8b-2a09-4e8d-9ee8-2a7665f5ca5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:55 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-115a18b1-9a7a-428a-8d12-3729bc25219d tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7df3445b-e09f-457d-b08e-7fe7f705ce10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:55 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-115a18b1-9a7a-428a-8d12-3729bc25219d tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7df3445b-e09f-457d-b08e-7fe7f705ce10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '113f49bc-a1f5-4601-ad7c-044496ffc364', 'volume_name': 'volume-113f49bc-a1f5-4601-ad7c-044496ffc364', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:55 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-115a18b1-9a7a-428a-8d12-3729bc25219d tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecb9c2ae-12db-4ff9-a755-64c3ca6cc596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:55 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-115a18b1-9a7a-428a-8d12-3729bc25219d tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecb9c2ae-12db-4ff9-a755-64c3ca6cc596) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:55 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-115a18b1-9a7a-428a-8d12-3729bc25219d tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (709491f3-e12b-481b-b768-defc0a4f79ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:55 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-115a18b1-9a7a-428a-8d12-3729bc25219d tempest-ProjectMemberTests-782019947 None] Volume 113f49bc-a1f5-4601-ad7c-044496ffc364: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-113f49bc-a1f5-4601-ad7c-044496ffc364', 'volume_size': 1}
Nov 04 12:30:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-115a18b1-9a7a-428a-8d12-3729bc25219d tempest-ProjectMemberTests-782019947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:55 devstack sudo[108238]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9b63dde1-c6d4-463b-879a-8cc36da1c5bc tempest-ProjectReaderTests-745542355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6" returned: 0 in 0.401s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9b63dde1-c6d4-463b-879a-8cc36da1c5bc tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6.3005e630-5d99-4ada-87ee-d87dc3dc99f7 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:55 devstack sudo[108243]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6.3005e630-5d99-4ada-87ee-d87dc3dc99f7 1G
Nov 04 12:30:55 devstack sudo[108243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:55 devstack sudo[108243]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9b63dde1-c6d4-463b-879a-8cc36da1c5bc tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6.3005e630-5d99-4ada-87ee-d87dc3dc99f7 1G" returned: 0 in 0.392s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9b63dde1-c6d4-463b-879a-8cc36da1c5bc tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-359da600-3b2b-4542-9469-c1b414fb7dc6 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6.3005e630-5d99-4ada-87ee-d87dc3dc99f7 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:55 devstack sudo[108249]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-359da600-3b2b-4542-9469-c1b414fb7dc6 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6.3005e630-5d99-4ada-87ee-d87dc3dc99f7
Nov 04 12:30:55 devstack sudo[108249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:55 devstack sudo[108249]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9b63dde1-c6d4-463b-879a-8cc36da1c5bc tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-359da600-3b2b-4542-9469-c1b414fb7dc6 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6.3005e630-5d99-4ada-87ee-d87dc3dc99f7" returned: 0 in 0.284s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:55 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-9b63dde1-c6d4-463b-879a-8cc36da1c5bc tempest-ProjectReaderTests-745542355 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6.3005e630-5d99-4ada-87ee-d87dc3dc99f7 is being set with open permissions: ugo+rw
Nov 04 12:30:55 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9b63dde1-c6d4-463b-879a-8cc36da1c5bc tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6.3005e630-5d99-4ada-87ee-d87dc3dc99f7 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:55 devstack sudo[108256]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6.3005e630-5d99-4ada-87ee-d87dc3dc99f7
Nov 04 12:30:55 devstack sudo[108256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:56 devstack sudo[108256]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9b63dde1-c6d4-463b-879a-8cc36da1c5bc tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6.3005e630-5d99-4ada-87ee-d87dc3dc99f7" returned: 0 in 0.258s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9b63dde1-c6d4-463b-879a-8cc36da1c5bc tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:56 devstack sudo[108259]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6.info
Nov 04 12:30:56 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:56 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9b63dde1-c6d4-463b-879a-8cc36da1c5bc tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6.info" returned: 0 in 0.254s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:56 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-9b63dde1-c6d4-463b-879a-8cc36da1c5bc tempest-ProjectReaderTests-745542355 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6.info is being set with open permissions: ugo+rw
Nov 04 12:30:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9b63dde1-c6d4-463b-879a-8cc36da1c5bc tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:56 devstack sudo[108262]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6.info
Nov 04 12:30:56 devstack sudo[108262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:56 devstack sudo[108262]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9b63dde1-c6d4-463b-879a-8cc36da1c5bc tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6.info" returned: 0 in 0.240s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-9b63dde1-c6d4-463b-879a-8cc36da1c5bc tempest-ProjectReaderTests-745542355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.924s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-115a18b1-9a7a-428a-8d12-3729bc25219d tempest-ProjectMemberTests-782019947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.534s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:56 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-115a18b1-9a7a-428a-8d12-3729bc25219d tempest-ProjectMemberTests-782019947 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:30:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1334337224',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=113f49bc-a1f5-4601-ad7c-044496ffc364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5a80a035d04be496795229f2e16378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:30:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:30:55Z,use_quota=True,user_id='4f258b2e50a741e4b75bd5ecf8d3039a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:30:56 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-115a18b1-9a7a-428a-8d12-3729bc25219d tempest-ProjectMemberTests-782019947 None] Creating volume 113f49bc-a1f5-4601-ad7c-044496ffc364 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:30:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-115a18b1-9a7a-428a-8d12-3729bc25219d tempest-ProjectMemberTests-782019947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-115a18b1-9a7a-428a-8d12-3729bc25219d tempest-ProjectMemberTests-782019947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:56 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-115a18b1-9a7a-428a-8d12-3729bc25219d tempest-ProjectMemberTests-782019947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:30:56 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-115a18b1-9a7a-428a-8d12-3729bc25219d tempest-ProjectMemberTests-782019947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:30:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-115a18b1-9a7a-428a-8d12-3729bc25219d tempest-ProjectMemberTests-782019947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:56 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-115a18b1-9a7a-428a-8d12-3729bc25219d tempest-ProjectMemberTests-782019947 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:30:56 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-115a18b1-9a7a-428a-8d12-3729bc25219d tempest-ProjectMemberTests-782019947 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:30:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-115a18b1-9a7a-428a-8d12-3729bc25219d tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:56 devstack sudo[108265]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364 1073741824
Nov 04 12:30:56 devstack sudo[108265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:56 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-9b63dde1-c6d4-463b-879a-8cc36da1c5bc tempest-ProjectReaderTests-745542355 None] Create snapshot completed successfully
Nov 04 12:30:56 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a913d44f-43f2-4993-99d6-30e6343fc5e3 tempest-ProjectReaderTests-745542355 None] Acquiring lock "cinder-3005e630-5d99-4ada-87ee-d87dc3dc99f7-delete_snapshot" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:56 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a913d44f-43f2-4993-99d6-30e6343fc5e3 tempest-ProjectReaderTests-745542355 None] Lock "cinder-3005e630-5d99-4ada-87ee-d87dc3dc99f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:56 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a913d44f-43f2-4993-99d6-30e6343fc5e3 tempest-ProjectReaderTests-745542355 None] Acquiring lock "cinder-quobyte-359da600-3b2b-4542-9469-c1b414fb7dc6" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:56 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a913d44f-43f2-4993-99d6-30e6343fc5e3 tempest-ProjectReaderTests-745542355 None] Lock "cinder-quobyte-359da600-3b2b-4542-9469-c1b414fb7dc6" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:56 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a913d44f-43f2-4993-99d6-30e6343fc5e3 tempest-ProjectReaderTests-745542355 None] Acquiring lock "cinder-quobyte-3005e630-5d99-4ada-87ee-d87dc3dc99f7" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:56 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a913d44f-43f2-4993-99d6-30e6343fc5e3 tempest-ProjectReaderTests-745542355 None] Lock "cinder-quobyte-3005e630-5d99-4ada-87ee-d87dc3dc99f7" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:56 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-a913d44f-43f2-4993-99d6-30e6343fc5e3 tempest-ProjectReaderTests-745542355 None] Deleting offline snapshot 3005e630-5d99-4ada-87ee-d87dc3dc99f7 of volume 359da600-3b2b-4542-9469-c1b414fb7dc6 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:30:56 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-a913d44f-43f2-4993-99d6-30e6343fc5e3 tempest-ProjectReaderTests-745542355 None] snapshot_file for this snap is: volume-359da600-3b2b-4542-9469-c1b414fb7dc6.3005e630-5d99-4ada-87ee-d87dc3dc99f7 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:30:56 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[023d213b-583d-4f6b-ba33-6e9095cc91e4]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:56 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a913d44f-43f2-4993-99d6-30e6343fc5e3 tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6.3005e630-5d99-4ada-87ee-d87dc3dc99f7 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:56 devstack sudo[108270]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6.3005e630-5d99-4ada-87ee-d87dc3dc99f7
Nov 04 12:30:56 devstack sudo[108270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:57 devstack sudo[108265]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-115a18b1-9a7a-428a-8d12-3729bc25219d tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364 1073741824" returned: 0 in 0.486s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-115a18b1-9a7a-428a-8d12-3729bc25219d tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:57 devstack sudo[108272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364
Nov 04 12:30:57 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:57 devstack sudo[108270]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a913d44f-43f2-4993-99d6-30e6343fc5e3 tempest-ProjectReaderTests-745542355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6.3005e630-5d99-4ada-87ee-d87dc3dc99f7" returned: 0 in 0.409s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:57 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-a913d44f-43f2-4993-99d6-30e6343fc5e3 tempest-ProjectReaderTests-745542355 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-359da600-3b2b-4542-9469-c1b414fb7dc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:30:57 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aeb4bad-2aef-4114-b2d6-0ba89818b555]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a913d44f-43f2-4993-99d6-30e6343fc5e3 tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:57 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-115a18b1-9a7a-428a-8d12-3729bc25219d tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364" returned: 0 in 0.257s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:57 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-115a18b1-9a7a-428a-8d12-3729bc25219d tempest-ProjectMemberTests-782019947 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:30:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-115a18b1-9a7a-428a-8d12-3729bc25219d tempest-ProjectMemberTests-782019947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-115a18b1-9a7a-428a-8d12-3729bc25219d tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (709491f3-e12b-481b-b768-defc0a4f79ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-113f49bc-a1f5-4601-ad7c-044496ffc364', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-115a18b1-9a7a-428a-8d12-3729bc25219d tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a37c06c-a48f-4c59-ad2b-a9ae558ffbd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:30:57 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-115a18b1-9a7a-428a-8d12-3729bc25219d tempest-ProjectMemberTests-782019947 None] Volume volume-113f49bc-a1f5-4601-ad7c-044496ffc364 (113f49bc-a1f5-4601-ad7c-044496ffc364): created successfully
Nov 04 12:30:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-115a18b1-9a7a-428a-8d12-3729bc25219d tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a37c06c-a48f-4c59-ad2b-a9ae558ffbd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:30:57 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-115a18b1-9a7a-428a-8d12-3729bc25219d tempest-ProjectMemberTests-782019947 None] Flow 'volume_create_manager' (040a375d-d600-4a7a-9c2c-39cd95f006e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:30:57 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-115a18b1-9a7a-428a-8d12-3729bc25219d tempest-ProjectMemberTests-782019947 None] Created volume successfully.
Nov 04 12:30:57 devstack sudo[108278]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6
Nov 04 12:30:57 devstack sudo[108278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:57 devstack sudo[108278]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a913d44f-43f2-4993-99d6-30e6343fc5e3 tempest-ProjectReaderTests-745542355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6" returned: 0 in 0.373s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:57 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a913d44f-43f2-4993-99d6-30e6343fc5e3 tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6.3005e630-5d99-4ada-87ee-d87dc3dc99f7 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:57 devstack sudo[108283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6.3005e630-5d99-4ada-87ee-d87dc3dc99f7
Nov 04 12:30:57 devstack sudo[108283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:58 devstack sudo[108283]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a913d44f-43f2-4993-99d6-30e6343fc5e3 tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6.3005e630-5d99-4ada-87ee-d87dc3dc99f7" returned: 0 in 0.333s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a913d44f-43f2-4993-99d6-30e6343fc5e3 tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6.3005e630-5d99-4ada-87ee-d87dc3dc99f7 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:58 devstack sudo[108289]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6.3005e630-5d99-4ada-87ee-d87dc3dc99f7
Nov 04 12:30:58 devstack sudo[108289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d99746e7-8d8f-4dd0-9c5f-7935a684c8f5 tempest-ProjectMemberTests-782019947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d99746e7-8d8f-4dd0-9c5f-7935a684c8f5 tempest-ProjectMemberTests-782019947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:58 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-d99746e7-8d8f-4dd0-9c5f-7935a684c8f5 tempest-ProjectMemberTests-782019947 None] Creating offline snapshot d32661eb-356e-4536-89bd-b8ccc043ad18 of volume 113f49bc-a1f5-4601-ad7c-044496ffc364 {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:30:58 devstack sudo[108289]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a913d44f-43f2-4993-99d6-30e6343fc5e3 tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6.3005e630-5d99-4ada-87ee-d87dc3dc99f7" returned: 0 in 0.261s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:58 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6eb5a0-41c1-4ef1-b53b-34c257ab48d6]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d99746e7-8d8f-4dd0-9c5f-7935a684c8f5 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:58 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a913d44f-43f2-4993-99d6-30e6343fc5e3 tempest-ProjectReaderTests-745542355 None] Lock "cinder-quobyte-3005e630-5d99-4ada-87ee-d87dc3dc99f7" released by "_delete_snapshot" :: held 1.492s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:58 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a913d44f-43f2-4993-99d6-30e6343fc5e3 tempest-ProjectReaderTests-745542355 None] Lock "cinder-quobyte-359da600-3b2b-4542-9469-c1b414fb7dc6" released by "delete_snapshot" :: held 1.518s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:58 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-a913d44f-43f2-4993-99d6-30e6343fc5e3 tempest-ProjectReaderTests-745542355 None] Created reservations ['35fd31fc-bd09-4d0a-9f11-4c1a7ab38754', 'ef140be8-ae2b-415f-a80b-c6478daed093', '9eb96611-0759-45f6-a8f6-447f243e2d64', '1a015f61-616b-495c-a859-63df64f739b9'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:30:58 devstack sudo[108292]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364
Nov 04 12:30:58 devstack sudo[108292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:58 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-a913d44f-43f2-4993-99d6-30e6343fc5e3 tempest-ProjectReaderTests-745542355 None] Delete snapshot completed successfully.
Nov 04 12:30:58 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a913d44f-43f2-4993-99d6-30e6343fc5e3 tempest-ProjectReaderTests-745542355 None] Lock "cinder-3005e630-5d99-4ada-87ee-d87dc3dc99f7-delete_snapshot" released by "delete_snapshot" :: held 1.655s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:58 devstack sudo[108292]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d99746e7-8d8f-4dd0-9c5f-7935a684c8f5 tempest-ProjectMemberTests-782019947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364" returned: 0 in 0.379s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:58 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d99746e7-8d8f-4dd0-9c5f-7935a684c8f5 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364.d32661eb-356e-4536-89bd-b8ccc043ad18 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:58 devstack sudo[108297]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364.d32661eb-356e-4536-89bd-b8ccc043ad18 1G
Nov 04 12:30:58 devstack sudo[108297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:58 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d3c850ea-0e65-4b8a-ba1f-cd472de6bb8f tempest-ProjectReaderTests-745542355 None] Acquiring lock "cinder-359da600-3b2b-4542-9469-c1b414fb7dc6-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:58 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d3c850ea-0e65-4b8a-ba1f-cd472de6bb8f tempest-ProjectReaderTests-745542355 None] Lock "cinder-359da600-3b2b-4542-9469-c1b414fb7dc6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:58 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d3c850ea-0e65-4b8a-ba1f-cd472de6bb8f tempest-ProjectReaderTests-745542355 None] Acquiring lock "cinder-quobyte-359da600-3b2b-4542-9469-c1b414fb7dc6" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:30:59 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d3c850ea-0e65-4b8a-ba1f-cd472de6bb8f tempest-ProjectReaderTests-745542355 None] Lock "cinder-quobyte-359da600-3b2b-4542-9469-c1b414fb7dc6" acquired by "delete_volume" :: waited 0.017s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:30:59 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[27de7275-3e60-48de-9a0d-f47db3a6837e]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:30:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d3c850ea-0e65-4b8a-ba1f-cd472de6bb8f tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:59 devstack sudo[108297]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d99746e7-8d8f-4dd0-9c5f-7935a684c8f5 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364.d32661eb-356e-4536-89bd-b8ccc043ad18 1G" returned: 0 in 0.453s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d99746e7-8d8f-4dd0-9c5f-7935a684c8f5 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-113f49bc-a1f5-4601-ad7c-044496ffc364 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364.d32661eb-356e-4536-89bd-b8ccc043ad18 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:59 devstack sudo[108303]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-113f49bc-a1f5-4601-ad7c-044496ffc364 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364.d32661eb-356e-4536-89bd-b8ccc043ad18
Nov 04 12:30:59 devstack sudo[108303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:59 devstack sudo[108302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6
Nov 04 12:30:59 devstack sudo[108302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:59 devstack sudo[108302]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d3c850ea-0e65-4b8a-ba1f-cd472de6bb8f tempest-ProjectReaderTests-745542355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6" returned: 0 in 0.376s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d3c850ea-0e65-4b8a-ba1f-cd472de6bb8f tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:59 devstack sudo[108303]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:59 devstack sudo[108312]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6
Nov 04 12:30:59 devstack sudo[108312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d99746e7-8d8f-4dd0-9c5f-7935a684c8f5 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-113f49bc-a1f5-4601-ad7c-044496ffc364 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364.d32661eb-356e-4536-89bd-b8ccc043ad18" returned: 0 in 0.321s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:59 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-d99746e7-8d8f-4dd0-9c5f-7935a684c8f5 tempest-ProjectMemberTests-782019947 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364.d32661eb-356e-4536-89bd-b8ccc043ad18 is being set with open permissions: ugo+rw
Nov 04 12:30:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d99746e7-8d8f-4dd0-9c5f-7935a684c8f5 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364.d32661eb-356e-4536-89bd-b8ccc043ad18 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:59 devstack sudo[108314]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364.d32661eb-356e-4536-89bd-b8ccc043ad18
Nov 04 12:30:59 devstack sudo[108314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:59 devstack sudo[108312]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d3c850ea-0e65-4b8a-ba1f-cd472de6bb8f tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-359da600-3b2b-4542-9469-c1b414fb7dc6" returned: 0 in 0.254s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:59 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d3c850ea-0e65-4b8a-ba1f-cd472de6bb8f tempest-ProjectReaderTests-745542355 None] Lock "cinder-quobyte-359da600-3b2b-4542-9469-c1b414fb7dc6" released by "delete_volume" :: held 0.700s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:30:59 devstack sudo[108314]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d99746e7-8d8f-4dd0-9c5f-7935a684c8f5 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364.d32661eb-356e-4536-89bd-b8ccc043ad18" returned: 0 in 0.252s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d99746e7-8d8f-4dd0-9c5f-7935a684c8f5 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:59 devstack sudo[108318]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364.info
Nov 04 12:30:59 devstack sudo[108318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:59 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-d3c850ea-0e65-4b8a-ba1f-cd472de6bb8f tempest-ProjectReaderTests-745542355 None] Created reservations ['48065b60-9c86-4053-b585-4b9fa1280f76', '52d5af38-e6e9-424e-86b6-120a4a2887a8', '83099aff-21af-45b9-b40c-06548b6002e1', 'bf9beb70-cd9b-41f8-8269-cdef13ff498b'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:30:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d3c850ea-0e65-4b8a-ba1f-cd472de6bb8f tempest-ProjectReaderTests-745542355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:30:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d3c850ea-0e65-4b8a-ba1f-cd472de6bb8f tempest-ProjectReaderTests-745542355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:30:59 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d3c850ea-0e65-4b8a-ba1f-cd472de6bb8f tempest-ProjectReaderTests-745542355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:30:59 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-d3c850ea-0e65-4b8a-ba1f-cd472de6bb8f tempest-ProjectReaderTests-745542355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:30:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d3c850ea-0e65-4b8a-ba1f-cd472de6bb8f tempest-ProjectReaderTests-745542355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:30:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d3c850ea-0e65-4b8a-ba1f-cd472de6bb8f tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:30:59 devstack sudo[108320]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:30:59 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:30:59 devstack sudo[108318]: pam_unix(sudo:session): session closed for user root
Nov 04 12:30:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d99746e7-8d8f-4dd0-9c5f-7935a684c8f5 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364.info" returned: 0 in 0.250s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:30:59 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-d99746e7-8d8f-4dd0-9c5f-7935a684c8f5 tempest-ProjectMemberTests-782019947 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364.info is being set with open permissions: ugo+rw
Nov 04 12:30:59 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d99746e7-8d8f-4dd0-9c5f-7935a684c8f5 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:00 devstack sudo[108323]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364.info
Nov 04 12:31:00 devstack sudo[108323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:00 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d3c850ea-0e65-4b8a-ba1f-cd472de6bb8f tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.260s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:00 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-d3c850ea-0e65-4b8a-ba1f-cd472de6bb8f tempest-ProjectReaderTests-745542355 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:31:00 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-d3c850ea-0e65-4b8a-ba1f-cd472de6bb8f tempest-ProjectReaderTests-745542355 None] Deleted volume successfully.
Nov 04 12:31:00 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d3c850ea-0e65-4b8a-ba1f-cd472de6bb8f tempest-ProjectReaderTests-745542355 None] Lock "cinder-359da600-3b2b-4542-9469-c1b414fb7dc6-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:31:00 devstack sudo[108323]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d99746e7-8d8f-4dd0-9c5f-7935a684c8f5 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364.info" returned: 0 in 0.265s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-d99746e7-8d8f-4dd0-9c5f-7935a684c8f5 tempest-ProjectMemberTests-782019947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.032s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:31:00 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-d99746e7-8d8f-4dd0-9c5f-7935a684c8f5 tempest-ProjectMemberTests-782019947 None] Create snapshot completed successfully
Nov 04 12:31:00 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-456ec91a-90c6-4e8c-b10f-5f63252389ea tempest-ProjectReaderTests-745542355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:31:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-456ec91a-90c6-4e8c-b10f-5f63252389ea tempest-ProjectReaderTests-745542355 None] Flow 'volume_create_manager' (7ea6d096-5ca4-4444-8f54-27d516112176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:31:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-456ec91a-90c6-4e8c-b10f-5f63252389ea tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e556ffd7-5a78-4a52-95e0-7da70c9dda7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-456ec91a-90c6-4e8c-b10f-5f63252389ea tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e556ffd7-5a78-4a52-95e0-7da70c9dda7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-183848235',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a2851a0-3379-4360-9e60-ee3802fd4b63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='324f832ed91d41c5891b98855382e88b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:31:00Z,use_quota=True,user_id='c72534133ab0445ca0b45d95d7c20347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-456ec91a-90c6-4e8c-b10f-5f63252389ea tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daf3cdd1-3559-44a8-a955-efbe7eb5a546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-456ec91a-90c6-4e8c-b10f-5f63252389ea tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daf3cdd1-3559-44a8-a955-efbe7eb5a546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-456ec91a-90c6-4e8c-b10f-5f63252389ea tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74b51ccc-060e-480c-ad8c-e024739ff39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-456ec91a-90c6-4e8c-b10f-5f63252389ea tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74b51ccc-060e-480c-ad8c-e024739ff39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a2851a0-3379-4360-9e60-ee3802fd4b63', 'volume_name': 'volume-8a2851a0-3379-4360-9e60-ee3802fd4b63', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-456ec91a-90c6-4e8c-b10f-5f63252389ea tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (503cfb7c-edce-4977-8f3d-ca19f29a9ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-456ec91a-90c6-4e8c-b10f-5f63252389ea tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (503cfb7c-edce-4977-8f3d-ca19f29a9ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:00 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-456ec91a-90c6-4e8c-b10f-5f63252389ea tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6740d778-a578-40bc-ba41-1b9452e5409f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:00 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-456ec91a-90c6-4e8c-b10f-5f63252389ea tempest-ProjectReaderTests-745542355 None] Volume 8a2851a0-3379-4360-9e60-ee3802fd4b63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a2851a0-3379-4360-9e60-ee3802fd4b63', 'volume_size': 1}
Nov 04 12:31:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-456ec91a-90c6-4e8c-b10f-5f63252389ea tempest-ProjectReaderTests-745542355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:31:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-456ec91a-90c6-4e8c-b10f-5f63252389ea tempest-ProjectReaderTests-745542355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:31:00 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-456ec91a-90c6-4e8c-b10f-5f63252389ea tempest-ProjectReaderTests-745542355 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-183848235',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a2851a0-3379-4360-9e60-ee3802fd4b63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='324f832ed91d41c5891b98855382e88b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:31:00Z,use_quota=True,user_id='c72534133ab0445ca0b45d95d7c20347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:31:00 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-456ec91a-90c6-4e8c-b10f-5f63252389ea tempest-ProjectReaderTests-745542355 None] Creating volume 8a2851a0-3379-4360-9e60-ee3802fd4b63 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:31:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-456ec91a-90c6-4e8c-b10f-5f63252389ea tempest-ProjectReaderTests-745542355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:31:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-456ec91a-90c6-4e8c-b10f-5f63252389ea tempest-ProjectReaderTests-745542355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:31:00 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-456ec91a-90c6-4e8c-b10f-5f63252389ea tempest-ProjectReaderTests-745542355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:31:00 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-456ec91a-90c6-4e8c-b10f-5f63252389ea tempest-ProjectReaderTests-745542355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:31:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-456ec91a-90c6-4e8c-b10f-5f63252389ea tempest-ProjectReaderTests-745542355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:31:00 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-456ec91a-90c6-4e8c-b10f-5f63252389ea tempest-ProjectReaderTests-745542355 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:31:00 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-456ec91a-90c6-4e8c-b10f-5f63252389ea tempest-ProjectReaderTests-745542355 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:31:00 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-456ec91a-90c6-4e8c-b10f-5f63252389ea tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:00 devstack sudo[108327]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63 1073741824
Nov 04 12:31:00 devstack sudo[108327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:01 devstack sudo[108327]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-456ec91a-90c6-4e8c-b10f-5f63252389ea tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63 1073741824" returned: 0 in 0.394s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-456ec91a-90c6-4e8c-b10f-5f63252389ea tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:01 devstack sudo[108332]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63
Nov 04 12:31:01 devstack sudo[108332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:01 devstack sudo[108332]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-456ec91a-90c6-4e8c-b10f-5f63252389ea tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63" returned: 0 in 0.237s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:01 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-456ec91a-90c6-4e8c-b10f-5f63252389ea tempest-ProjectReaderTests-745542355 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:31:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-456ec91a-90c6-4e8c-b10f-5f63252389ea tempest-ProjectReaderTests-745542355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.677s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:31:01 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-456ec91a-90c6-4e8c-b10f-5f63252389ea tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6740d778-a578-40bc-ba41-1b9452e5409f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a2851a0-3379-4360-9e60-ee3802fd4b63', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:01 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-456ec91a-90c6-4e8c-b10f-5f63252389ea tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd51c625-3023-4c23-a083-6f00121079a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:01 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-456ec91a-90c6-4e8c-b10f-5f63252389ea tempest-ProjectReaderTests-745542355 None] Volume volume-8a2851a0-3379-4360-9e60-ee3802fd4b63 (8a2851a0-3379-4360-9e60-ee3802fd4b63): created successfully
Nov 04 12:31:01 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-456ec91a-90c6-4e8c-b10f-5f63252389ea tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd51c625-3023-4c23-a083-6f00121079a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:01 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-456ec91a-90c6-4e8c-b10f-5f63252389ea tempest-ProjectReaderTests-745542355 None] Flow 'volume_create_manager' (7ea6d096-5ca4-4444-8f54-27d516112176) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:31:01 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-456ec91a-90c6-4e8c-b10f-5f63252389ea tempest-ProjectReaderTests-745542355 None] Created volume successfully.
Nov 04 12:31:01 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ebe67032-8dd7-4bb0-b603-a52b7e85bbc5 tempest-ProjectMemberTests-782019947 None] Acquiring lock "cinder-d32661eb-356e-4536-89bd-b8ccc043ad18-delete_snapshot" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:31:01 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ebe67032-8dd7-4bb0-b603-a52b7e85bbc5 tempest-ProjectMemberTests-782019947 None] Lock "cinder-d32661eb-356e-4536-89bd-b8ccc043ad18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:31:01 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ebe67032-8dd7-4bb0-b603-a52b7e85bbc5 tempest-ProjectMemberTests-782019947 None] Acquiring lock "cinder-quobyte-113f49bc-a1f5-4601-ad7c-044496ffc364" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:31:01 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ebe67032-8dd7-4bb0-b603-a52b7e85bbc5 tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-113f49bc-a1f5-4601-ad7c-044496ffc364" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:31:01 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ebe67032-8dd7-4bb0-b603-a52b7e85bbc5 tempest-ProjectMemberTests-782019947 None] Acquiring lock "cinder-quobyte-d32661eb-356e-4536-89bd-b8ccc043ad18" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:31:01 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ebe67032-8dd7-4bb0-b603-a52b7e85bbc5 tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-d32661eb-356e-4536-89bd-b8ccc043ad18" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:31:01 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-ebe67032-8dd7-4bb0-b603-a52b7e85bbc5 tempest-ProjectMemberTests-782019947 None] Deleting offline snapshot d32661eb-356e-4536-89bd-b8ccc043ad18 of volume 113f49bc-a1f5-4601-ad7c-044496ffc364 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:31:01 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-ebe67032-8dd7-4bb0-b603-a52b7e85bbc5 tempest-ProjectMemberTests-782019947 None] snapshot_file for this snap is: volume-113f49bc-a1f5-4601-ad7c-044496ffc364.d32661eb-356e-4536-89bd-b8ccc043ad18 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:31:01 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[fff171c1-9f0c-488d-9113-669103cd8e41]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:31:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ebe67032-8dd7-4bb0-b603-a52b7e85bbc5 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364.d32661eb-356e-4536-89bd-b8ccc043ad18 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:01 devstack sudo[108335]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364.d32661eb-356e-4536-89bd-b8ccc043ad18
Nov 04 12:31:01 devstack sudo[108335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-aeaebb06-fd73-4058-8c4d-f118cfce931b tempest-ProjectReaderTests-745542355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:31:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-aeaebb06-fd73-4058-8c4d-f118cfce931b tempest-ProjectReaderTests-745542355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:31:01 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-aeaebb06-fd73-4058-8c4d-f118cfce931b tempest-ProjectReaderTests-745542355 None] Creating offline snapshot 8e006365-9f2b-497f-970b-94aef1b5872e of volume 8a2851a0-3379-4360-9e60-ee3802fd4b63 {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:31:01 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa32dcfe-5a48-457d-ad77-136e6de80903]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:31:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-aeaebb06-fd73-4058-8c4d-f118cfce931b tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:01 devstack sudo[108335]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ebe67032-8dd7-4bb0-b603-a52b7e85bbc5 tempest-ProjectMemberTests-782019947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364.d32661eb-356e-4536-89bd-b8ccc043ad18" returned: 0 in 0.379s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:01 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-ebe67032-8dd7-4bb0-b603-a52b7e85bbc5 tempest-ProjectMemberTests-782019947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-113f49bc-a1f5-4601-ad7c-044496ffc364(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:31:01 devstack sudo[108338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63
Nov 04 12:31:01 devstack sudo[108338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:01 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d98a044-122e-4cf9-aad3-f7ed97576b30]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:31:01 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ebe67032-8dd7-4bb0-b603-a52b7e85bbc5 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:02 devstack sudo[108343]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364
Nov 04 12:31:02 devstack sudo[108343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:02 devstack sudo[108338]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-aeaebb06-fd73-4058-8c4d-f118cfce931b tempest-ProjectReaderTests-745542355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63" returned: 0 in 0.366s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-aeaebb06-fd73-4058-8c4d-f118cfce931b tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63.8e006365-9f2b-497f-970b-94aef1b5872e 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:02 devstack sudo[108348]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63.8e006365-9f2b-497f-970b-94aef1b5872e 1G
Nov 04 12:31:02 devstack sudo[108348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:02 devstack sudo[108343]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ebe67032-8dd7-4bb0-b603-a52b7e85bbc5 tempest-ProjectMemberTests-782019947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364" returned: 0 in 0.354s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ebe67032-8dd7-4bb0-b603-a52b7e85bbc5 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364.d32661eb-356e-4536-89bd-b8ccc043ad18 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:02 devstack sudo[108353]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364.d32661eb-356e-4536-89bd-b8ccc043ad18
Nov 04 12:31:02 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:02 devstack sudo[108348]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-aeaebb06-fd73-4058-8c4d-f118cfce931b tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63.8e006365-9f2b-497f-970b-94aef1b5872e 1G" returned: 0 in 0.404s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-aeaebb06-fd73-4058-8c4d-f118cfce931b tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a2851a0-3379-4360-9e60-ee3802fd4b63 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63.8e006365-9f2b-497f-970b-94aef1b5872e {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:02 devstack sudo[108362]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a2851a0-3379-4360-9e60-ee3802fd4b63 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63.8e006365-9f2b-497f-970b-94aef1b5872e
Nov 04 12:31:02 devstack sudo[108362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:02 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ebe67032-8dd7-4bb0-b603-a52b7e85bbc5 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364.d32661eb-356e-4536-89bd-b8ccc043ad18" returned: 0 in 0.338s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ebe67032-8dd7-4bb0-b603-a52b7e85bbc5 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364.d32661eb-356e-4536-89bd-b8ccc043ad18 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:02 devstack sudo[108364]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364.d32661eb-356e-4536-89bd-b8ccc043ad18
Nov 04 12:31:02 devstack sudo[108364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:02 devstack sudo[108362]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-aeaebb06-fd73-4058-8c4d-f118cfce931b tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a2851a0-3379-4360-9e60-ee3802fd4b63 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63.8e006365-9f2b-497f-970b-94aef1b5872e" returned: 0 in 0.285s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:02 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-aeaebb06-fd73-4058-8c4d-f118cfce931b tempest-ProjectReaderTests-745542355 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63.8e006365-9f2b-497f-970b-94aef1b5872e is being set with open permissions: ugo+rw
Nov 04 12:31:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-aeaebb06-fd73-4058-8c4d-f118cfce931b tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63.8e006365-9f2b-497f-970b-94aef1b5872e {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:02 devstack sudo[108364]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:02 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ebe67032-8dd7-4bb0-b603-a52b7e85bbc5 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364.d32661eb-356e-4536-89bd-b8ccc043ad18" returned: 0 in 0.251s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:02 devstack sudo[108370]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63.8e006365-9f2b-497f-970b-94aef1b5872e
Nov 04 12:31:02 devstack sudo[108370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:02 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ebe67032-8dd7-4bb0-b603-a52b7e85bbc5 tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-d32661eb-356e-4536-89bd-b8ccc043ad18" released by "_delete_snapshot" :: held 1.440s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:31:02 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ebe67032-8dd7-4bb0-b603-a52b7e85bbc5 tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-113f49bc-a1f5-4601-ad7c-044496ffc364" released by "delete_snapshot" :: held 1.463s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:31:02 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-ebe67032-8dd7-4bb0-b603-a52b7e85bbc5 tempest-ProjectMemberTests-782019947 None] Created reservations ['a1521db5-a675-41b5-89af-57d2830d198a', 'cc781437-6e9e-44d8-8e23-c6997f5454f2', 'cca59a9f-d88b-4a2a-8285-a49af97f1a43', 'aeb1614a-63ce-4d25-9ada-fc7b045118cc'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:31:02 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-ebe67032-8dd7-4bb0-b603-a52b7e85bbc5 tempest-ProjectMemberTests-782019947 None] Delete snapshot completed successfully.
Nov 04 12:31:03 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-ebe67032-8dd7-4bb0-b603-a52b7e85bbc5 tempest-ProjectMemberTests-782019947 None] Lock "cinder-d32661eb-356e-4536-89bd-b8ccc043ad18-delete_snapshot" released by "delete_snapshot" :: held 1.591s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:31:03 devstack sudo[108370]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-aeaebb06-fd73-4058-8c4d-f118cfce931b tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63.8e006365-9f2b-497f-970b-94aef1b5872e" returned: 0 in 0.250s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-aeaebb06-fd73-4058-8c4d-f118cfce931b tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:03 devstack sudo[108373]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63.info
Nov 04 12:31:03 devstack sudo[108373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:03 devstack sudo[108373]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-aeaebb06-fd73-4058-8c4d-f118cfce931b tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63.info" returned: 0 in 0.237s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:03 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-aeaebb06-fd73-4058-8c4d-f118cfce931b tempest-ProjectReaderTests-745542355 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63.info is being set with open permissions: ugo+rw
Nov 04 12:31:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-aeaebb06-fd73-4058-8c4d-f118cfce931b tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:03 devstack sudo[108376]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63.info
Nov 04 12:31:03 devstack sudo[108376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:03 devstack sudo[108376]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-aeaebb06-fd73-4058-8c4d-f118cfce931b tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63.info" returned: 0 in 0.242s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-aeaebb06-fd73-4058-8c4d-f118cfce931b tempest-ProjectReaderTests-745542355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.880s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:31:03 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fc0dd88e-2601-4daa-8b9b-09a3e1ea6bfa tempest-ProjectMemberTests-782019947 None] Acquiring lock "cinder-113f49bc-a1f5-4601-ad7c-044496ffc364-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:31:03 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fc0dd88e-2601-4daa-8b9b-09a3e1ea6bfa tempest-ProjectMemberTests-782019947 None] Lock "cinder-113f49bc-a1f5-4601-ad7c-044496ffc364-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:31:03 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-aeaebb06-fd73-4058-8c4d-f118cfce931b tempest-ProjectReaderTests-745542355 None] Create snapshot completed successfully
Nov 04 12:31:03 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fc0dd88e-2601-4daa-8b9b-09a3e1ea6bfa tempest-ProjectMemberTests-782019947 None] Acquiring lock "cinder-quobyte-113f49bc-a1f5-4601-ad7c-044496ffc364" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:31:03 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fc0dd88e-2601-4daa-8b9b-09a3e1ea6bfa tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-113f49bc-a1f5-4601-ad7c-044496ffc364" acquired by "delete_volume" :: waited 0.015s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:31:03 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac2d7b5-11a8-4928-a1ca-dbbcb75d7f05]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:31:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fc0dd88e-2601-4daa-8b9b-09a3e1ea6bfa tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:03 devstack sudo[108379]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364
Nov 04 12:31:03 devstack sudo[108379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:03 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-18923ec1-489b-4e3e-bd96-3110b11d829a tempest-ProjectReaderTests-745542355 None] Acquiring lock "cinder-8e006365-9f2b-497f-970b-94aef1b5872e-delete_snapshot" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:31:03 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-18923ec1-489b-4e3e-bd96-3110b11d829a tempest-ProjectReaderTests-745542355 None] Lock "cinder-8e006365-9f2b-497f-970b-94aef1b5872e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:31:03 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-18923ec1-489b-4e3e-bd96-3110b11d829a tempest-ProjectReaderTests-745542355 None] Acquiring lock "cinder-quobyte-8a2851a0-3379-4360-9e60-ee3802fd4b63" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:31:03 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-18923ec1-489b-4e3e-bd96-3110b11d829a tempest-ProjectReaderTests-745542355 None] Lock "cinder-quobyte-8a2851a0-3379-4360-9e60-ee3802fd4b63" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:31:03 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-18923ec1-489b-4e3e-bd96-3110b11d829a tempest-ProjectReaderTests-745542355 None] Acquiring lock "cinder-quobyte-8e006365-9f2b-497f-970b-94aef1b5872e" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:31:03 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-18923ec1-489b-4e3e-bd96-3110b11d829a tempest-ProjectReaderTests-745542355 None] Lock "cinder-quobyte-8e006365-9f2b-497f-970b-94aef1b5872e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:31:03 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-18923ec1-489b-4e3e-bd96-3110b11d829a tempest-ProjectReaderTests-745542355 None] Deleting offline snapshot 8e006365-9f2b-497f-970b-94aef1b5872e of volume 8a2851a0-3379-4360-9e60-ee3802fd4b63 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:31:03 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-18923ec1-489b-4e3e-bd96-3110b11d829a tempest-ProjectReaderTests-745542355 None] snapshot_file for this snap is: volume-8a2851a0-3379-4360-9e60-ee3802fd4b63.8e006365-9f2b-497f-970b-94aef1b5872e {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:31:03 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[cacbd857-363d-43f3-8e05-d435d523e16e]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:31:03 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-18923ec1-489b-4e3e-bd96-3110b11d829a tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63.8e006365-9f2b-497f-970b-94aef1b5872e {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:04 devstack sudo[108381]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63.8e006365-9f2b-497f-970b-94aef1b5872e
Nov 04 12:31:04 devstack sudo[108381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:04 devstack sudo[108379]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fc0dd88e-2601-4daa-8b9b-09a3e1ea6bfa tempest-ProjectMemberTests-782019947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364" returned: 0 in 0.399s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fc0dd88e-2601-4daa-8b9b-09a3e1ea6bfa tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:04 devstack sudo[108386]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364
Nov 04 12:31:04 devstack sudo[108386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:04 devstack sudo[108381]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-18923ec1-489b-4e3e-bd96-3110b11d829a tempest-ProjectReaderTests-745542355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63.8e006365-9f2b-497f-970b-94aef1b5872e" returned: 0 in 0.367s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:04 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-18923ec1-489b-4e3e-bd96-3110b11d829a tempest-ProjectReaderTests-745542355 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a2851a0-3379-4360-9e60-ee3802fd4b63(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:31:04 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb1e702-2289-4a1c-ae28-864db32f7c00]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:31:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-18923ec1-489b-4e3e-bd96-3110b11d829a tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:04 devstack sudo[108386]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fc0dd88e-2601-4daa-8b9b-09a3e1ea6bfa tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-113f49bc-a1f5-4601-ad7c-044496ffc364" returned: 0 in 0.260s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:04 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fc0dd88e-2601-4daa-8b9b-09a3e1ea6bfa tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-113f49bc-a1f5-4601-ad7c-044496ffc364" released by "delete_volume" :: held 0.718s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:31:04 devstack sudo[108391]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63
Nov 04 12:31:04 devstack sudo[108391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:04 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-fc0dd88e-2601-4daa-8b9b-09a3e1ea6bfa tempest-ProjectMemberTests-782019947 None] Created reservations ['b5e89b08-d1c0-431f-b4bd-9dd28d540e80', 'ded632c4-08de-468a-9b66-fa3d030f5342', 'a6e4dec2-d5ed-4ffe-afce-d7127cfeef15', '685a3960-7323-4582-a78a-6ae030161577'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:31:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-fc0dd88e-2601-4daa-8b9b-09a3e1ea6bfa tempest-ProjectMemberTests-782019947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:31:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-fc0dd88e-2601-4daa-8b9b-09a3e1ea6bfa tempest-ProjectMemberTests-782019947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:31:04 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-fc0dd88e-2601-4daa-8b9b-09a3e1ea6bfa tempest-ProjectMemberTests-782019947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:31:04 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-fc0dd88e-2601-4daa-8b9b-09a3e1ea6bfa tempest-ProjectMemberTests-782019947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:31:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-fc0dd88e-2601-4daa-8b9b-09a3e1ea6bfa tempest-ProjectMemberTests-782019947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:31:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fc0dd88e-2601-4daa-8b9b-09a3e1ea6bfa tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:04 devstack sudo[108394]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:31:04 devstack sudo[108394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:04 devstack sudo[108391]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-18923ec1-489b-4e3e-bd96-3110b11d829a tempest-ProjectReaderTests-745542355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63" returned: 0 in 0.384s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-18923ec1-489b-4e3e-bd96-3110b11d829a tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63.8e006365-9f2b-497f-970b-94aef1b5872e {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:04 devstack sudo[108399]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63.8e006365-9f2b-497f-970b-94aef1b5872e
Nov 04 12:31:04 devstack sudo[108399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:04 devstack sudo[108394]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:04 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-fc0dd88e-2601-4daa-8b9b-09a3e1ea6bfa tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.261s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:04 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-fc0dd88e-2601-4daa-8b9b-09a3e1ea6bfa tempest-ProjectMemberTests-782019947 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:31:04 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-fc0dd88e-2601-4daa-8b9b-09a3e1ea6bfa tempest-ProjectMemberTests-782019947 None] Deleted volume successfully.
Nov 04 12:31:04 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-fc0dd88e-2601-4daa-8b9b-09a3e1ea6bfa tempest-ProjectMemberTests-782019947 None] Lock "cinder-113f49bc-a1f5-4601-ad7c-044496ffc364-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:31:05 devstack sudo[108399]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-18923ec1-489b-4e3e-bd96-3110b11d829a tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63.8e006365-9f2b-497f-970b-94aef1b5872e" returned: 0 in 0.376s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-18923ec1-489b-4e3e-bd96-3110b11d829a tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63.8e006365-9f2b-497f-970b-94aef1b5872e {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:05 devstack sudo[108405]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63.8e006365-9f2b-497f-970b-94aef1b5872e
Nov 04 12:31:05 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:05 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-b460ce45-b65a-4851-bb04-a84a2d672e28 tempest-ProjectMemberTests-782019947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:31:05 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b460ce45-b65a-4851-bb04-a84a2d672e28 tempest-ProjectMemberTests-782019947 None] Flow 'volume_create_manager' (620c5d6f-af3d-4e54-9f75-af3f1818d80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:31:05 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b460ce45-b65a-4851-bb04-a84a2d672e28 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6b0a698-1aa4-487a-91dc-4bdbe806108e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:05 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b460ce45-b65a-4851-bb04-a84a2d672e28 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6b0a698-1aa4-487a-91dc-4bdbe806108e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:31:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-106580483',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4428db37-2689-48c9-a2a9-c02943cf6aa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5a80a035d04be496795229f2e16378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:31:05Z,use_quota=True,user_id='4f258b2e50a741e4b75bd5ecf8d3039a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:05 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b460ce45-b65a-4851-bb04-a84a2d672e28 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731574ee-b03c-43b0-991e-aec88c843003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:05 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b460ce45-b65a-4851-bb04-a84a2d672e28 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731574ee-b03c-43b0-991e-aec88c843003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:05 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b460ce45-b65a-4851-bb04-a84a2d672e28 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ca22999-04d5-433c-8af7-7c6d507b8b6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:05 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b460ce45-b65a-4851-bb04-a84a2d672e28 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ca22999-04d5-433c-8af7-7c6d507b8b6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4428db37-2689-48c9-a2a9-c02943cf6aa1', 'volume_name': 'volume-4428db37-2689-48c9-a2a9-c02943cf6aa1', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:05 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b460ce45-b65a-4851-bb04-a84a2d672e28 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fae7d20-aff0-474e-bab8-04aa90c11d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:05 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b460ce45-b65a-4851-bb04-a84a2d672e28 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fae7d20-aff0-474e-bab8-04aa90c11d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:05 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b460ce45-b65a-4851-bb04-a84a2d672e28 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (582257e5-2fd6-474c-a914-d846329c88ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:05 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-b460ce45-b65a-4851-bb04-a84a2d672e28 tempest-ProjectMemberTests-782019947 None] Volume 4428db37-2689-48c9-a2a9-c02943cf6aa1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4428db37-2689-48c9-a2a9-c02943cf6aa1', 'volume_size': 1}
Nov 04 12:31:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b460ce45-b65a-4851-bb04-a84a2d672e28 tempest-ProjectMemberTests-782019947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:31:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b460ce45-b65a-4851-bb04-a84a2d672e28 tempest-ProjectMemberTests-782019947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:31:05 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-b460ce45-b65a-4851-bb04-a84a2d672e28 tempest-ProjectMemberTests-782019947 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:31:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-106580483',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4428db37-2689-48c9-a2a9-c02943cf6aa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5a80a035d04be496795229f2e16378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:31:05Z,use_quota=True,user_id='4f258b2e50a741e4b75bd5ecf8d3039a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:31:05 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-b460ce45-b65a-4851-bb04-a84a2d672e28 tempest-ProjectMemberTests-782019947 None] Creating volume 4428db37-2689-48c9-a2a9-c02943cf6aa1 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:31:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b460ce45-b65a-4851-bb04-a84a2d672e28 tempest-ProjectMemberTests-782019947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:31:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b460ce45-b65a-4851-bb04-a84a2d672e28 tempest-ProjectMemberTests-782019947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:31:05 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-b460ce45-b65a-4851-bb04-a84a2d672e28 tempest-ProjectMemberTests-782019947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:31:05 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-b460ce45-b65a-4851-bb04-a84a2d672e28 tempest-ProjectMemberTests-782019947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:31:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b460ce45-b65a-4851-bb04-a84a2d672e28 tempest-ProjectMemberTests-782019947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:31:05 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-b460ce45-b65a-4851-bb04-a84a2d672e28 tempest-ProjectMemberTests-782019947 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:31:05 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-b460ce45-b65a-4851-bb04-a84a2d672e28 tempest-ProjectMemberTests-782019947 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:31:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b460ce45-b65a-4851-bb04-a84a2d672e28 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:05 devstack sudo[108408]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1 1073741824
Nov 04 12:31:05 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:05 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-18923ec1-489b-4e3e-bd96-3110b11d829a tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63.8e006365-9f2b-497f-970b-94aef1b5872e" returned: 0 in 0.250s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:05 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-18923ec1-489b-4e3e-bd96-3110b11d829a tempest-ProjectReaderTests-745542355 None] Lock "cinder-quobyte-8e006365-9f2b-497f-970b-94aef1b5872e" released by "_delete_snapshot" :: held 1.484s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:31:05 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-18923ec1-489b-4e3e-bd96-3110b11d829a tempest-ProjectReaderTests-745542355 None] Lock "cinder-quobyte-8a2851a0-3379-4360-9e60-ee3802fd4b63" released by "delete_snapshot" :: held 1.507s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:31:05 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-18923ec1-489b-4e3e-bd96-3110b11d829a tempest-ProjectReaderTests-745542355 None] Created reservations ['b4f9f00f-948a-4a88-8f85-318b7416c7f7', '4affff66-86a2-4dfe-9c94-c383a3bde77a', '473f39c4-b7f6-4ed9-a4f1-51ac86d5454b', '5e846aea-842f-4606-8133-2c1222d1b2df'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:31:05 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-18923ec1-489b-4e3e-bd96-3110b11d829a tempest-ProjectReaderTests-745542355 None] Delete snapshot completed successfully.
Nov 04 12:31:05 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-18923ec1-489b-4e3e-bd96-3110b11d829a tempest-ProjectReaderTests-745542355 None] Lock "cinder-8e006365-9f2b-497f-970b-94aef1b5872e-delete_snapshot" released by "delete_snapshot" :: held 1.641s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:31:05 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b460ce45-b65a-4851-bb04-a84a2d672e28 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1 1073741824" returned: 0 in 0.435s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:05 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b460ce45-b65a-4851-bb04-a84a2d672e28 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:05 devstack sudo[108413]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1
Nov 04 12:31:05 devstack sudo[108413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:06 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-8faf4c81-c668-4091-acac-b5134ecd0ab6 tempest-ProjectReaderTests-745542355 None] Acquiring lock "cinder-8a2851a0-3379-4360-9e60-ee3802fd4b63-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:31:06 devstack sudo[108413]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-b460ce45-b65a-4851-bb04-a84a2d672e28 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1" returned: 0 in 0.258s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:06 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-b460ce45-b65a-4851-bb04-a84a2d672e28 tempest-ProjectMemberTests-782019947 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:31:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-b460ce45-b65a-4851-bb04-a84a2d672e28 tempest-ProjectMemberTests-782019947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:31:06 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-8faf4c81-c668-4091-acac-b5134ecd0ab6 tempest-ProjectReaderTests-745542355 None] Lock "cinder-8a2851a0-3379-4360-9e60-ee3802fd4b63-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:31:06 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b460ce45-b65a-4851-bb04-a84a2d672e28 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (582257e5-2fd6-474c-a914-d846329c88ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4428db37-2689-48c9-a2a9-c02943cf6aa1', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:06 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b460ce45-b65a-4851-bb04-a84a2d672e28 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6cf0734-5589-4201-9d29-34660caa0e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:06 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-b460ce45-b65a-4851-bb04-a84a2d672e28 tempest-ProjectMemberTests-782019947 None] Volume volume-4428db37-2689-48c9-a2a9-c02943cf6aa1 (4428db37-2689-48c9-a2a9-c02943cf6aa1): created successfully
Nov 04 12:31:06 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b460ce45-b65a-4851-bb04-a84a2d672e28 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6cf0734-5589-4201-9d29-34660caa0e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:06 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-b460ce45-b65a-4851-bb04-a84a2d672e28 tempest-ProjectMemberTests-782019947 None] Flow 'volume_create_manager' (620c5d6f-af3d-4e54-9f75-af3f1818d80a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:31:06 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-8faf4c81-c668-4091-acac-b5134ecd0ab6 tempest-ProjectReaderTests-745542355 None] Acquiring lock "cinder-quobyte-8a2851a0-3379-4360-9e60-ee3802fd4b63" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:31:06 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-b460ce45-b65a-4851-bb04-a84a2d672e28 tempest-ProjectMemberTests-782019947 None] Created volume successfully.
Nov 04 12:31:06 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-8faf4c81-c668-4091-acac-b5134ecd0ab6 tempest-ProjectReaderTests-745542355 None] Lock "cinder-quobyte-8a2851a0-3379-4360-9e60-ee3802fd4b63" acquired by "delete_volume" :: waited 0.022s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:31:06 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[62756bd1-8151-4467-b7b4-0efcb5f1a145]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:31:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8faf4c81-c668-4091-acac-b5134ecd0ab6 tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:06 devstack sudo[108416]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63
Nov 04 12:31:06 devstack sudo[108416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-54274ab6-1908-4523-a4b5-6ad53db6d12e tempest-ProjectMemberTests-782019947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:31:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-54274ab6-1908-4523-a4b5-6ad53db6d12e tempest-ProjectMemberTests-782019947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:31:06 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-54274ab6-1908-4523-a4b5-6ad53db6d12e tempest-ProjectMemberTests-782019947 None] Creating offline snapshot 11562f91-2fd5-4de7-b67d-79cc644537f6 of volume 4428db37-2689-48c9-a2a9-c02943cf6aa1 {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:31:06 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4f8bbe-4cf3-4eb7-b36c-a6721718e88c]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:31:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-54274ab6-1908-4523-a4b5-6ad53db6d12e tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:06 devstack sudo[108418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1
Nov 04 12:31:06 devstack sudo[108418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:06 devstack sudo[108416]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8faf4c81-c668-4091-acac-b5134ecd0ab6 tempest-ProjectReaderTests-745542355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63" returned: 0 in 0.386s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8faf4c81-c668-4091-acac-b5134ecd0ab6 tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:06 devstack sudo[108423]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63
Nov 04 12:31:06 devstack sudo[108423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:06 devstack sudo[108418]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-54274ab6-1908-4523-a4b5-6ad53db6d12e tempest-ProjectMemberTests-782019947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1" returned: 0 in 0.368s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-54274ab6-1908-4523-a4b5-6ad53db6d12e tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1.11562f91-2fd5-4de7-b67d-79cc644537f6 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:06 devstack sudo[108429]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1.11562f91-2fd5-4de7-b67d-79cc644537f6 1G
Nov 04 12:31:06 devstack sudo[108429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:06 devstack sudo[108423]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8faf4c81-c668-4091-acac-b5134ecd0ab6 tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-8a2851a0-3379-4360-9e60-ee3802fd4b63" returned: 0 in 0.263s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:06 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-8faf4c81-c668-4091-acac-b5134ecd0ab6 tempest-ProjectReaderTests-745542355 None] Lock "cinder-quobyte-8a2851a0-3379-4360-9e60-ee3802fd4b63" released by "delete_volume" :: held 0.729s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:31:06 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-8faf4c81-c668-4091-acac-b5134ecd0ab6 tempest-ProjectReaderTests-745542355 None] Created reservations ['40c0256f-b222-4727-97c5-7d5edca22e79', 'a18b4e53-6306-4e35-bb80-ed3fecfc80af', '5ff448cb-f0e5-4309-8dff-9030ad31d9ad', '3f5a3e2b-92fa-41d8-9b35-d571611d91da'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:31:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8faf4c81-c668-4091-acac-b5134ecd0ab6 tempest-ProjectReaderTests-745542355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:31:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8faf4c81-c668-4091-acac-b5134ecd0ab6 tempest-ProjectReaderTests-745542355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:31:06 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-8faf4c81-c668-4091-acac-b5134ecd0ab6 tempest-ProjectReaderTests-745542355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:31:06 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-8faf4c81-c668-4091-acac-b5134ecd0ab6 tempest-ProjectReaderTests-745542355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:31:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-8faf4c81-c668-4091-acac-b5134ecd0ab6 tempest-ProjectReaderTests-745542355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:31:06 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8faf4c81-c668-4091-acac-b5134ecd0ab6 tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:06 devstack sudo[108431]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:31:06 devstack sudo[108431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:07 devstack sudo[108431]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-8faf4c81-c668-4091-acac-b5134ecd0ab6 tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.271s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:07 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-8faf4c81-c668-4091-acac-b5134ecd0ab6 tempest-ProjectReaderTests-745542355 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:31:07 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-8faf4c81-c668-4091-acac-b5134ecd0ab6 tempest-ProjectReaderTests-745542355 None] Deleted volume successfully.
Nov 04 12:31:07 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-8faf4c81-c668-4091-acac-b5134ecd0ab6 tempest-ProjectReaderTests-745542355 None] Lock "cinder-8a2851a0-3379-4360-9e60-ee3802fd4b63-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:31:07 devstack sudo[108429]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-54274ab6-1908-4523-a4b5-6ad53db6d12e tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1.11562f91-2fd5-4de7-b67d-79cc644537f6 1G" returned: 0 in 0.498s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-54274ab6-1908-4523-a4b5-6ad53db6d12e tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4428db37-2689-48c9-a2a9-c02943cf6aa1 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1.11562f91-2fd5-4de7-b67d-79cc644537f6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:07 devstack sudo[108437]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4428db37-2689-48c9-a2a9-c02943cf6aa1 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1.11562f91-2fd5-4de7-b67d-79cc644537f6
Nov 04 12:31:07 devstack sudo[108437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:07 devstack sudo[108437]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-54274ab6-1908-4523-a4b5-6ad53db6d12e tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4428db37-2689-48c9-a2a9-c02943cf6aa1 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1.11562f91-2fd5-4de7-b67d-79cc644537f6" returned: 0 in 0.325s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:07 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-54274ab6-1908-4523-a4b5-6ad53db6d12e tempest-ProjectMemberTests-782019947 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1.11562f91-2fd5-4de7-b67d-79cc644537f6 is being set with open permissions: ugo+rw
Nov 04 12:31:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-54274ab6-1908-4523-a4b5-6ad53db6d12e tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1.11562f91-2fd5-4de7-b67d-79cc644537f6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:07 devstack sudo[108442]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1.11562f91-2fd5-4de7-b67d-79cc644537f6
Nov 04 12:31:07 devstack sudo[108442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:07 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeaf13d1-c42a-4ea1-994e-c053e678e49d tempest-ProjectReaderTests-745542355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:31:07 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-aeaf13d1-c42a-4ea1-994e-c053e678e49d tempest-ProjectReaderTests-745542355 None] Flow 'volume_create_manager' (54feadca-d7ad-4cfc-aeb6-9d59bd40d2b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:31:07 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-aeaf13d1-c42a-4ea1-994e-c053e678e49d tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34db0cf2-447d-4ab0-92e0-66f7f7a1492f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:07 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-aeaf13d1-c42a-4ea1-994e-c053e678e49d tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34db0cf2-447d-4ab0-92e0-66f7f7a1492f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:31:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1653150830',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=435b68a0-3d86-4aa1-a24e-a08eec905ea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='324f832ed91d41c5891b98855382e88b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:31:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:31:08Z,use_quota=True,user_id='c72534133ab0445ca0b45d95d7c20347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:07 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-aeaf13d1-c42a-4ea1-994e-c053e678e49d tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c368910a-2f94-4e4f-aaf6-e09a19d348f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:07 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-aeaf13d1-c42a-4ea1-994e-c053e678e49d tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c368910a-2f94-4e4f-aaf6-e09a19d348f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:07 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-aeaf13d1-c42a-4ea1-994e-c053e678e49d tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3232dfb4-26c4-49f1-838e-8fde7e429d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:07 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-aeaf13d1-c42a-4ea1-994e-c053e678e49d tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3232dfb4-26c4-49f1-838e-8fde7e429d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '435b68a0-3d86-4aa1-a24e-a08eec905ea1', 'volume_name': 'volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:07 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-aeaf13d1-c42a-4ea1-994e-c053e678e49d tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (804b15e6-7399-4232-8060-34ca270b06bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:07 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-aeaf13d1-c42a-4ea1-994e-c053e678e49d tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (804b15e6-7399-4232-8060-34ca270b06bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:07 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-aeaf13d1-c42a-4ea1-994e-c053e678e49d tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95dbf513-d5f7-42d7-9e13-c6e4c26bb634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:07 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-aeaf13d1-c42a-4ea1-994e-c053e678e49d tempest-ProjectReaderTests-745542355 None] Volume 435b68a0-3d86-4aa1-a24e-a08eec905ea1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1', 'volume_size': 1}
Nov 04 12:31:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-aeaf13d1-c42a-4ea1-994e-c053e678e49d tempest-ProjectReaderTests-745542355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:31:07 devstack sudo[108442]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-54274ab6-1908-4523-a4b5-6ad53db6d12e tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1.11562f91-2fd5-4de7-b67d-79cc644537f6" returned: 0 in 0.239s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:07 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-54274ab6-1908-4523-a4b5-6ad53db6d12e tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:07 devstack sudo[108445]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1.info
Nov 04 12:31:07 devstack sudo[108445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:08 devstack sudo[108445]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-54274ab6-1908-4523-a4b5-6ad53db6d12e tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1.info" returned: 0 in 0.242s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:08 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-54274ab6-1908-4523-a4b5-6ad53db6d12e tempest-ProjectMemberTests-782019947 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1.info is being set with open permissions: ugo+rw
Nov 04 12:31:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-54274ab6-1908-4523-a4b5-6ad53db6d12e tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:08 devstack sudo[108448]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1.info
Nov 04 12:31:08 devstack sudo[108448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:08 devstack sudo[108448]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-54274ab6-1908-4523-a4b5-6ad53db6d12e tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1.info" returned: 0 in 0.236s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-54274ab6-1908-4523-a4b5-6ad53db6d12e tempest-ProjectMemberTests-782019947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.986s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:31:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-aeaf13d1-c42a-4ea1-994e-c053e678e49d tempest-ProjectReaderTests-745542355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.638s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:31:08 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-aeaf13d1-c42a-4ea1-994e-c053e678e49d tempest-ProjectReaderTests-745542355 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:31:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1653150830',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=435b68a0-3d86-4aa1-a24e-a08eec905ea1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='324f832ed91d41c5891b98855382e88b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:31:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:31:08Z,use_quota=True,user_id='c72534133ab0445ca0b45d95d7c20347',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:31:08 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-aeaf13d1-c42a-4ea1-994e-c053e678e49d tempest-ProjectReaderTests-745542355 None] Creating volume 435b68a0-3d86-4aa1-a24e-a08eec905ea1 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:31:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-aeaf13d1-c42a-4ea1-994e-c053e678e49d tempest-ProjectReaderTests-745542355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:31:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-aeaf13d1-c42a-4ea1-994e-c053e678e49d tempest-ProjectReaderTests-745542355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:31:08 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-aeaf13d1-c42a-4ea1-994e-c053e678e49d tempest-ProjectReaderTests-745542355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:31:08 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-aeaf13d1-c42a-4ea1-994e-c053e678e49d tempest-ProjectReaderTests-745542355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:31:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-aeaf13d1-c42a-4ea1-994e-c053e678e49d tempest-ProjectReaderTests-745542355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:31:08 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-aeaf13d1-c42a-4ea1-994e-c053e678e49d tempest-ProjectReaderTests-745542355 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:31:08 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-aeaf13d1-c42a-4ea1-994e-c053e678e49d tempest-ProjectReaderTests-745542355 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:31:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-aeaf13d1-c42a-4ea1-994e-c053e678e49d tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:08 devstack sudo[108451]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1 1073741824
Nov 04 12:31:08 devstack sudo[108451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:08 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-54274ab6-1908-4523-a4b5-6ad53db6d12e tempest-ProjectMemberTests-782019947 None] Create snapshot completed successfully
Nov 04 12:31:08 devstack sudo[108451]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-aeaf13d1-c42a-4ea1-994e-c053e678e49d tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1 1073741824" returned: 0 in 0.415s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:08 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-aeaf13d1-c42a-4ea1-994e-c053e678e49d tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:08 devstack sudo[108456]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1
Nov 04 12:31:08 devstack sudo[108456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:09 devstack sudo[108456]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-aeaf13d1-c42a-4ea1-994e-c053e678e49d tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1" returned: 0 in 0.245s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:09 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-aeaf13d1-c42a-4ea1-994e-c053e678e49d tempest-ProjectReaderTests-745542355 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:31:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-aeaf13d1-c42a-4ea1-994e-c053e678e49d tempest-ProjectReaderTests-745542355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:31:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-aeaf13d1-c42a-4ea1-994e-c053e678e49d tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95dbf513-d5f7-42d7-9e13-c6e4c26bb634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-aeaf13d1-c42a-4ea1-994e-c053e678e49d tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (797ed182-1c82-47ee-9dfc-b48df048963a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:09 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-aeaf13d1-c42a-4ea1-994e-c053e678e49d tempest-ProjectReaderTests-745542355 None] Volume volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1 (435b68a0-3d86-4aa1-a24e-a08eec905ea1): created successfully
Nov 04 12:31:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-aeaf13d1-c42a-4ea1-994e-c053e678e49d tempest-ProjectReaderTests-745542355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (797ed182-1c82-47ee-9dfc-b48df048963a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-aeaf13d1-c42a-4ea1-994e-c053e678e49d tempest-ProjectReaderTests-745542355 None] Flow 'volume_create_manager' (54feadca-d7ad-4cfc-aeb6-9d59bd40d2b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:31:09 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-aeaf13d1-c42a-4ea1-994e-c053e678e49d tempest-ProjectReaderTests-745542355 None] Created volume successfully.
Nov 04 12:31:09 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1afcc8be-31e0-4174-9138-fea5261923bb tempest-ProjectMemberTests-782019947 None] Acquiring lock "cinder-11562f91-2fd5-4de7-b67d-79cc644537f6-delete_snapshot" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:31:09 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1afcc8be-31e0-4174-9138-fea5261923bb tempest-ProjectMemberTests-782019947 None] Lock "cinder-11562f91-2fd5-4de7-b67d-79cc644537f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:31:09 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1afcc8be-31e0-4174-9138-fea5261923bb tempest-ProjectMemberTests-782019947 None] Acquiring lock "cinder-quobyte-4428db37-2689-48c9-a2a9-c02943cf6aa1" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:31:09 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1afcc8be-31e0-4174-9138-fea5261923bb tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-4428db37-2689-48c9-a2a9-c02943cf6aa1" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:31:09 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1afcc8be-31e0-4174-9138-fea5261923bb tempest-ProjectMemberTests-782019947 None] Acquiring lock "cinder-quobyte-11562f91-2fd5-4de7-b67d-79cc644537f6" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:31:09 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1afcc8be-31e0-4174-9138-fea5261923bb tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-11562f91-2fd5-4de7-b67d-79cc644537f6" acquired by "_delete_snapshot" :: waited 0.058s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:31:09 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-1afcc8be-31e0-4174-9138-fea5261923bb tempest-ProjectMemberTests-782019947 None] Deleting offline snapshot 11562f91-2fd5-4de7-b67d-79cc644537f6 of volume 4428db37-2689-48c9-a2a9-c02943cf6aa1 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:31:09 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-1afcc8be-31e0-4174-9138-fea5261923bb tempest-ProjectMemberTests-782019947 None] snapshot_file for this snap is: volume-4428db37-2689-48c9-a2a9-c02943cf6aa1.11562f91-2fd5-4de7-b67d-79cc644537f6 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:31:09 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[da904e2c-2703-4c88-909a-9fb0b80fd1a0]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:31:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1afcc8be-31e0-4174-9138-fea5261923bb tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1.11562f91-2fd5-4de7-b67d-79cc644537f6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:09 devstack sudo[108459]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1.11562f91-2fd5-4de7-b67d-79cc644537f6
Nov 04 12:31:09 devstack sudo[108459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1af4a63e-7b7b-42bb-bf4d-c6a1a45336b8 tempest-ProjectReaderTests-745542355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:31:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1af4a63e-7b7b-42bb-bf4d-c6a1a45336b8 tempest-ProjectReaderTests-745542355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:31:09 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-1af4a63e-7b7b-42bb-bf4d-c6a1a45336b8 tempest-ProjectReaderTests-745542355 None] Creating offline snapshot 93aeb90d-9e87-4131-9e02-d73ee893ffa4 of volume 435b68a0-3d86-4aa1-a24e-a08eec905ea1 {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:31:09 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d032551-6574-49a1-9994-4a3c1a5627b0]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:31:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1af4a63e-7b7b-42bb-bf4d-c6a1a45336b8 tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:10 devstack sudo[108461]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1
Nov 04 12:31:10 devstack sudo[108461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:10 devstack sudo[108459]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1afcc8be-31e0-4174-9138-fea5261923bb tempest-ProjectMemberTests-782019947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1.11562f91-2fd5-4de7-b67d-79cc644537f6" returned: 0 in 0.379s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:10 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-1afcc8be-31e0-4174-9138-fea5261923bb tempest-ProjectMemberTests-782019947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4428db37-2689-48c9-a2a9-c02943cf6aa1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:31:10 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4668a1-86f8-4681-953e-385ebb9df591]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:31:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1afcc8be-31e0-4174-9138-fea5261923bb tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:10 devstack sudo[108466]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1
Nov 04 12:31:10 devstack sudo[108466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:10 devstack sudo[108461]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1af4a63e-7b7b-42bb-bf4d-c6a1a45336b8 tempest-ProjectReaderTests-745542355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1" returned: 0 in 0.369s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1af4a63e-7b7b-42bb-bf4d-c6a1a45336b8 tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1.93aeb90d-9e87-4131-9e02-d73ee893ffa4 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:10 devstack sudo[108471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1.93aeb90d-9e87-4131-9e02-d73ee893ffa4 1G
Nov 04 12:31:10 devstack sudo[108471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:10 devstack sudo[108466]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1afcc8be-31e0-4174-9138-fea5261923bb tempest-ProjectMemberTests-782019947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1" returned: 0 in 0.369s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1afcc8be-31e0-4174-9138-fea5261923bb tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1.11562f91-2fd5-4de7-b67d-79cc644537f6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:10 devstack sudo[108476]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1.11562f91-2fd5-4de7-b67d-79cc644537f6
Nov 04 12:31:10 devstack sudo[108476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:10 devstack sudo[108471]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1af4a63e-7b7b-42bb-bf4d-c6a1a45336b8 tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1.93aeb90d-9e87-4131-9e02-d73ee893ffa4 1G" returned: 0 in 0.421s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1af4a63e-7b7b-42bb-bf4d-c6a1a45336b8 tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1.93aeb90d-9e87-4131-9e02-d73ee893ffa4 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:10 devstack sudo[108483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1.93aeb90d-9e87-4131-9e02-d73ee893ffa4
Nov 04 12:31:10 devstack sudo[108483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:10 devstack sudo[108476]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1afcc8be-31e0-4174-9138-fea5261923bb tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1.11562f91-2fd5-4de7-b67d-79cc644537f6" returned: 0 in 0.391s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1afcc8be-31e0-4174-9138-fea5261923bb tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1.11562f91-2fd5-4de7-b67d-79cc644537f6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:10 devstack sudo[108486]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1.11562f91-2fd5-4de7-b67d-79cc644537f6
Nov 04 12:31:10 devstack sudo[108486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:11 devstack sudo[108483]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1af4a63e-7b7b-42bb-bf4d-c6a1a45336b8 tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1.93aeb90d-9e87-4131-9e02-d73ee893ffa4" returned: 0 in 0.301s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:11 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-1af4a63e-7b7b-42bb-bf4d-c6a1a45336b8 tempest-ProjectReaderTests-745542355 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1.93aeb90d-9e87-4131-9e02-d73ee893ffa4 is being set with open permissions: ugo+rw
Nov 04 12:31:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1af4a63e-7b7b-42bb-bf4d-c6a1a45336b8 tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1.93aeb90d-9e87-4131-9e02-d73ee893ffa4 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:11 devstack sudo[108491]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1.93aeb90d-9e87-4131-9e02-d73ee893ffa4
Nov 04 12:31:11 devstack sudo[108491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:11 devstack sudo[108486]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1afcc8be-31e0-4174-9138-fea5261923bb tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1.11562f91-2fd5-4de7-b67d-79cc644537f6" returned: 0 in 0.255s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:11 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1afcc8be-31e0-4174-9138-fea5261923bb tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-11562f91-2fd5-4de7-b67d-79cc644537f6" released by "_delete_snapshot" :: held 1.503s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:31:11 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1afcc8be-31e0-4174-9138-fea5261923bb tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-4428db37-2689-48c9-a2a9-c02943cf6aa1" released by "delete_snapshot" :: held 1.568s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:31:11 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-1afcc8be-31e0-4174-9138-fea5261923bb tempest-ProjectMemberTests-782019947 None] Created reservations ['8e25d9b7-f18b-4f95-8a76-b8bdea149ce9', '8593f4ec-87a1-4642-853e-64b4adb6b297', '60d441a4-a049-463a-957d-b35b99d341c6', '7faffcf1-2121-4c02-8a89-2fe8d8afcc12'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:31:11 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-1afcc8be-31e0-4174-9138-fea5261923bb tempest-ProjectMemberTests-782019947 None] Delete snapshot completed successfully.
Nov 04 12:31:11 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-1afcc8be-31e0-4174-9138-fea5261923bb tempest-ProjectMemberTests-782019947 None] Lock "cinder-11562f91-2fd5-4de7-b67d-79cc644537f6-delete_snapshot" released by "delete_snapshot" :: held 1.711s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:31:11 devstack sudo[108491]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1af4a63e-7b7b-42bb-bf4d-c6a1a45336b8 tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1.93aeb90d-9e87-4131-9e02-d73ee893ffa4" returned: 0 in 0.268s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1af4a63e-7b7b-42bb-bf4d-c6a1a45336b8 tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:11 devstack sudo[108495]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1.info
Nov 04 12:31:11 devstack sudo[108495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:11 devstack sudo[108495]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1af4a63e-7b7b-42bb-bf4d-c6a1a45336b8 tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1.info" returned: 0 in 0.268s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:11 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-1af4a63e-7b7b-42bb-bf4d-c6a1a45336b8 tempest-ProjectReaderTests-745542355 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1.info is being set with open permissions: ugo+rw
Nov 04 12:31:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1af4a63e-7b7b-42bb-bf4d-c6a1a45336b8 tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:11 devstack sudo[108499]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1.info
Nov 04 12:31:11 devstack sudo[108499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:11 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-134437ba-4d64-4c24-9fab-8c431e5c15d4 tempest-ProjectMemberTests-782019947 None] Acquiring lock "cinder-4428db37-2689-48c9-a2a9-c02943cf6aa1-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:31:11 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-134437ba-4d64-4c24-9fab-8c431e5c15d4 tempest-ProjectMemberTests-782019947 None] Lock "cinder-4428db37-2689-48c9-a2a9-c02943cf6aa1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:31:11 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-134437ba-4d64-4c24-9fab-8c431e5c15d4 tempest-ProjectMemberTests-782019947 None] Acquiring lock "cinder-quobyte-4428db37-2689-48c9-a2a9-c02943cf6aa1" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:31:11 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-134437ba-4d64-4c24-9fab-8c431e5c15d4 tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-4428db37-2689-48c9-a2a9-c02943cf6aa1" acquired by "delete_volume" :: waited 0.016s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:31:11 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3dc4a1-0096-4a76-9caf-5b27b9261864]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:31:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-134437ba-4d64-4c24-9fab-8c431e5c15d4 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:11 devstack sudo[108499]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1af4a63e-7b7b-42bb-bf4d-c6a1a45336b8 tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1.info" returned: 0 in 0.289s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1af4a63e-7b7b-42bb-bf4d-c6a1a45336b8 tempest-ProjectReaderTests-745542355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.019s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:31:11 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-1af4a63e-7b7b-42bb-bf4d-c6a1a45336b8 tempest-ProjectReaderTests-745542355 None] Create snapshot completed successfully
Nov 04 12:31:11 devstack sudo[108502]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1
Nov 04 12:31:11 devstack sudo[108502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:12 devstack sudo[108502]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-134437ba-4d64-4c24-9fab-8c431e5c15d4 tempest-ProjectMemberTests-782019947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1" returned: 0 in 0.381s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-134437ba-4d64-4c24-9fab-8c431e5c15d4 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:12 devstack sudo[108507]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1
Nov 04 12:31:12 devstack sudo[108507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:12 devstack sudo[108507]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-134437ba-4d64-4c24-9fab-8c431e5c15d4 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-4428db37-2689-48c9-a2a9-c02943cf6aa1" returned: 0 in 0.249s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:12 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-134437ba-4d64-4c24-9fab-8c431e5c15d4 tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-4428db37-2689-48c9-a2a9-c02943cf6aa1" released by "delete_volume" :: held 0.691s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:31:12 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-134437ba-4d64-4c24-9fab-8c431e5c15d4 tempest-ProjectMemberTests-782019947 None] Created reservations ['92a1e801-6223-4c5e-ad21-fee2b6e793f2', '0d8a0515-ae98-4dfe-bd25-b1ac77155778', '0e4b58be-9d09-455e-9134-03f671682352', '542b37e1-3508-4d35-8857-49b17b202985'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:31:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-134437ba-4d64-4c24-9fab-8c431e5c15d4 tempest-ProjectMemberTests-782019947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:31:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-134437ba-4d64-4c24-9fab-8c431e5c15d4 tempest-ProjectMemberTests-782019947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:31:12 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-134437ba-4d64-4c24-9fab-8c431e5c15d4 tempest-ProjectMemberTests-782019947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:31:12 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-134437ba-4d64-4c24-9fab-8c431e5c15d4 tempest-ProjectMemberTests-782019947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:31:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-134437ba-4d64-4c24-9fab-8c431e5c15d4 tempest-ProjectMemberTests-782019947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:31:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-134437ba-4d64-4c24-9fab-8c431e5c15d4 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:12 devstack sudo[108510]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:31:12 devstack sudo[108510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:12 devstack sudo[108510]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-134437ba-4d64-4c24-9fab-8c431e5c15d4 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.251s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:12 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-134437ba-4d64-4c24-9fab-8c431e5c15d4 tempest-ProjectMemberTests-782019947 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:31:12 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-134437ba-4d64-4c24-9fab-8c431e5c15d4 tempest-ProjectMemberTests-782019947 None] Deleted volume successfully.
Nov 04 12:31:12 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-134437ba-4d64-4c24-9fab-8c431e5c15d4 tempest-ProjectMemberTests-782019947 None] Lock "cinder-4428db37-2689-48c9-a2a9-c02943cf6aa1-delete_volume" released by "delete_volume" :: held 1.133s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:31:13 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9812f8d2-7c1e-4a8e-a18f-63edf6bb75ab tempest-ProjectReaderTests-745542355 None] Acquiring lock "cinder-93aeb90d-9e87-4131-9e02-d73ee893ffa4-delete_snapshot" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:31:13 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9812f8d2-7c1e-4a8e-a18f-63edf6bb75ab tempest-ProjectReaderTests-745542355 None] Lock "cinder-93aeb90d-9e87-4131-9e02-d73ee893ffa4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:31:13 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9812f8d2-7c1e-4a8e-a18f-63edf6bb75ab tempest-ProjectReaderTests-745542355 None] Acquiring lock "cinder-quobyte-435b68a0-3d86-4aa1-a24e-a08eec905ea1" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:31:13 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9812f8d2-7c1e-4a8e-a18f-63edf6bb75ab tempest-ProjectReaderTests-745542355 None] Lock "cinder-quobyte-435b68a0-3d86-4aa1-a24e-a08eec905ea1" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:31:13 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9812f8d2-7c1e-4a8e-a18f-63edf6bb75ab tempest-ProjectReaderTests-745542355 None] Acquiring lock "cinder-quobyte-93aeb90d-9e87-4131-9e02-d73ee893ffa4" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:31:13 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9812f8d2-7c1e-4a8e-a18f-63edf6bb75ab tempest-ProjectReaderTests-745542355 None] Lock "cinder-quobyte-93aeb90d-9e87-4131-9e02-d73ee893ffa4" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:31:13 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-9812f8d2-7c1e-4a8e-a18f-63edf6bb75ab tempest-ProjectReaderTests-745542355 None] Deleting offline snapshot 93aeb90d-9e87-4131-9e02-d73ee893ffa4 of volume 435b68a0-3d86-4aa1-a24e-a08eec905ea1 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:31:13 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-9812f8d2-7c1e-4a8e-a18f-63edf6bb75ab tempest-ProjectReaderTests-745542355 None] snapshot_file for this snap is: volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1.93aeb90d-9e87-4131-9e02-d73ee893ffa4 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:31:13 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[060a3c7f-655d-4139-8cd2-9a48107c216c]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:31:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9812f8d2-7c1e-4a8e-a18f-63edf6bb75ab tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1.93aeb90d-9e87-4131-9e02-d73ee893ffa4 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:13 devstack sudo[108513]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1.93aeb90d-9e87-4131-9e02-d73ee893ffa4
Nov 04 12:31:13 devstack sudo[108513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:13 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-55c9707a-ceba-4b38-b38b-3fc701db142d tempest-ProjectMemberTests-782019947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:31:13 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-55c9707a-ceba-4b38-b38b-3fc701db142d tempest-ProjectMemberTests-782019947 None] Flow 'volume_create_manager' (5cffe071-9bec-4e3d-a45b-e79f38abac34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:31:13 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-55c9707a-ceba-4b38-b38b-3fc701db142d tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba95231f-7277-42d4-97be-d900758a226a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:13 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-55c9707a-ceba-4b38-b38b-3fc701db142d tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba95231f-7277-42d4-97be-d900758a226a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1971638431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d944c17-c63b-4318-ab82-4e89f7720dfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5a80a035d04be496795229f2e16378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:31:13Z,use_quota=True,user_id='4f258b2e50a741e4b75bd5ecf8d3039a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:13 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-55c9707a-ceba-4b38-b38b-3fc701db142d tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29ce9962-6030-47a0-98b8-fa26518a46ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:13 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-55c9707a-ceba-4b38-b38b-3fc701db142d tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29ce9962-6030-47a0-98b8-fa26518a46ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:13 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-55c9707a-ceba-4b38-b38b-3fc701db142d tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc47e7ca-2850-4256-b28f-7d4d1b1f722b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:13 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-55c9707a-ceba-4b38-b38b-3fc701db142d tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc47e7ca-2850-4256-b28f-7d4d1b1f722b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d944c17-c63b-4318-ab82-4e89f7720dfa', 'volume_name': 'volume-9d944c17-c63b-4318-ab82-4e89f7720dfa', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:13 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-55c9707a-ceba-4b38-b38b-3fc701db142d tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f6fa1af-f9d3-4813-b7fc-ef5971a67147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:13 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-55c9707a-ceba-4b38-b38b-3fc701db142d tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f6fa1af-f9d3-4813-b7fc-ef5971a67147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:13 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-55c9707a-ceba-4b38-b38b-3fc701db142d tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (355920b9-aa11-4812-8e61-d0186ed7ab42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:13 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-55c9707a-ceba-4b38-b38b-3fc701db142d tempest-ProjectMemberTests-782019947 None] Volume 9d944c17-c63b-4318-ab82-4e89f7720dfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d944c17-c63b-4318-ab82-4e89f7720dfa', 'volume_size': 1}
Nov 04 12:31:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-55c9707a-ceba-4b38-b38b-3fc701db142d tempest-ProjectMemberTests-782019947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:31:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-55c9707a-ceba-4b38-b38b-3fc701db142d tempest-ProjectMemberTests-782019947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:31:13 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-55c9707a-ceba-4b38-b38b-3fc701db142d tempest-ProjectMemberTests-782019947 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:31:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1971638431',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d944c17-c63b-4318-ab82-4e89f7720dfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5a80a035d04be496795229f2e16378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:31:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:31:13Z,use_quota=True,user_id='4f258b2e50a741e4b75bd5ecf8d3039a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:31:13 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-55c9707a-ceba-4b38-b38b-3fc701db142d tempest-ProjectMemberTests-782019947 None] Creating volume 9d944c17-c63b-4318-ab82-4e89f7720dfa {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:31:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-55c9707a-ceba-4b38-b38b-3fc701db142d tempest-ProjectMemberTests-782019947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:31:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-55c9707a-ceba-4b38-b38b-3fc701db142d tempest-ProjectMemberTests-782019947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:31:13 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-55c9707a-ceba-4b38-b38b-3fc701db142d tempest-ProjectMemberTests-782019947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:31:13 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-55c9707a-ceba-4b38-b38b-3fc701db142d tempest-ProjectMemberTests-782019947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:31:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-55c9707a-ceba-4b38-b38b-3fc701db142d tempest-ProjectMemberTests-782019947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:31:13 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-55c9707a-ceba-4b38-b38b-3fc701db142d tempest-ProjectMemberTests-782019947 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:31:13 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-55c9707a-ceba-4b38-b38b-3fc701db142d tempest-ProjectMemberTests-782019947 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:31:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-55c9707a-ceba-4b38-b38b-3fc701db142d tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:13 devstack sudo[108515]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa 1073741824
Nov 04 12:31:13 devstack sudo[108515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:13 devstack sudo[108513]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9812f8d2-7c1e-4a8e-a18f-63edf6bb75ab tempest-ProjectReaderTests-745542355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1.93aeb90d-9e87-4131-9e02-d73ee893ffa4" returned: 0 in 0.398s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:13 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-9812f8d2-7c1e-4a8e-a18f-63edf6bb75ab tempest-ProjectReaderTests-745542355 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:31:13 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f27ce2-e861-488f-b422-a022a30e5b1a]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:31:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9812f8d2-7c1e-4a8e-a18f-63edf6bb75ab tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:13 devstack sudo[108520]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1
Nov 04 12:31:13 devstack sudo[108520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:13 devstack sudo[108515]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-55c9707a-ceba-4b38-b38b-3fc701db142d tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa 1073741824" returned: 0 in 0.526s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-55c9707a-ceba-4b38-b38b-3fc701db142d tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:14 devstack sudo[108520]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9812f8d2-7c1e-4a8e-a18f-63edf6bb75ab tempest-ProjectReaderTests-745542355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1" returned: 0 in 0.397s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9812f8d2-7c1e-4a8e-a18f-63edf6bb75ab tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1.93aeb90d-9e87-4131-9e02-d73ee893ffa4 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:14 devstack sudo[108529]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa
Nov 04 12:31:14 devstack sudo[108529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:14 devstack sudo[108530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1.93aeb90d-9e87-4131-9e02-d73ee893ffa4
Nov 04 12:31:14 devstack sudo[108530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:14 devstack sudo[108529]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-55c9707a-ceba-4b38-b38b-3fc701db142d tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa" returned: 0 in 0.270s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:14 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-55c9707a-ceba-4b38-b38b-3fc701db142d tempest-ProjectMemberTests-782019947 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:31:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-55c9707a-ceba-4b38-b38b-3fc701db142d tempest-ProjectMemberTests-782019947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:31:14 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-55c9707a-ceba-4b38-b38b-3fc701db142d tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (355920b9-aa11-4812-8e61-d0186ed7ab42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d944c17-c63b-4318-ab82-4e89f7720dfa', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:14 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-55c9707a-ceba-4b38-b38b-3fc701db142d tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (710abd70-5629-4fa2-91b9-4d71d25f9c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:14 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-55c9707a-ceba-4b38-b38b-3fc701db142d tempest-ProjectMemberTests-782019947 None] Volume volume-9d944c17-c63b-4318-ab82-4e89f7720dfa (9d944c17-c63b-4318-ab82-4e89f7720dfa): created successfully
Nov 04 12:31:14 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-55c9707a-ceba-4b38-b38b-3fc701db142d tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (710abd70-5629-4fa2-91b9-4d71d25f9c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:14 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-55c9707a-ceba-4b38-b38b-3fc701db142d tempest-ProjectMemberTests-782019947 None] Flow 'volume_create_manager' (5cffe071-9bec-4e3d-a45b-e79f38abac34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:31:14 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-55c9707a-ceba-4b38-b38b-3fc701db142d tempest-ProjectMemberTests-782019947 None] Created volume successfully.
Nov 04 12:31:14 devstack sudo[108530]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9812f8d2-7c1e-4a8e-a18f-63edf6bb75ab tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1.93aeb90d-9e87-4131-9e02-d73ee893ffa4" returned: 0 in 0.364s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9812f8d2-7c1e-4a8e-a18f-63edf6bb75ab tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1.93aeb90d-9e87-4131-9e02-d73ee893ffa4 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:14 devstack sudo[108539]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1.93aeb90d-9e87-4131-9e02-d73ee893ffa4
Nov 04 12:31:14 devstack sudo[108539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:14 devstack sudo[108539]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:14 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-9812f8d2-7c1e-4a8e-a18f-63edf6bb75ab tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1.93aeb90d-9e87-4131-9e02-d73ee893ffa4" returned: 0 in 0.233s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:14 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9812f8d2-7c1e-4a8e-a18f-63edf6bb75ab tempest-ProjectReaderTests-745542355 None] Lock "cinder-quobyte-93aeb90d-9e87-4131-9e02-d73ee893ffa4" released by "_delete_snapshot" :: held 1.524s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:31:14 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9812f8d2-7c1e-4a8e-a18f-63edf6bb75ab tempest-ProjectReaderTests-745542355 None] Lock "cinder-quobyte-435b68a0-3d86-4aa1-a24e-a08eec905ea1" released by "delete_snapshot" :: held 1.552s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:31:14 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-9812f8d2-7c1e-4a8e-a18f-63edf6bb75ab tempest-ProjectReaderTests-745542355 None] Created reservations ['9023eb2b-80f2-44d4-875f-f76d4e36eb7d', 'c7901212-fe0a-452f-9601-312d6c2ab805', 'b7785acc-bdd0-4554-88db-fad52507d5a0', 'fce5b4ad-cd77-44d9-8238-a651e1bb8cdd'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:31:14 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-9812f8d2-7c1e-4a8e-a18f-63edf6bb75ab tempest-ProjectReaderTests-745542355 None] Delete snapshot completed successfully.
Nov 04 12:31:14 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-9812f8d2-7c1e-4a8e-a18f-63edf6bb75ab tempest-ProjectReaderTests-745542355 None] Lock "cinder-93aeb90d-9e87-4131-9e02-d73ee893ffa4-delete_snapshot" released by "delete_snapshot" :: held 1.673s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:31:15 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e8375d68-5935-4801-bafe-7f2538a17da2 tempest-ProjectReaderTests-745542355 None] Acquiring lock "cinder-435b68a0-3d86-4aa1-a24e-a08eec905ea1-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:31:15 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e8375d68-5935-4801-bafe-7f2538a17da2 tempest-ProjectReaderTests-745542355 None] Lock "cinder-435b68a0-3d86-4aa1-a24e-a08eec905ea1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:31:15 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e8375d68-5935-4801-bafe-7f2538a17da2 tempest-ProjectReaderTests-745542355 None] Acquiring lock "cinder-quobyte-435b68a0-3d86-4aa1-a24e-a08eec905ea1" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:31:15 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e8375d68-5935-4801-bafe-7f2538a17da2 tempest-ProjectReaderTests-745542355 None] Lock "cinder-quobyte-435b68a0-3d86-4aa1-a24e-a08eec905ea1" acquired by "delete_volume" :: waited 0.014s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:31:15 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a5c599-4e0f-4834-9b89-baedbd5976c9]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:31:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e8375d68-5935-4801-bafe-7f2538a17da2 tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:15 devstack sudo[108542]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1
Nov 04 12:31:15 devstack sudo[108542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e2ae5163-a7a2-49ea-9d19-60377c5004ab tempest-ProjectMemberTests-782019947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:31:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e2ae5163-a7a2-49ea-9d19-60377c5004ab tempest-ProjectMemberTests-782019947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:31:15 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-e2ae5163-a7a2-49ea-9d19-60377c5004ab tempest-ProjectMemberTests-782019947 None] Creating offline snapshot 76a674e1-2c6b-4c78-b601-53617a641b9c of volume 9d944c17-c63b-4318-ab82-4e89f7720dfa {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:31:15 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[4643b297-de26-411c-ae81-8309b7d0c809]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:31:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e2ae5163-a7a2-49ea-9d19-60377c5004ab tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:15 devstack sudo[108542]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e8375d68-5935-4801-bafe-7f2538a17da2 tempest-ProjectReaderTests-745542355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1" returned: 0 in 0.382s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e8375d68-5935-4801-bafe-7f2538a17da2 tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:15 devstack sudo[108544]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa
Nov 04 12:31:15 devstack sudo[108544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:15 devstack sudo[108549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1
Nov 04 12:31:15 devstack sudo[108549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:15 devstack sudo[108549]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e8375d68-5935-4801-bafe-7f2538a17da2 tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-435b68a0-3d86-4aa1-a24e-a08eec905ea1" returned: 0 in 0.249s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:15 devstack sudo[108544]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e2ae5163-a7a2-49ea-9d19-60377c5004ab tempest-ProjectMemberTests-782019947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa" returned: 0 in 0.373s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:15 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e2ae5163-a7a2-49ea-9d19-60377c5004ab tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa.76a674e1-2c6b-4c78-b601-53617a641b9c 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:16 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e8375d68-5935-4801-bafe-7f2538a17da2 tempest-ProjectReaderTests-745542355 None] Lock "cinder-quobyte-435b68a0-3d86-4aa1-a24e-a08eec905ea1" released by "delete_volume" :: held 0.718s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:31:16 devstack sudo[108555]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa.76a674e1-2c6b-4c78-b601-53617a641b9c 1G
Nov 04 12:31:16 devstack sudo[108555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:16 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-e8375d68-5935-4801-bafe-7f2538a17da2 tempest-ProjectReaderTests-745542355 None] Created reservations ['17bddc0d-8e60-4dfa-a7b4-2c3dd3712857', '8b592134-d8a4-4734-9ebb-5c3f09c9746e', '066a7faa-8124-4b3c-8203-78d6bd2b9c0b', 'a84bec8c-4f1a-4282-93ea-117c1eef6bce'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:31:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e8375d68-5935-4801-bafe-7f2538a17da2 tempest-ProjectReaderTests-745542355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:31:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e8375d68-5935-4801-bafe-7f2538a17da2 tempest-ProjectReaderTests-745542355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:31:16 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e8375d68-5935-4801-bafe-7f2538a17da2 tempest-ProjectReaderTests-745542355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:31:16 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-e8375d68-5935-4801-bafe-7f2538a17da2 tempest-ProjectReaderTests-745542355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:31:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e8375d68-5935-4801-bafe-7f2538a17da2 tempest-ProjectReaderTests-745542355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:31:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e8375d68-5935-4801-bafe-7f2538a17da2 tempest-ProjectReaderTests-745542355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:16 devstack sudo[108557]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:31:16 devstack sudo[108557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:16 devstack sudo[108557]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e8375d68-5935-4801-bafe-7f2538a17da2 tempest-ProjectReaderTests-745542355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.269s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:16 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-e8375d68-5935-4801-bafe-7f2538a17da2 tempest-ProjectReaderTests-745542355 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:31:16 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-e8375d68-5935-4801-bafe-7f2538a17da2 tempest-ProjectReaderTests-745542355 None] Deleted volume successfully.
Nov 04 12:31:16 devstack sudo[108555]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e2ae5163-a7a2-49ea-9d19-60377c5004ab tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa.76a674e1-2c6b-4c78-b601-53617a641b9c 1G" returned: 0 in 0.419s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e2ae5163-a7a2-49ea-9d19-60377c5004ab tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d944c17-c63b-4318-ab82-4e89f7720dfa -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa.76a674e1-2c6b-4c78-b601-53617a641b9c {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:16 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-e8375d68-5935-4801-bafe-7f2538a17da2 tempest-ProjectReaderTests-745542355 None] Lock "cinder-435b68a0-3d86-4aa1-a24e-a08eec905ea1-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:31:16 devstack sudo[108564]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d944c17-c63b-4318-ab82-4e89f7720dfa -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa.76a674e1-2c6b-4c78-b601-53617a641b9c
Nov 04 12:31:16 devstack sudo[108564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:16 devstack sudo[108564]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e2ae5163-a7a2-49ea-9d19-60377c5004ab tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9d944c17-c63b-4318-ab82-4e89f7720dfa -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa.76a674e1-2c6b-4c78-b601-53617a641b9c" returned: 0 in 0.313s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:16 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-e2ae5163-a7a2-49ea-9d19-60377c5004ab tempest-ProjectMemberTests-782019947 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa.76a674e1-2c6b-4c78-b601-53617a641b9c is being set with open permissions: ugo+rw
Nov 04 12:31:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e2ae5163-a7a2-49ea-9d19-60377c5004ab tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa.76a674e1-2c6b-4c78-b601-53617a641b9c {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:16 devstack sudo[108570]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa.76a674e1-2c6b-4c78-b601-53617a641b9c
Nov 04 12:31:16 devstack sudo[108570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:16 devstack sudo[108570]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:16 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e2ae5163-a7a2-49ea-9d19-60377c5004ab tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa.76a674e1-2c6b-4c78-b601-53617a641b9c" returned: 0 in 0.264s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e2ae5163-a7a2-49ea-9d19-60377c5004ab tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:17 devstack sudo[108573]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa.info
Nov 04 12:31:17 devstack sudo[108573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:17 devstack sudo[108573]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e2ae5163-a7a2-49ea-9d19-60377c5004ab tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa.info" returned: 0 in 0.258s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:17 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-e2ae5163-a7a2-49ea-9d19-60377c5004ab tempest-ProjectMemberTests-782019947 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa.info is being set with open permissions: ugo+rw
Nov 04 12:31:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e2ae5163-a7a2-49ea-9d19-60377c5004ab tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:17 devstack sudo[108576]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa.info
Nov 04 12:31:17 devstack sudo[108576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:17 devstack sudo[108576]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-e2ae5163-a7a2-49ea-9d19-60377c5004ab tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa.info" returned: 0 in 0.270s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-e2ae5163-a7a2-49ea-9d19-60377c5004ab tempest-ProjectMemberTests-782019947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.989s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:31:17 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-e2ae5163-a7a2-49ea-9d19-60377c5004ab tempest-ProjectMemberTests-782019947 None] Create snapshot completed successfully
Nov 04 12:31:17 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3673ab75-9184-44d5-a3fe-877fee0eb1f2 tempest-ProjectMemberTests-782019947 None] Acquiring lock "cinder-76a674e1-2c6b-4c78-b601-53617a641b9c-delete_snapshot" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:31:17 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3673ab75-9184-44d5-a3fe-877fee0eb1f2 tempest-ProjectMemberTests-782019947 None] Lock "cinder-76a674e1-2c6b-4c78-b601-53617a641b9c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:31:17 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3673ab75-9184-44d5-a3fe-877fee0eb1f2 tempest-ProjectMemberTests-782019947 None] Acquiring lock "cinder-quobyte-9d944c17-c63b-4318-ab82-4e89f7720dfa" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:31:17 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3673ab75-9184-44d5-a3fe-877fee0eb1f2 tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-9d944c17-c63b-4318-ab82-4e89f7720dfa" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:31:17 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3673ab75-9184-44d5-a3fe-877fee0eb1f2 tempest-ProjectMemberTests-782019947 None] Acquiring lock "cinder-quobyte-76a674e1-2c6b-4c78-b601-53617a641b9c" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:31:17 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3673ab75-9184-44d5-a3fe-877fee0eb1f2 tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-76a674e1-2c6b-4c78-b601-53617a641b9c" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:31:17 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-3673ab75-9184-44d5-a3fe-877fee0eb1f2 tempest-ProjectMemberTests-782019947 None] Deleting offline snapshot 76a674e1-2c6b-4c78-b601-53617a641b9c of volume 9d944c17-c63b-4318-ab82-4e89f7720dfa {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:31:17 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-3673ab75-9184-44d5-a3fe-877fee0eb1f2 tempest-ProjectMemberTests-782019947 None] snapshot_file for this snap is: volume-9d944c17-c63b-4318-ab82-4e89f7720dfa.76a674e1-2c6b-4c78-b601-53617a641b9c {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:31:17 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[3add3b6d-b988-4b8c-b6b7-fa34a6c7c2ff]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:31:17 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3673ab75-9184-44d5-a3fe-877fee0eb1f2 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa.76a674e1-2c6b-4c78-b601-53617a641b9c {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:17 devstack sudo[108580]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa.76a674e1-2c6b-4c78-b601-53617a641b9c
Nov 04 12:31:17 devstack sudo[108580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:18 devstack sudo[108580]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3673ab75-9184-44d5-a3fe-877fee0eb1f2 tempest-ProjectMemberTests-782019947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa.76a674e1-2c6b-4c78-b601-53617a641b9c" returned: 0 in 0.382s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:18 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-3673ab75-9184-44d5-a3fe-877fee0eb1f2 tempest-ProjectMemberTests-782019947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9d944c17-c63b-4318-ab82-4e89f7720dfa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:31:18 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd89201c-8f71-46b3-9232-c88341487f33]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:31:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3673ab75-9184-44d5-a3fe-877fee0eb1f2 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:18 devstack sudo[108585]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa
Nov 04 12:31:18 devstack sudo[108585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:18 devstack sudo[108585]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3673ab75-9184-44d5-a3fe-877fee0eb1f2 tempest-ProjectMemberTests-782019947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa" returned: 0 in 0.380s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3673ab75-9184-44d5-a3fe-877fee0eb1f2 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa.76a674e1-2c6b-4c78-b601-53617a641b9c {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:18 devstack sudo[108591]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa.76a674e1-2c6b-4c78-b601-53617a641b9c
Nov 04 12:31:18 devstack sudo[108591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:18 devstack sudo[108591]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3673ab75-9184-44d5-a3fe-877fee0eb1f2 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa.76a674e1-2c6b-4c78-b601-53617a641b9c" returned: 0 in 0.346s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:18 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3673ab75-9184-44d5-a3fe-877fee0eb1f2 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa.76a674e1-2c6b-4c78-b601-53617a641b9c {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:18 devstack sudo[108597]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa.76a674e1-2c6b-4c78-b601-53617a641b9c
Nov 04 12:31:18 devstack sudo[108597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:19 devstack sudo[108597]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3673ab75-9184-44d5-a3fe-877fee0eb1f2 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa.76a674e1-2c6b-4c78-b601-53617a641b9c" returned: 0 in 0.257s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3673ab75-9184-44d5-a3fe-877fee0eb1f2 tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-76a674e1-2c6b-4c78-b601-53617a641b9c" released by "_delete_snapshot" :: held 1.470s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:31:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3673ab75-9184-44d5-a3fe-877fee0eb1f2 tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-9d944c17-c63b-4318-ab82-4e89f7720dfa" released by "delete_snapshot" :: held 1.504s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:31:19 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-3673ab75-9184-44d5-a3fe-877fee0eb1f2 tempest-ProjectMemberTests-782019947 None] Created reservations ['1d510916-0093-4c88-a6d0-cfc41f30cc86', 'c12ad29f-b3fc-4762-9370-5c354dc4bcf5', '7911a51d-b8ff-4847-b81e-20af79539ee0', '85e625a0-8ace-4d2c-aee7-94ab9ef06837'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:31:19 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-3673ab75-9184-44d5-a3fe-877fee0eb1f2 tempest-ProjectMemberTests-782019947 None] Delete snapshot completed successfully.
Nov 04 12:31:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3673ab75-9184-44d5-a3fe-877fee0eb1f2 tempest-ProjectMemberTests-782019947 None] Lock "cinder-76a674e1-2c6b-4c78-b601-53617a641b9c-delete_snapshot" released by "delete_snapshot" :: held 1.636s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:31:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-4fd05159-168b-4d6e-bc93-204c63dd3328 tempest-ProjectMemberTests-782019947 None] Acquiring lock "cinder-9d944c17-c63b-4318-ab82-4e89f7720dfa-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:31:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-4fd05159-168b-4d6e-bc93-204c63dd3328 tempest-ProjectMemberTests-782019947 None] Lock "cinder-9d944c17-c63b-4318-ab82-4e89f7720dfa-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:31:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-4fd05159-168b-4d6e-bc93-204c63dd3328 tempest-ProjectMemberTests-782019947 None] Acquiring lock "cinder-quobyte-9d944c17-c63b-4318-ab82-4e89f7720dfa" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:31:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-4fd05159-168b-4d6e-bc93-204c63dd3328 tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-9d944c17-c63b-4318-ab82-4e89f7720dfa" acquired by "delete_volume" :: waited 0.013s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:31:19 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e4a74e3-b30a-461e-81e2-c8288b3a50b3]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:31:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4fd05159-168b-4d6e-bc93-204c63dd3328 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:20 devstack sudo[108600]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa
Nov 04 12:31:20 devstack sudo[108600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:20 devstack sudo[108600]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4fd05159-168b-4d6e-bc93-204c63dd3328 tempest-ProjectMemberTests-782019947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa" returned: 0 in 0.346s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4fd05159-168b-4d6e-bc93-204c63dd3328 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:20 devstack sudo[108605]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa
Nov 04 12:31:20 devstack sudo[108605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:20 devstack sudo[108605]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4fd05159-168b-4d6e-bc93-204c63dd3328 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-9d944c17-c63b-4318-ab82-4e89f7720dfa" returned: 0 in 0.234s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-4fd05159-168b-4d6e-bc93-204c63dd3328 tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-9d944c17-c63b-4318-ab82-4e89f7720dfa" released by "delete_volume" :: held 0.638s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:31:20 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-4fd05159-168b-4d6e-bc93-204c63dd3328 tempest-ProjectMemberTests-782019947 None] Created reservations ['a1fdb46d-39dd-4016-85b9-156f54efedda', '1accac22-7152-45a5-b955-f4735336780a', 'f526d6b1-5087-4b69-a0a7-4fd19a3fe996', 'e82a9ab0-32c2-41e3-855a-74837b9b1cd6'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:31:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-4fd05159-168b-4d6e-bc93-204c63dd3328 tempest-ProjectMemberTests-782019947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:31:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-4fd05159-168b-4d6e-bc93-204c63dd3328 tempest-ProjectMemberTests-782019947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:31:20 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-4fd05159-168b-4d6e-bc93-204c63dd3328 tempest-ProjectMemberTests-782019947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:31:20 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-4fd05159-168b-4d6e-bc93-204c63dd3328 tempest-ProjectMemberTests-782019947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:31:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-4fd05159-168b-4d6e-bc93-204c63dd3328 tempest-ProjectMemberTests-782019947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:31:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4fd05159-168b-4d6e-bc93-204c63dd3328 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:20 devstack sudo[108608]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:31:20 devstack sudo[108608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:20 devstack sudo[108608]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-4fd05159-168b-4d6e-bc93-204c63dd3328 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.251s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:20 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-4fd05159-168b-4d6e-bc93-204c63dd3328 tempest-ProjectMemberTests-782019947 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:31:20 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-4fd05159-168b-4d6e-bc93-204c63dd3328 tempest-ProjectMemberTests-782019947 None] Deleted volume successfully.
Nov 04 12:31:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-4fd05159-168b-4d6e-bc93-204c63dd3328 tempest-ProjectMemberTests-782019947 None] Lock "cinder-9d944c17-c63b-4318-ab82-4e89f7720dfa-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:31:21 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4e98ea3-3e89-4515-a3eb-d643e7e0fba2 tempest-ProjectMemberTests-782019947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:31:21 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a4e98ea3-3e89-4515-a3eb-d643e7e0fba2 tempest-ProjectMemberTests-782019947 None] Flow 'volume_create_manager' (e4101dd0-3767-4428-9f22-98222613960d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:31:21 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a4e98ea3-3e89-4515-a3eb-d643e7e0fba2 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bde3b259-7b7e-428a-bb67-13742e30c1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:21 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a4e98ea3-3e89-4515-a3eb-d643e7e0fba2 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bde3b259-7b7e-428a-bb67-13742e30c1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:31:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1788864146',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55d00430-6e33-4313-af18-c81c8d34369f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5a80a035d04be496795229f2e16378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:31:22Z,use_quota=True,user_id='4f258b2e50a741e4b75bd5ecf8d3039a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:21 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a4e98ea3-3e89-4515-a3eb-d643e7e0fba2 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5658eb73-46c1-418e-a366-92aa363d600a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:21 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a4e98ea3-3e89-4515-a3eb-d643e7e0fba2 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5658eb73-46c1-418e-a366-92aa363d600a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:21 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a4e98ea3-3e89-4515-a3eb-d643e7e0fba2 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7addfc8-49c1-4460-b235-0ec034cdeb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:21 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a4e98ea3-3e89-4515-a3eb-d643e7e0fba2 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7addfc8-49c1-4460-b235-0ec034cdeb9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55d00430-6e33-4313-af18-c81c8d34369f', 'volume_name': 'volume-55d00430-6e33-4313-af18-c81c8d34369f', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:21 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a4e98ea3-3e89-4515-a3eb-d643e7e0fba2 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a66c00a-4e6d-4388-9c78-df478320a765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:21 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a4e98ea3-3e89-4515-a3eb-d643e7e0fba2 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a66c00a-4e6d-4388-9c78-df478320a765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:21 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a4e98ea3-3e89-4515-a3eb-d643e7e0fba2 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (295fa2c0-8bb6-4beb-abd6-7eee2195ffee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:21 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-a4e98ea3-3e89-4515-a3eb-d643e7e0fba2 tempest-ProjectMemberTests-782019947 None] Volume 55d00430-6e33-4313-af18-c81c8d34369f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55d00430-6e33-4313-af18-c81c8d34369f', 'volume_size': 1}
Nov 04 12:31:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a4e98ea3-3e89-4515-a3eb-d643e7e0fba2 tempest-ProjectMemberTests-782019947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:31:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a4e98ea3-3e89-4515-a3eb-d643e7e0fba2 tempest-ProjectMemberTests-782019947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:31:21 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a4e98ea3-3e89-4515-a3eb-d643e7e0fba2 tempest-ProjectMemberTests-782019947 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:31:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1788864146',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55d00430-6e33-4313-af18-c81c8d34369f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5a80a035d04be496795229f2e16378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:31:22Z,use_quota=True,user_id='4f258b2e50a741e4b75bd5ecf8d3039a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:31:21 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-a4e98ea3-3e89-4515-a3eb-d643e7e0fba2 tempest-ProjectMemberTests-782019947 None] Creating volume 55d00430-6e33-4313-af18-c81c8d34369f {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:31:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a4e98ea3-3e89-4515-a3eb-d643e7e0fba2 tempest-ProjectMemberTests-782019947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:31:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a4e98ea3-3e89-4515-a3eb-d643e7e0fba2 tempest-ProjectMemberTests-782019947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:31:21 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a4e98ea3-3e89-4515-a3eb-d643e7e0fba2 tempest-ProjectMemberTests-782019947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:31:21 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a4e98ea3-3e89-4515-a3eb-d643e7e0fba2 tempest-ProjectMemberTests-782019947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:31:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a4e98ea3-3e89-4515-a3eb-d643e7e0fba2 tempest-ProjectMemberTests-782019947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:31:21 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a4e98ea3-3e89-4515-a3eb-d643e7e0fba2 tempest-ProjectMemberTests-782019947 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:31:21 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-a4e98ea3-3e89-4515-a3eb-d643e7e0fba2 tempest-ProjectMemberTests-782019947 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:31:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a4e98ea3-3e89-4515-a3eb-d643e7e0fba2 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:21 devstack sudo[108613]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f 1073741824
Nov 04 12:31:21 devstack sudo[108613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:22 devstack sudo[108613]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a4e98ea3-3e89-4515-a3eb-d643e7e0fba2 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f 1073741824" returned: 0 in 0.396s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a4e98ea3-3e89-4515-a3eb-d643e7e0fba2 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:22 devstack sudo[108618]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f
Nov 04 12:31:22 devstack sudo[108618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:22 devstack sudo[108618]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a4e98ea3-3e89-4515-a3eb-d643e7e0fba2 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f" returned: 0 in 0.247s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:22 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a4e98ea3-3e89-4515-a3eb-d643e7e0fba2 tempest-ProjectMemberTests-782019947 None] <== create_volume: return (683ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:31:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a4e98ea3-3e89-4515-a3eb-d643e7e0fba2 tempest-ProjectMemberTests-782019947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.685s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:31:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a4e98ea3-3e89-4515-a3eb-d643e7e0fba2 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (295fa2c0-8bb6-4beb-abd6-7eee2195ffee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55d00430-6e33-4313-af18-c81c8d34369f', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a4e98ea3-3e89-4515-a3eb-d643e7e0fba2 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (350277b2-68fc-4f5f-a3f3-9a6f06ff3850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:22 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-a4e98ea3-3e89-4515-a3eb-d643e7e0fba2 tempest-ProjectMemberTests-782019947 None] Volume volume-55d00430-6e33-4313-af18-c81c8d34369f (55d00430-6e33-4313-af18-c81c8d34369f): created successfully
Nov 04 12:31:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a4e98ea3-3e89-4515-a3eb-d643e7e0fba2 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (350277b2-68fc-4f5f-a3f3-9a6f06ff3850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:22 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a4e98ea3-3e89-4515-a3eb-d643e7e0fba2 tempest-ProjectMemberTests-782019947 None] Flow 'volume_create_manager' (e4101dd0-3767-4428-9f22-98222613960d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:31:22 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-a4e98ea3-3e89-4515-a3eb-d643e7e0fba2 tempest-ProjectMemberTests-782019947 None] Created volume successfully.
Nov 04 12:31:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f591a583-bd71-44c7-b193-8f9ca14269fd tempest-ProjectMemberTests-782019947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:31:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f591a583-bd71-44c7-b193-8f9ca14269fd tempest-ProjectMemberTests-782019947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:31:23 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-f591a583-bd71-44c7-b193-8f9ca14269fd tempest-ProjectMemberTests-782019947 None] Creating offline snapshot cafd36c1-23d8-4f75-a383-b6cb2e7f547b of volume 55d00430-6e33-4313-af18-c81c8d34369f {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:31:23 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[4164be25-6481-4144-b9ec-33e31e80cfe3]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:31:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f591a583-bd71-44c7-b193-8f9ca14269fd tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:23 devstack sudo[108621]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f
Nov 04 12:31:23 devstack sudo[108621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:24 devstack sudo[108621]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f591a583-bd71-44c7-b193-8f9ca14269fd tempest-ProjectMemberTests-782019947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f" returned: 0 in 0.347s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f591a583-bd71-44c7-b193-8f9ca14269fd tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f.cafd36c1-23d8-4f75-a383-b6cb2e7f547b 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:24 devstack sudo[108626]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f.cafd36c1-23d8-4f75-a383-b6cb2e7f547b 1G
Nov 04 12:31:24 devstack sudo[108626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:24 devstack sudo[108626]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f591a583-bd71-44c7-b193-8f9ca14269fd tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f.cafd36c1-23d8-4f75-a383-b6cb2e7f547b 1G" returned: 0 in 0.424s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f591a583-bd71-44c7-b193-8f9ca14269fd tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55d00430-6e33-4313-af18-c81c8d34369f -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f.cafd36c1-23d8-4f75-a383-b6cb2e7f547b {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:24 devstack sudo[108632]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55d00430-6e33-4313-af18-c81c8d34369f -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f.cafd36c1-23d8-4f75-a383-b6cb2e7f547b
Nov 04 12:31:24 devstack sudo[108632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:24 devstack sudo[108632]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f591a583-bd71-44c7-b193-8f9ca14269fd tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55d00430-6e33-4313-af18-c81c8d34369f -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f.cafd36c1-23d8-4f75-a383-b6cb2e7f547b" returned: 0 in 0.299s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:24 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-f591a583-bd71-44c7-b193-8f9ca14269fd tempest-ProjectMemberTests-782019947 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f.cafd36c1-23d8-4f75-a383-b6cb2e7f547b is being set with open permissions: ugo+rw
Nov 04 12:31:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f591a583-bd71-44c7-b193-8f9ca14269fd tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f.cafd36c1-23d8-4f75-a383-b6cb2e7f547b {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:24 devstack sudo[108638]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f.cafd36c1-23d8-4f75-a383-b6cb2e7f547b
Nov 04 12:31:24 devstack sudo[108638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:25 devstack sudo[108638]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f591a583-bd71-44c7-b193-8f9ca14269fd tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f.cafd36c1-23d8-4f75-a383-b6cb2e7f547b" returned: 0 in 0.258s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:25 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=213,cinder:INSERT=72,cinder:UPDATE=272,cinder:DELETE=28 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:31:25 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=195,cinder:INSERT=72,cinder:UPDATE=263,cinder:DELETE=17 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:31:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f591a583-bd71-44c7-b193-8f9ca14269fd tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:25 devstack sudo[108641]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f.info
Nov 04 12:31:25 devstack sudo[108641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:25 devstack sudo[108641]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f591a583-bd71-44c7-b193-8f9ca14269fd tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f.info" returned: 0 in 0.282s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:25 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-f591a583-bd71-44c7-b193-8f9ca14269fd tempest-ProjectMemberTests-782019947 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f.info is being set with open permissions: ugo+rw
Nov 04 12:31:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f591a583-bd71-44c7-b193-8f9ca14269fd tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:25 devstack sudo[108644]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f.info
Nov 04 12:31:25 devstack sudo[108644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:25 devstack sudo[108644]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-f591a583-bd71-44c7-b193-8f9ca14269fd tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f.info" returned: 0 in 0.253s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-f591a583-bd71-44c7-b193-8f9ca14269fd tempest-ProjectMemberTests-782019947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.956s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:31:25 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-f591a583-bd71-44c7-b193-8f9ca14269fd tempest-ProjectMemberTests-782019947 None] Create snapshot completed successfully
Nov 04 12:31:25 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c15b6939-f2d4-4a2c-b591-ad3bebf8d7a5 tempest-ProjectMemberTests-782019947 None] Acquiring lock "cinder-cafd36c1-23d8-4f75-a383-b6cb2e7f547b-delete_snapshot" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:31:25 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c15b6939-f2d4-4a2c-b591-ad3bebf8d7a5 tempest-ProjectMemberTests-782019947 None] Lock "cinder-cafd36c1-23d8-4f75-a383-b6cb2e7f547b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:31:25 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c15b6939-f2d4-4a2c-b591-ad3bebf8d7a5 tempest-ProjectMemberTests-782019947 None] Acquiring lock "cinder-quobyte-55d00430-6e33-4313-af18-c81c8d34369f" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:31:25 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c15b6939-f2d4-4a2c-b591-ad3bebf8d7a5 tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-55d00430-6e33-4313-af18-c81c8d34369f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:31:25 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c15b6939-f2d4-4a2c-b591-ad3bebf8d7a5 tempest-ProjectMemberTests-782019947 None] Acquiring lock "cinder-quobyte-cafd36c1-23d8-4f75-a383-b6cb2e7f547b" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:31:25 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c15b6939-f2d4-4a2c-b591-ad3bebf8d7a5 tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-cafd36c1-23d8-4f75-a383-b6cb2e7f547b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:31:25 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-c15b6939-f2d4-4a2c-b591-ad3bebf8d7a5 tempest-ProjectMemberTests-782019947 None] Deleting offline snapshot cafd36c1-23d8-4f75-a383-b6cb2e7f547b of volume 55d00430-6e33-4313-af18-c81c8d34369f {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:31:25 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-c15b6939-f2d4-4a2c-b591-ad3bebf8d7a5 tempest-ProjectMemberTests-782019947 None] snapshot_file for this snap is: volume-55d00430-6e33-4313-af18-c81c8d34369f.cafd36c1-23d8-4f75-a383-b6cb2e7f547b {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:31:25 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[e31b4e60-a7ae-4c06-86c0-ee936f9b46a6]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:31:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c15b6939-f2d4-4a2c-b591-ad3bebf8d7a5 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f.cafd36c1-23d8-4f75-a383-b6cb2e7f547b {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:26 devstack sudo[108647]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f.cafd36c1-23d8-4f75-a383-b6cb2e7f547b
Nov 04 12:31:26 devstack sudo[108647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:26 devstack sudo[108647]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c15b6939-f2d4-4a2c-b591-ad3bebf8d7a5 tempest-ProjectMemberTests-782019947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f.cafd36c1-23d8-4f75-a383-b6cb2e7f547b" returned: 0 in 0.373s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:26 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-c15b6939-f2d4-4a2c-b591-ad3bebf8d7a5 tempest-ProjectMemberTests-782019947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55d00430-6e33-4313-af18-c81c8d34369f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:31:26 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[10a1b743-35a3-4fb3-b8bc-a9cc578e63fb]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:31:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c15b6939-f2d4-4a2c-b591-ad3bebf8d7a5 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:26 devstack sudo[108652]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f
Nov 04 12:31:26 devstack sudo[108652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:26 devstack sudo[108652]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c15b6939-f2d4-4a2c-b591-ad3bebf8d7a5 tempest-ProjectMemberTests-782019947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f" returned: 0 in 0.365s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:26 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c15b6939-f2d4-4a2c-b591-ad3bebf8d7a5 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f.cafd36c1-23d8-4f75-a383-b6cb2e7f547b {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:26 devstack sudo[108657]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f.cafd36c1-23d8-4f75-a383-b6cb2e7f547b
Nov 04 12:31:26 devstack sudo[108657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:27 devstack sudo[108657]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:27 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c15b6939-f2d4-4a2c-b591-ad3bebf8d7a5 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f.cafd36c1-23d8-4f75-a383-b6cb2e7f547b" returned: 0 in 0.334s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:27 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c15b6939-f2d4-4a2c-b591-ad3bebf8d7a5 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f.cafd36c1-23d8-4f75-a383-b6cb2e7f547b {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:27 devstack sudo[108663]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f.cafd36c1-23d8-4f75-a383-b6cb2e7f547b
Nov 04 12:31:27 devstack sudo[108663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:27 devstack sudo[108663]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:27 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-c15b6939-f2d4-4a2c-b591-ad3bebf8d7a5 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f.cafd36c1-23d8-4f75-a383-b6cb2e7f547b" returned: 0 in 0.252s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:27 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c15b6939-f2d4-4a2c-b591-ad3bebf8d7a5 tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-cafd36c1-23d8-4f75-a383-b6cb2e7f547b" released by "_delete_snapshot" :: held 1.434s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:31:27 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c15b6939-f2d4-4a2c-b591-ad3bebf8d7a5 tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-55d00430-6e33-4313-af18-c81c8d34369f" released by "delete_snapshot" :: held 1.460s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:31:27 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-c15b6939-f2d4-4a2c-b591-ad3bebf8d7a5 tempest-ProjectMemberTests-782019947 None] Created reservations ['2d4ec650-e721-4ff4-abac-d0cae09badb7', 'cdabad31-db0e-49e9-82a8-7b634ec36b86', 'c0464d3d-4a98-435f-8cda-0348ab9872ef', '4be1e60f-5960-45c5-8549-c7b009d9a172'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:31:27 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-c15b6939-f2d4-4a2c-b591-ad3bebf8d7a5 tempest-ProjectMemberTests-782019947 None] Delete snapshot completed successfully.
Nov 04 12:31:27 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-c15b6939-f2d4-4a2c-b591-ad3bebf8d7a5 tempest-ProjectMemberTests-782019947 None] Lock "cinder-cafd36c1-23d8-4f75-a383-b6cb2e7f547b-delete_snapshot" released by "delete_snapshot" :: held 1.594s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:31:28 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-46b1ff91-2d4b-490c-9860-841e4d6e5918 tempest-ProjectMemberTests-782019947 None] Acquiring lock "cinder-55d00430-6e33-4313-af18-c81c8d34369f-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:31:28 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-46b1ff91-2d4b-490c-9860-841e4d6e5918 tempest-ProjectMemberTests-782019947 None] Lock "cinder-55d00430-6e33-4313-af18-c81c8d34369f-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:31:28 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-46b1ff91-2d4b-490c-9860-841e4d6e5918 tempest-ProjectMemberTests-782019947 None] Acquiring lock "cinder-quobyte-55d00430-6e33-4313-af18-c81c8d34369f" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:31:28 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-46b1ff91-2d4b-490c-9860-841e4d6e5918 tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-55d00430-6e33-4313-af18-c81c8d34369f" acquired by "delete_volume" :: waited 0.024s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:31:28 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f35c14f-a444-4303-ae85-3c2fc0b02ce3]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:31:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-46b1ff91-2d4b-490c-9860-841e4d6e5918 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:28 devstack sudo[108666]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f
Nov 04 12:31:28 devstack sudo[108666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:28 devstack sudo[108666]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-46b1ff91-2d4b-490c-9860-841e4d6e5918 tempest-ProjectMemberTests-782019947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f" returned: 0 in 0.354s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-46b1ff91-2d4b-490c-9860-841e4d6e5918 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:28 devstack sudo[108671]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f
Nov 04 12:31:28 devstack sudo[108671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:28 devstack sudo[108671]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-46b1ff91-2d4b-490c-9860-841e4d6e5918 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-55d00430-6e33-4313-af18-c81c8d34369f" returned: 0 in 0.239s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:28 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-46b1ff91-2d4b-490c-9860-841e4d6e5918 tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-55d00430-6e33-4313-af18-c81c8d34369f" released by "delete_volume" :: held 0.649s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:31:28 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-46b1ff91-2d4b-490c-9860-841e4d6e5918 tempest-ProjectMemberTests-782019947 None] Created reservations ['6b71be96-8e66-4680-b58c-8f951a34c872', '2b46e460-065c-4bed-9324-d3ef4badea25', '1d809d7d-3be4-48a9-ae17-0f3bff0de9bd', '220f1bc0-9d73-45b4-ba56-853830540d8b'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:31:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-46b1ff91-2d4b-490c-9860-841e4d6e5918 tempest-ProjectMemberTests-782019947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:31:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-46b1ff91-2d4b-490c-9860-841e4d6e5918 tempest-ProjectMemberTests-782019947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:31:28 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-46b1ff91-2d4b-490c-9860-841e4d6e5918 tempest-ProjectMemberTests-782019947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:31:28 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-46b1ff91-2d4b-490c-9860-841e4d6e5918 tempest-ProjectMemberTests-782019947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:31:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-46b1ff91-2d4b-490c-9860-841e4d6e5918 tempest-ProjectMemberTests-782019947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:31:28 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-46b1ff91-2d4b-490c-9860-841e4d6e5918 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:28 devstack sudo[108674]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:31:28 devstack sudo[108674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:29 devstack sudo[108674]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-46b1ff91-2d4b-490c-9860-841e4d6e5918 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.248s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:29 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-46b1ff91-2d4b-490c-9860-841e4d6e5918 tempest-ProjectMemberTests-782019947 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:31:29 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-46b1ff91-2d4b-490c-9860-841e4d6e5918 tempest-ProjectMemberTests-782019947 None] Deleted volume successfully.
Nov 04 12:31:29 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-46b1ff91-2d4b-490c-9860-841e4d6e5918 tempest-ProjectMemberTests-782019947 None] Lock "cinder-55d00430-6e33-4313-af18-c81c8d34369f-delete_volume" released by "delete_volume" :: held 1.135s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:31:29 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a5268d7-d69a-4986-b9c0-461062833b60 tempest-ProjectMemberTests-782019947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:31:29 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1a5268d7-d69a-4986-b9c0-461062833b60 tempest-ProjectMemberTests-782019947 None] Flow 'volume_create_manager' (95f17d8e-37ad-4872-a79b-6be1e4b08402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:31:29 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1a5268d7-d69a-4986-b9c0-461062833b60 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42ab1077-87cf-4506-bb2a-b5f199eb2ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:29 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1a5268d7-d69a-4986-b9c0-461062833b60 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42ab1077-87cf-4506-bb2a-b5f199eb2ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1828402164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a783f62-f984-4b2f-be4f-2bab98798f16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5a80a035d04be496795229f2e16378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:31:30Z,use_quota=True,user_id='4f258b2e50a741e4b75bd5ecf8d3039a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:29 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1a5268d7-d69a-4986-b9c0-461062833b60 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c4b93b9-0154-46d2-9e4c-83d84ea95d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:29 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1a5268d7-d69a-4986-b9c0-461062833b60 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c4b93b9-0154-46d2-9e4c-83d84ea95d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:29 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1a5268d7-d69a-4986-b9c0-461062833b60 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e83e8bcc-e75b-4e6d-9df5-8106ff052c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:29 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1a5268d7-d69a-4986-b9c0-461062833b60 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e83e8bcc-e75b-4e6d-9df5-8106ff052c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a783f62-f984-4b2f-be4f-2bab98798f16', 'volume_name': 'volume-0a783f62-f984-4b2f-be4f-2bab98798f16', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:29 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1a5268d7-d69a-4986-b9c0-461062833b60 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdab164a-7f7d-4cb7-b046-f2c81bb4d6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:29 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1a5268d7-d69a-4986-b9c0-461062833b60 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdab164a-7f7d-4cb7-b046-f2c81bb4d6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:29 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1a5268d7-d69a-4986-b9c0-461062833b60 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4e67ae0-b902-498d-b6cb-202f29a71954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:29 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-1a5268d7-d69a-4986-b9c0-461062833b60 tempest-ProjectMemberTests-782019947 None] Volume 0a783f62-f984-4b2f-be4f-2bab98798f16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a783f62-f984-4b2f-be4f-2bab98798f16', 'volume_size': 1}
Nov 04 12:31:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1a5268d7-d69a-4986-b9c0-461062833b60 tempest-ProjectMemberTests-782019947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:31:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1a5268d7-d69a-4986-b9c0-461062833b60 tempest-ProjectMemberTests-782019947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:31:29 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1a5268d7-d69a-4986-b9c0-461062833b60 tempest-ProjectMemberTests-782019947 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1828402164',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a783f62-f984-4b2f-be4f-2bab98798f16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5a80a035d04be496795229f2e16378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:31:30Z,use_quota=True,user_id='4f258b2e50a741e4b75bd5ecf8d3039a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:31:29 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-1a5268d7-d69a-4986-b9c0-461062833b60 tempest-ProjectMemberTests-782019947 None] Creating volume 0a783f62-f984-4b2f-be4f-2bab98798f16 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:31:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1a5268d7-d69a-4986-b9c0-461062833b60 tempest-ProjectMemberTests-782019947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:31:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1a5268d7-d69a-4986-b9c0-461062833b60 tempest-ProjectMemberTests-782019947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:31:29 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1a5268d7-d69a-4986-b9c0-461062833b60 tempest-ProjectMemberTests-782019947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:31:29 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1a5268d7-d69a-4986-b9c0-461062833b60 tempest-ProjectMemberTests-782019947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:31:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1a5268d7-d69a-4986-b9c0-461062833b60 tempest-ProjectMemberTests-782019947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:31:29 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1a5268d7-d69a-4986-b9c0-461062833b60 tempest-ProjectMemberTests-782019947 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:31:29 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-1a5268d7-d69a-4986-b9c0-461062833b60 tempest-ProjectMemberTests-782019947 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:31:29 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1a5268d7-d69a-4986-b9c0-461062833b60 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:29 devstack sudo[108677]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16 1073741824
Nov 04 12:31:29 devstack sudo[108677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:30 devstack sudo[108677]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1a5268d7-d69a-4986-b9c0-461062833b60 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16 1073741824" returned: 0 in 0.412s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1a5268d7-d69a-4986-b9c0-461062833b60 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:30 devstack sudo[108682]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16
Nov 04 12:31:30 devstack sudo[108682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:30 devstack sudo[108682]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-1a5268d7-d69a-4986-b9c0-461062833b60 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16" returned: 0 in 0.234s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:30 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-1a5268d7-d69a-4986-b9c0-461062833b60 tempest-ProjectMemberTests-782019947 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:31:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-1a5268d7-d69a-4986-b9c0-461062833b60 tempest-ProjectMemberTests-782019947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:31:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1a5268d7-d69a-4986-b9c0-461062833b60 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4e67ae0-b902-498d-b6cb-202f29a71954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a783f62-f984-4b2f-be4f-2bab98798f16', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1a5268d7-d69a-4986-b9c0-461062833b60 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8505c677-aeff-4eb6-97d0-09cb32e1185b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:30 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-1a5268d7-d69a-4986-b9c0-461062833b60 tempest-ProjectMemberTests-782019947 None] Volume volume-0a783f62-f984-4b2f-be4f-2bab98798f16 (0a783f62-f984-4b2f-be4f-2bab98798f16): created successfully
Nov 04 12:31:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1a5268d7-d69a-4986-b9c0-461062833b60 tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8505c677-aeff-4eb6-97d0-09cb32e1185b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:30 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-1a5268d7-d69a-4986-b9c0-461062833b60 tempest-ProjectMemberTests-782019947 None] Flow 'volume_create_manager' (95f17d8e-37ad-4872-a79b-6be1e4b08402) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:31:30 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-1a5268d7-d69a-4986-b9c0-461062833b60 tempest-ProjectMemberTests-782019947 None] Created volume successfully.
Nov 04 12:31:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-0b2c602a-162b-491c-8690-3c10775f39d1 tempest-ProjectMemberTests-782019947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:31:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-0b2c602a-162b-491c-8690-3c10775f39d1 tempest-ProjectMemberTests-782019947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:31:30 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-0b2c602a-162b-491c-8690-3c10775f39d1 tempest-ProjectMemberTests-782019947 None] Creating offline snapshot 33b881e8-9043-44cc-a8ac-37181e8f43c6 of volume 0a783f62-f984-4b2f-be4f-2bab98798f16 {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:31:30 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[f513dbba-c426-4769-99d1-08703f66a501]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:31:30 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0b2c602a-162b-491c-8690-3c10775f39d1 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:30 devstack sudo[108685]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16
Nov 04 12:31:30 devstack sudo[108685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:31 devstack sudo[108685]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0b2c602a-162b-491c-8690-3c10775f39d1 tempest-ProjectMemberTests-782019947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16" returned: 0 in 0.387s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0b2c602a-162b-491c-8690-3c10775f39d1 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16.33b881e8-9043-44cc-a8ac-37181e8f43c6 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:31 devstack sudo[108690]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16.33b881e8-9043-44cc-a8ac-37181e8f43c6 1G
Nov 04 12:31:31 devstack sudo[108690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:31 devstack sudo[108690]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0b2c602a-162b-491c-8690-3c10775f39d1 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16.33b881e8-9043-44cc-a8ac-37181e8f43c6 1G" returned: 0 in 0.433s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0b2c602a-162b-491c-8690-3c10775f39d1 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a783f62-f984-4b2f-be4f-2bab98798f16 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16.33b881e8-9043-44cc-a8ac-37181e8f43c6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:31 devstack sudo[108697]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a783f62-f984-4b2f-be4f-2bab98798f16 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16.33b881e8-9043-44cc-a8ac-37181e8f43c6
Nov 04 12:31:31 devstack sudo[108697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:31 devstack sudo[108697]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0b2c602a-162b-491c-8690-3c10775f39d1 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a783f62-f984-4b2f-be4f-2bab98798f16 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16.33b881e8-9043-44cc-a8ac-37181e8f43c6" returned: 0 in 0.279s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:31 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-0b2c602a-162b-491c-8690-3c10775f39d1 tempest-ProjectMemberTests-782019947 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16.33b881e8-9043-44cc-a8ac-37181e8f43c6 is being set with open permissions: ugo+rw
Nov 04 12:31:31 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0b2c602a-162b-491c-8690-3c10775f39d1 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16.33b881e8-9043-44cc-a8ac-37181e8f43c6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:31 devstack sudo[108702]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16.33b881e8-9043-44cc-a8ac-37181e8f43c6
Nov 04 12:31:31 devstack sudo[108702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:32 devstack sudo[108702]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0b2c602a-162b-491c-8690-3c10775f39d1 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16.33b881e8-9043-44cc-a8ac-37181e8f43c6" returned: 0 in 0.244s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0b2c602a-162b-491c-8690-3c10775f39d1 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:32 devstack sudo[108705]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16.info
Nov 04 12:31:32 devstack sudo[108705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:32 devstack sudo[108705]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0b2c602a-162b-491c-8690-3c10775f39d1 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16.info" returned: 0 in 0.239s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:32 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-0b2c602a-162b-491c-8690-3c10775f39d1 tempest-ProjectMemberTests-782019947 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16.info is being set with open permissions: ugo+rw
Nov 04 12:31:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0b2c602a-162b-491c-8690-3c10775f39d1 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:32 devstack sudo[108708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16.info
Nov 04 12:31:32 devstack sudo[108708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:32 devstack sudo[108708]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-0b2c602a-162b-491c-8690-3c10775f39d1 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16.info" returned: 0 in 0.235s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:32 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-0b2c602a-162b-491c-8690-3c10775f39d1 tempest-ProjectMemberTests-782019947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.905s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:31:32 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-0b2c602a-162b-491c-8690-3c10775f39d1 tempest-ProjectMemberTests-782019947 None] Create snapshot completed successfully
Nov 04 12:31:32 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d6f2877f-4fd2-44b8-abc5-f8089e98a600 tempest-ProjectMemberTests-782019947 None] Acquiring lock "cinder-33b881e8-9043-44cc-a8ac-37181e8f43c6-delete_snapshot" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:31:33 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d6f2877f-4fd2-44b8-abc5-f8089e98a600 tempest-ProjectMemberTests-782019947 None] Lock "cinder-33b881e8-9043-44cc-a8ac-37181e8f43c6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:31:33 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d6f2877f-4fd2-44b8-abc5-f8089e98a600 tempest-ProjectMemberTests-782019947 None] Acquiring lock "cinder-quobyte-0a783f62-f984-4b2f-be4f-2bab98798f16" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:31:33 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d6f2877f-4fd2-44b8-abc5-f8089e98a600 tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-0a783f62-f984-4b2f-be4f-2bab98798f16" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:31:33 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d6f2877f-4fd2-44b8-abc5-f8089e98a600 tempest-ProjectMemberTests-782019947 None] Acquiring lock "cinder-quobyte-33b881e8-9043-44cc-a8ac-37181e8f43c6" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:31:33 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d6f2877f-4fd2-44b8-abc5-f8089e98a600 tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-33b881e8-9043-44cc-a8ac-37181e8f43c6" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:31:33 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-d6f2877f-4fd2-44b8-abc5-f8089e98a600 tempest-ProjectMemberTests-782019947 None] Deleting offline snapshot 33b881e8-9043-44cc-a8ac-37181e8f43c6 of volume 0a783f62-f984-4b2f-be4f-2bab98798f16 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:31:33 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-d6f2877f-4fd2-44b8-abc5-f8089e98a600 tempest-ProjectMemberTests-782019947 None] snapshot_file for this snap is: volume-0a783f62-f984-4b2f-be4f-2bab98798f16.33b881e8-9043-44cc-a8ac-37181e8f43c6 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:31:33 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2d87cd-dc6b-48fb-b2b4-1cd1bab055ab]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:31:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d6f2877f-4fd2-44b8-abc5-f8089e98a600 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16.33b881e8-9043-44cc-a8ac-37181e8f43c6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:33 devstack sudo[108717]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16.33b881e8-9043-44cc-a8ac-37181e8f43c6
Nov 04 12:31:33 devstack sudo[108717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:33 devstack sudo[108717]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d6f2877f-4fd2-44b8-abc5-f8089e98a600 tempest-ProjectMemberTests-782019947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16.33b881e8-9043-44cc-a8ac-37181e8f43c6" returned: 0 in 0.359s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:33 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-d6f2877f-4fd2-44b8-abc5-f8089e98a600 tempest-ProjectMemberTests-782019947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a783f62-f984-4b2f-be4f-2bab98798f16(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:31:33 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[542820d1-f160-4cb1-a66b-734c911f5a3f]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:31:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d6f2877f-4fd2-44b8-abc5-f8089e98a600 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:33 devstack sudo[108722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16
Nov 04 12:31:33 devstack sudo[108722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:33 devstack sudo[108722]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d6f2877f-4fd2-44b8-abc5-f8089e98a600 tempest-ProjectMemberTests-782019947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16" returned: 0 in 0.387s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:33 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d6f2877f-4fd2-44b8-abc5-f8089e98a600 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16.33b881e8-9043-44cc-a8ac-37181e8f43c6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:33 devstack sudo[108727]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16.33b881e8-9043-44cc-a8ac-37181e8f43c6
Nov 04 12:31:33 devstack sudo[108727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:34 devstack sudo[108727]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d6f2877f-4fd2-44b8-abc5-f8089e98a600 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16.33b881e8-9043-44cc-a8ac-37181e8f43c6" returned: 0 in 0.387s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d6f2877f-4fd2-44b8-abc5-f8089e98a600 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16.33b881e8-9043-44cc-a8ac-37181e8f43c6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:34 devstack sudo[108733]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16.33b881e8-9043-44cc-a8ac-37181e8f43c6
Nov 04 12:31:34 devstack sudo[108733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:34 devstack sudo[108733]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:34 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-d6f2877f-4fd2-44b8-abc5-f8089e98a600 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16.33b881e8-9043-44cc-a8ac-37181e8f43c6" returned: 0 in 0.267s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:34 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d6f2877f-4fd2-44b8-abc5-f8089e98a600 tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-33b881e8-9043-44cc-a8ac-37181e8f43c6" released by "_delete_snapshot" :: held 1.516s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:31:34 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d6f2877f-4fd2-44b8-abc5-f8089e98a600 tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-0a783f62-f984-4b2f-be4f-2bab98798f16" released by "delete_snapshot" :: held 1.540s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:31:34 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-d6f2877f-4fd2-44b8-abc5-f8089e98a600 tempest-ProjectMemberTests-782019947 None] Created reservations ['8f9fbf4c-822f-4640-a38f-e41fbae6d761', 'e6c7bd12-fdf8-45d3-a83f-ef1a566c5da0', '4247e767-d1aa-4f2e-833d-99a0c17cb12b', '5c55a407-0f21-48ab-8e8e-3abce3c33a68'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:31:34 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-d6f2877f-4fd2-44b8-abc5-f8089e98a600 tempest-ProjectMemberTests-782019947 None] Delete snapshot completed successfully.
Nov 04 12:31:34 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-d6f2877f-4fd2-44b8-abc5-f8089e98a600 tempest-ProjectMemberTests-782019947 None] Lock "cinder-33b881e8-9043-44cc-a8ac-37181e8f43c6-delete_snapshot" released by "delete_snapshot" :: held 1.687s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:31:35 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-eaa9125a-661e-4362-a41f-f0da86618070 tempest-ProjectMemberTests-782019947 None] Acquiring lock "cinder-0a783f62-f984-4b2f-be4f-2bab98798f16-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:31:35 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-eaa9125a-661e-4362-a41f-f0da86618070 tempest-ProjectMemberTests-782019947 None] Lock "cinder-0a783f62-f984-4b2f-be4f-2bab98798f16-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:31:35 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-eaa9125a-661e-4362-a41f-f0da86618070 tempest-ProjectMemberTests-782019947 None] Acquiring lock "cinder-quobyte-0a783f62-f984-4b2f-be4f-2bab98798f16" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:31:35 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-eaa9125a-661e-4362-a41f-f0da86618070 tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-0a783f62-f984-4b2f-be4f-2bab98798f16" acquired by "delete_volume" :: waited 0.020s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:31:35 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f217dd-60a5-4954-86fe-8a6608bb6a8f]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:31:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-eaa9125a-661e-4362-a41f-f0da86618070 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:35 devstack sudo[108736]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16
Nov 04 12:31:35 devstack sudo[108736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:35 devstack sudo[108736]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-eaa9125a-661e-4362-a41f-f0da86618070 tempest-ProjectMemberTests-782019947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16" returned: 0 in 0.383s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-eaa9125a-661e-4362-a41f-f0da86618070 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:35 devstack sudo[108742]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16
Nov 04 12:31:35 devstack sudo[108742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:35 devstack sudo[108742]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:35 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-eaa9125a-661e-4362-a41f-f0da86618070 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-0a783f62-f984-4b2f-be4f-2bab98798f16" returned: 0 in 0.256s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:36 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-eaa9125a-661e-4362-a41f-f0da86618070 tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-0a783f62-f984-4b2f-be4f-2bab98798f16" released by "delete_volume" :: held 0.717s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:31:36 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-eaa9125a-661e-4362-a41f-f0da86618070 tempest-ProjectMemberTests-782019947 None] Created reservations ['c350486f-d944-4ca6-99d0-6acc1a0bd838', 'd6654ab8-3237-47af-a752-ffae18077b98', '0c0c467f-f1be-436e-b84d-9ab191ee09a3', '764888ec-c1cb-47f0-a47b-b22fefdfa16f'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:31:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-eaa9125a-661e-4362-a41f-f0da86618070 tempest-ProjectMemberTests-782019947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:31:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-eaa9125a-661e-4362-a41f-f0da86618070 tempest-ProjectMemberTests-782019947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:31:36 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-eaa9125a-661e-4362-a41f-f0da86618070 tempest-ProjectMemberTests-782019947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:31:36 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-eaa9125a-661e-4362-a41f-f0da86618070 tempest-ProjectMemberTests-782019947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:31:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-eaa9125a-661e-4362-a41f-f0da86618070 tempest-ProjectMemberTests-782019947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:31:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-eaa9125a-661e-4362-a41f-f0da86618070 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:36 devstack sudo[108745]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:31:36 devstack sudo[108745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:36 devstack sudo[108745]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:36 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-eaa9125a-661e-4362-a41f-f0da86618070 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.257s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:36 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-eaa9125a-661e-4362-a41f-f0da86618070 tempest-ProjectMemberTests-782019947 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:31:36 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-eaa9125a-661e-4362-a41f-f0da86618070 tempest-ProjectMemberTests-782019947 None] Deleted volume successfully.
Nov 04 12:31:36 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-eaa9125a-661e-4362-a41f-f0da86618070 tempest-ProjectMemberTests-782019947 None] Lock "cinder-0a783f62-f984-4b2f-be4f-2bab98798f16-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:31:36 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-41ae40df-24de-429c-ac3d-e8f0c24551eb tempest-ProjectMemberTests-782019947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-41ae40df-24de-429c-ac3d-e8f0c24551eb tempest-ProjectMemberTests-782019947 None] Flow 'volume_create_manager' (7a0dab74-9264-422c-936c-4db612e0b112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-41ae40df-24de-429c-ac3d-e8f0c24551eb tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9e20466-8d8a-4728-bd33-1b24a8442627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-41ae40df-24de-429c-ac3d-e8f0c24551eb tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9e20466-8d8a-4728-bd33-1b24a8442627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-731680394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=646be475-b514-47c9-994f-5c7d4627c6b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5a80a035d04be496795229f2e16378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:31:37Z,use_quota=True,user_id='4f258b2e50a741e4b75bd5ecf8d3039a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-41ae40df-24de-429c-ac3d-e8f0c24551eb tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c749afad-e441-4cc5-9a3c-29bc06727158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-41ae40df-24de-429c-ac3d-e8f0c24551eb tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c749afad-e441-4cc5-9a3c-29bc06727158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-41ae40df-24de-429c-ac3d-e8f0c24551eb tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21d62f5b-7747-41fd-a7ff-f91fe9720777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-41ae40df-24de-429c-ac3d-e8f0c24551eb tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21d62f5b-7747-41fd-a7ff-f91fe9720777) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '646be475-b514-47c9-994f-5c7d4627c6b6', 'volume_name': 'volume-646be475-b514-47c9-994f-5c7d4627c6b6', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-41ae40df-24de-429c-ac3d-e8f0c24551eb tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6679337e-55bf-4e0b-93cb-eeab9043e5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-41ae40df-24de-429c-ac3d-e8f0c24551eb tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6679337e-55bf-4e0b-93cb-eeab9043e5fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-41ae40df-24de-429c-ac3d-e8f0c24551eb tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a787b15a-2785-4685-aa66-abe29c9bdf69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:37 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-41ae40df-24de-429c-ac3d-e8f0c24551eb tempest-ProjectMemberTests-782019947 None] Volume 646be475-b514-47c9-994f-5c7d4627c6b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-646be475-b514-47c9-994f-5c7d4627c6b6', 'volume_size': 1}
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-41ae40df-24de-429c-ac3d-e8f0c24551eb tempest-ProjectMemberTests-782019947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-41ae40df-24de-429c-ac3d-e8f0c24551eb tempest-ProjectMemberTests-782019947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-41ae40df-24de-429c-ac3d-e8f0c24551eb tempest-ProjectMemberTests-782019947 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-731680394',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=646be475-b514-47c9-994f-5c7d4627c6b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec5a80a035d04be496795229f2e16378',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:31:37Z,use_quota=True,user_id='4f258b2e50a741e4b75bd5ecf8d3039a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-41ae40df-24de-429c-ac3d-e8f0c24551eb tempest-ProjectMemberTests-782019947 None] Creating volume 646be475-b514-47c9-994f-5c7d4627c6b6 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-41ae40df-24de-429c-ac3d-e8f0c24551eb tempest-ProjectMemberTests-782019947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-41ae40df-24de-429c-ac3d-e8f0c24551eb tempest-ProjectMemberTests-782019947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-41ae40df-24de-429c-ac3d-e8f0c24551eb tempest-ProjectMemberTests-782019947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-41ae40df-24de-429c-ac3d-e8f0c24551eb tempest-ProjectMemberTests-782019947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-41ae40df-24de-429c-ac3d-e8f0c24551eb tempest-ProjectMemberTests-782019947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-41ae40df-24de-429c-ac3d-e8f0c24551eb tempest-ProjectMemberTests-782019947 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:31:37 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-41ae40df-24de-429c-ac3d-e8f0c24551eb tempest-ProjectMemberTests-782019947 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-41ae40df-24de-429c-ac3d-e8f0c24551eb tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:37 devstack sudo[108748]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6 1073741824
Nov 04 12:31:37 devstack sudo[108748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d5aceff-abea-434d-aa4f-993d99ac9069 tempest-ProjectReaderTests-956727562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7d5aceff-abea-434d-aa4f-993d99ac9069 tempest-ProjectReaderTests-956727562 None] Flow 'volume_create_manager' (6e86406e-22a6-4aa9-9444-db07f86fbdea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7d5aceff-abea-434d-aa4f-993d99ac9069 tempest-ProjectReaderTests-956727562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10f2161b-c5f5-4137-ac3e-94f7cc7bcf0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7d5aceff-abea-434d-aa4f-993d99ac9069 tempest-ProjectReaderTests-956727562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10f2161b-c5f5-4137-ac3e-94f7cc7bcf0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-330040482',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=240f481c-1ed9-44a7-b291-777adf884922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d055b44ade44c9d9097734b135a4c4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:31:37Z,use_quota=True,user_id='26e8050ca9084888ae46822addbc78b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7d5aceff-abea-434d-aa4f-993d99ac9069 tempest-ProjectReaderTests-956727562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f536e33d-4d16-46d0-9720-46bcdf54eff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7d5aceff-abea-434d-aa4f-993d99ac9069 tempest-ProjectReaderTests-956727562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f536e33d-4d16-46d0-9720-46bcdf54eff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7d5aceff-abea-434d-aa4f-993d99ac9069 tempest-ProjectReaderTests-956727562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (951f602b-5e2e-43f0-8592-3d2e626fec78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7d5aceff-abea-434d-aa4f-993d99ac9069 tempest-ProjectReaderTests-956727562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (951f602b-5e2e-43f0-8592-3d2e626fec78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '240f481c-1ed9-44a7-b291-777adf884922', 'volume_name': 'volume-240f481c-1ed9-44a7-b291-777adf884922', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7d5aceff-abea-434d-aa4f-993d99ac9069 tempest-ProjectReaderTests-956727562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b443c2-6c48-49ac-bb2a-79b3636d2241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7d5aceff-abea-434d-aa4f-993d99ac9069 tempest-ProjectReaderTests-956727562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b443c2-6c48-49ac-bb2a-79b3636d2241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7d5aceff-abea-434d-aa4f-993d99ac9069 tempest-ProjectReaderTests-956727562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21e90f72-62db-42ee-a1ed-81ceff483400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:37 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-7d5aceff-abea-434d-aa4f-993d99ac9069 tempest-ProjectReaderTests-956727562 None] Volume 240f481c-1ed9-44a7-b291-777adf884922: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-240f481c-1ed9-44a7-b291-777adf884922', 'volume_size': 1}
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7d5aceff-abea-434d-aa4f-993d99ac9069 tempest-ProjectReaderTests-956727562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:31:37 devstack sudo[108748]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-41ae40df-24de-429c-ac3d-e8f0c24551eb tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6 1073741824" returned: 0 in 0.408s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-41ae40df-24de-429c-ac3d-e8f0c24551eb tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:37 devstack sudo[108753]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6
Nov 04 12:31:37 devstack sudo[108753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:37 devstack sudo[108753]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-41ae40df-24de-429c-ac3d-e8f0c24551eb tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6" returned: 0 in 0.247s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-41ae40df-24de-429c-ac3d-e8f0c24551eb tempest-ProjectMemberTests-782019947 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-41ae40df-24de-429c-ac3d-e8f0c24551eb tempest-ProjectMemberTests-782019947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7d5aceff-abea-434d-aa4f-993d99ac9069 tempest-ProjectReaderTests-956727562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.580s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-7d5aceff-abea-434d-aa4f-993d99ac9069 tempest-ProjectReaderTests-956727562 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-330040482',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=240f481c-1ed9-44a7-b291-777adf884922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d055b44ade44c9d9097734b135a4c4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:31:37Z,use_quota=True,user_id='26e8050ca9084888ae46822addbc78b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-7d5aceff-abea-434d-aa4f-993d99ac9069 tempest-ProjectReaderTests-956727562 None] Creating volume 240f481c-1ed9-44a7-b291-777adf884922 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7d5aceff-abea-434d-aa4f-993d99ac9069 tempest-ProjectReaderTests-956727562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7d5aceff-abea-434d-aa4f-993d99ac9069 tempest-ProjectReaderTests-956727562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-7d5aceff-abea-434d-aa4f-993d99ac9069 tempest-ProjectReaderTests-956727562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-7d5aceff-abea-434d-aa4f-993d99ac9069 tempest-ProjectReaderTests-956727562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7d5aceff-abea-434d-aa4f-993d99ac9069 tempest-ProjectReaderTests-956727562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-7d5aceff-abea-434d-aa4f-993d99ac9069 tempest-ProjectReaderTests-956727562 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:31:37 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-7d5aceff-abea-434d-aa4f-993d99ac9069 tempest-ProjectReaderTests-956727562 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7d5aceff-abea-434d-aa4f-993d99ac9069 tempest-ProjectReaderTests-956727562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-240f481c-1ed9-44a7-b291-777adf884922 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-41ae40df-24de-429c-ac3d-e8f0c24551eb tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a787b15a-2785-4685-aa66-abe29c9bdf69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-646be475-b514-47c9-994f-5c7d4627c6b6', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-41ae40df-24de-429c-ac3d-e8f0c24551eb tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (826f0658-d361-4eb7-ba18-d1d7bfb1e39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:37 devstack sudo[108756]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-240f481c-1ed9-44a7-b291-777adf884922 1073741824
Nov 04 12:31:37 devstack sudo[108756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:37 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-41ae40df-24de-429c-ac3d-e8f0c24551eb tempest-ProjectMemberTests-782019947 None] Volume volume-646be475-b514-47c9-994f-5c7d4627c6b6 (646be475-b514-47c9-994f-5c7d4627c6b6): created successfully
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-41ae40df-24de-429c-ac3d-e8f0c24551eb tempest-ProjectMemberTests-782019947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (826f0658-d361-4eb7-ba18-d1d7bfb1e39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:37 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-41ae40df-24de-429c-ac3d-e8f0c24551eb tempest-ProjectMemberTests-782019947 None] Flow 'volume_create_manager' (7a0dab74-9264-422c-936c-4db612e0b112) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:31:37 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-41ae40df-24de-429c-ac3d-e8f0c24551eb tempest-ProjectMemberTests-782019947 None] Created volume successfully.
Nov 04 12:31:38 devstack sudo[108756]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7d5aceff-abea-434d-aa4f-993d99ac9069 tempest-ProjectReaderTests-956727562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-240f481c-1ed9-44a7-b291-777adf884922 1073741824" returned: 0 in 0.427s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7d5aceff-abea-434d-aa4f-993d99ac9069 tempest-ProjectReaderTests-956727562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-240f481c-1ed9-44a7-b291-777adf884922 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:38 devstack sudo[108762]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-240f481c-1ed9-44a7-b291-777adf884922
Nov 04 12:31:38 devstack sudo[108762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:38 devstack sudo[108762]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7d5aceff-abea-434d-aa4f-993d99ac9069 tempest-ProjectReaderTests-956727562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-240f481c-1ed9-44a7-b291-777adf884922" returned: 0 in 0.235s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:38 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-7d5aceff-abea-434d-aa4f-993d99ac9069 tempest-ProjectReaderTests-956727562 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:31:38 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7d5aceff-abea-434d-aa4f-993d99ac9069 tempest-ProjectReaderTests-956727562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:31:38 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7d5aceff-abea-434d-aa4f-993d99ac9069 tempest-ProjectReaderTests-956727562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21e90f72-62db-42ee-a1ed-81ceff483400) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-240f481c-1ed9-44a7-b291-777adf884922', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:38 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7d5aceff-abea-434d-aa4f-993d99ac9069 tempest-ProjectReaderTests-956727562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9f56ef4-b6ae-4b52-8c3c-7647068c68f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:38 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-7d5aceff-abea-434d-aa4f-993d99ac9069 tempest-ProjectReaderTests-956727562 None] Volume volume-240f481c-1ed9-44a7-b291-777adf884922 (240f481c-1ed9-44a7-b291-777adf884922): created successfully
Nov 04 12:31:38 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7d5aceff-abea-434d-aa4f-993d99ac9069 tempest-ProjectReaderTests-956727562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9f56ef4-b6ae-4b52-8c3c-7647068c68f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:38 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-7d5aceff-abea-434d-aa4f-993d99ac9069 tempest-ProjectReaderTests-956727562 None] Flow 'volume_create_manager' (6e86406e-22a6-4aa9-9444-db07f86fbdea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:31:38 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-7d5aceff-abea-434d-aa4f-993d99ac9069 tempest-ProjectReaderTests-956727562 None] Created volume successfully.
Nov 04 12:31:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-6d056ef6-7679-42be-9a2a-0b0ae076f87a tempest-ProjectMemberTests-782019947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:31:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-6d056ef6-7679-42be-9a2a-0b0ae076f87a tempest-ProjectMemberTests-782019947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:31:39 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-6d056ef6-7679-42be-9a2a-0b0ae076f87a tempest-ProjectMemberTests-782019947 None] Creating offline snapshot 7bb21ad5-a9d6-46aa-8e7d-853f1de105aa of volume 646be475-b514-47c9-994f-5c7d4627c6b6 {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:31:39 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1993e10-3f81-45dd-8d6f-275083ffa34f]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:31:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6d056ef6-7679-42be-9a2a-0b0ae076f87a tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:39 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-7ec6aee2-0de2-4c67-a5c1-5144697f503e tempest-ProjectReaderTests-956727562 None] Acquiring lock "cinder-240f481c-1ed9-44a7-b291-777adf884922-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:31:39 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-7ec6aee2-0de2-4c67-a5c1-5144697f503e tempest-ProjectReaderTests-956727562 None] Lock "cinder-240f481c-1ed9-44a7-b291-777adf884922-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:31:39 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-7ec6aee2-0de2-4c67-a5c1-5144697f503e tempest-ProjectReaderTests-956727562 None] Acquiring lock "cinder-quobyte-240f481c-1ed9-44a7-b291-777adf884922" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:31:39 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-7ec6aee2-0de2-4c67-a5c1-5144697f503e tempest-ProjectReaderTests-956727562 None] Lock "cinder-quobyte-240f481c-1ed9-44a7-b291-777adf884922" acquired by "delete_volume" :: waited 0.014s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:31:39 devstack sudo[108765]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6
Nov 04 12:31:39 devstack sudo[108765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:39 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f794e1-ac24-4d18-9653-375c7cd75b58]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:31:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7ec6aee2-0de2-4c67-a5c1-5144697f503e tempest-ProjectReaderTests-956727562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-240f481c-1ed9-44a7-b291-777adf884922 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:39 devstack sudo[108767]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-240f481c-1ed9-44a7-b291-777adf884922
Nov 04 12:31:39 devstack sudo[108767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:39 devstack sudo[108765]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6d056ef6-7679-42be-9a2a-0b0ae076f87a tempest-ProjectMemberTests-782019947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6" returned: 0 in 0.373s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6d056ef6-7679-42be-9a2a-0b0ae076f87a tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6.7bb21ad5-a9d6-46aa-8e7d-853f1de105aa 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:39 devstack sudo[108772]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6.7bb21ad5-a9d6-46aa-8e7d-853f1de105aa 1G
Nov 04 12:31:39 devstack sudo[108772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:39 devstack sudo[108767]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7ec6aee2-0de2-4c67-a5c1-5144697f503e tempest-ProjectReaderTests-956727562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-240f481c-1ed9-44a7-b291-777adf884922" returned: 0 in 0.362s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7ec6aee2-0de2-4c67-a5c1-5144697f503e tempest-ProjectReaderTests-956727562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-240f481c-1ed9-44a7-b291-777adf884922 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:39 devstack sudo[108777]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-240f481c-1ed9-44a7-b291-777adf884922
Nov 04 12:31:39 devstack sudo[108777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:39 devstack sudo[108777]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7ec6aee2-0de2-4c67-a5c1-5144697f503e tempest-ProjectReaderTests-956727562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-240f481c-1ed9-44a7-b291-777adf884922" returned: 0 in 0.255s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:39 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-7ec6aee2-0de2-4c67-a5c1-5144697f503e tempest-ProjectReaderTests-956727562 None] Lock "cinder-quobyte-240f481c-1ed9-44a7-b291-777adf884922" released by "delete_volume" :: held 0.671s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:31:39 devstack sudo[108772]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6d056ef6-7679-42be-9a2a-0b0ae076f87a tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6.7bb21ad5-a9d6-46aa-8e7d-853f1de105aa 1G" returned: 0 in 0.458s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:39 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6d056ef6-7679-42be-9a2a-0b0ae076f87a tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-646be475-b514-47c9-994f-5c7d4627c6b6 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6.7bb21ad5-a9d6-46aa-8e7d-853f1de105aa {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:39 devstack sudo[108817]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-646be475-b514-47c9-994f-5c7d4627c6b6 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6.7bb21ad5-a9d6-46aa-8e7d-853f1de105aa
Nov 04 12:31:39 devstack sudo[108817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:39 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-7ec6aee2-0de2-4c67-a5c1-5144697f503e tempest-ProjectReaderTests-956727562 None] Created reservations ['8adc5fb9-a040-4ed1-8ea3-70f95562b525', '8a2b7379-f53a-42c7-ab34-91f0e9e8f036', '8e9f6237-c454-4c18-8e46-3aea28a0bac3', '27984716-3cca-4cdc-a319-d4ac0112cec4'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:31:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7ec6aee2-0de2-4c67-a5c1-5144697f503e tempest-ProjectReaderTests-956727562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:31:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7ec6aee2-0de2-4c67-a5c1-5144697f503e tempest-ProjectReaderTests-956727562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:31:40 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-7ec6aee2-0de2-4c67-a5c1-5144697f503e tempest-ProjectReaderTests-956727562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:31:40 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-7ec6aee2-0de2-4c67-a5c1-5144697f503e tempest-ProjectReaderTests-956727562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:31:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-7ec6aee2-0de2-4c67-a5c1-5144697f503e tempest-ProjectReaderTests-956727562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:31:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7ec6aee2-0de2-4c67-a5c1-5144697f503e tempest-ProjectReaderTests-956727562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:40 devstack sudo[108821]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:31:40 devstack sudo[108821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:40 devstack sudo[108817]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6d056ef6-7679-42be-9a2a-0b0ae076f87a tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-646be475-b514-47c9-994f-5c7d4627c6b6 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6.7bb21ad5-a9d6-46aa-8e7d-853f1de105aa" returned: 0 in 0.330s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:40 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-6d056ef6-7679-42be-9a2a-0b0ae076f87a tempest-ProjectMemberTests-782019947 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6.7bb21ad5-a9d6-46aa-8e7d-853f1de105aa is being set with open permissions: ugo+rw
Nov 04 12:31:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6d056ef6-7679-42be-9a2a-0b0ae076f87a tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6.7bb21ad5-a9d6-46aa-8e7d-853f1de105aa {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:40 devstack sudo[108826]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6.7bb21ad5-a9d6-46aa-8e7d-853f1de105aa
Nov 04 12:31:40 devstack sudo[108826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:40 devstack sudo[108821]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-7ec6aee2-0de2-4c67-a5c1-5144697f503e tempest-ProjectReaderTests-956727562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.285s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:40 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-7ec6aee2-0de2-4c67-a5c1-5144697f503e tempest-ProjectReaderTests-956727562 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:31:40 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-7ec6aee2-0de2-4c67-a5c1-5144697f503e tempest-ProjectReaderTests-956727562 None] Deleted volume successfully.
Nov 04 12:31:40 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-7ec6aee2-0de2-4c67-a5c1-5144697f503e tempest-ProjectReaderTests-956727562 None] Lock "cinder-240f481c-1ed9-44a7-b291-777adf884922-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:31:40 devstack sudo[108826]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6d056ef6-7679-42be-9a2a-0b0ae076f87a tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6.7bb21ad5-a9d6-46aa-8e7d-853f1de105aa" returned: 0 in 0.249s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6d056ef6-7679-42be-9a2a-0b0ae076f87a tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:40 devstack sudo[108830]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6.info
Nov 04 12:31:40 devstack sudo[108830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:40 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-5541020b-91ab-4004-93b8-d92bd0873a36 tempest-ProjectReaderTests-956727562 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:31:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5541020b-91ab-4004-93b8-d92bd0873a36 tempest-ProjectReaderTests-956727562 None] Flow 'volume_create_manager' (422c2ea1-f76f-4f89-bcba-5bd9938c8266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:31:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5541020b-91ab-4004-93b8-d92bd0873a36 tempest-ProjectReaderTests-956727562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d39de5a-7f7e-4fd8-8919-ca2be6b603ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:40 devstack sudo[108830]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5541020b-91ab-4004-93b8-d92bd0873a36 tempest-ProjectReaderTests-956727562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d39de5a-7f7e-4fd8-8919-ca2be6b603ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-522504311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be5a35e9-b5e6-4779-b1ea-737c2e94ee41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d055b44ade44c9d9097734b135a4c4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:31:41Z,use_quota=True,user_id='26e8050ca9084888ae46822addbc78b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5541020b-91ab-4004-93b8-d92bd0873a36 tempest-ProjectReaderTests-956727562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43e1f2aa-c415-425a-9f28-4bcf1a38bdc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5541020b-91ab-4004-93b8-d92bd0873a36 tempest-ProjectReaderTests-956727562 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43e1f2aa-c415-425a-9f28-4bcf1a38bdc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5541020b-91ab-4004-93b8-d92bd0873a36 tempest-ProjectReaderTests-956727562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9fb8c92-4d4f-4679-a071-b63191aa7851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5541020b-91ab-4004-93b8-d92bd0873a36 tempest-ProjectReaderTests-956727562 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9fb8c92-4d4f-4679-a071-b63191aa7851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be5a35e9-b5e6-4779-b1ea-737c2e94ee41', 'volume_name': 'volume-be5a35e9-b5e6-4779-b1ea-737c2e94ee41', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5541020b-91ab-4004-93b8-d92bd0873a36 tempest-ProjectReaderTests-956727562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79a80326-43dd-468c-8956-e909519f8925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5541020b-91ab-4004-93b8-d92bd0873a36 tempest-ProjectReaderTests-956727562 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79a80326-43dd-468c-8956-e909519f8925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:40 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5541020b-91ab-4004-93b8-d92bd0873a36 tempest-ProjectReaderTests-956727562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa59d518-353c-4a2c-b202-fdd17f9d649d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:40 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-5541020b-91ab-4004-93b8-d92bd0873a36 tempest-ProjectReaderTests-956727562 None] Volume be5a35e9-b5e6-4779-b1ea-737c2e94ee41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be5a35e9-b5e6-4779-b1ea-737c2e94ee41', 'volume_size': 1}
Nov 04 12:31:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5541020b-91ab-4004-93b8-d92bd0873a36 tempest-ProjectReaderTests-956727562 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:31:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6d056ef6-7679-42be-9a2a-0b0ae076f87a tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6.info" returned: 0 in 0.319s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:40 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-6d056ef6-7679-42be-9a2a-0b0ae076f87a tempest-ProjectMemberTests-782019947 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6.info is being set with open permissions: ugo+rw
Nov 04 12:31:40 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6d056ef6-7679-42be-9a2a-0b0ae076f87a tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:40 devstack sudo[108833]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6.info
Nov 04 12:31:40 devstack sudo[108833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:41 devstack sudo[108833]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6d056ef6-7679-42be-9a2a-0b0ae076f87a tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6.info" returned: 0 in 0.247s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-6d056ef6-7679-42be-9a2a-0b0ae076f87a tempest-ProjectMemberTests-782019947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.065s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:31:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5541020b-91ab-4004-93b8-d92bd0873a36 tempest-ProjectReaderTests-956727562 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.271s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:31:41 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5541020b-91ab-4004-93b8-d92bd0873a36 tempest-ProjectReaderTests-956727562 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-522504311',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be5a35e9-b5e6-4779-b1ea-737c2e94ee41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d055b44ade44c9d9097734b135a4c4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:31:41Z,use_quota=True,user_id='26e8050ca9084888ae46822addbc78b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:31:41 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-5541020b-91ab-4004-93b8-d92bd0873a36 tempest-ProjectReaderTests-956727562 None] Creating volume be5a35e9-b5e6-4779-b1ea-737c2e94ee41 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:31:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5541020b-91ab-4004-93b8-d92bd0873a36 tempest-ProjectReaderTests-956727562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:31:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5541020b-91ab-4004-93b8-d92bd0873a36 tempest-ProjectReaderTests-956727562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:31:41 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5541020b-91ab-4004-93b8-d92bd0873a36 tempest-ProjectReaderTests-956727562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:31:41 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5541020b-91ab-4004-93b8-d92bd0873a36 tempest-ProjectReaderTests-956727562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:31:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5541020b-91ab-4004-93b8-d92bd0873a36 tempest-ProjectReaderTests-956727562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:31:41 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5541020b-91ab-4004-93b8-d92bd0873a36 tempest-ProjectReaderTests-956727562 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:31:41 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-5541020b-91ab-4004-93b8-d92bd0873a36 tempest-ProjectReaderTests-956727562 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:31:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5541020b-91ab-4004-93b8-d92bd0873a36 tempest-ProjectReaderTests-956727562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-be5a35e9-b5e6-4779-b1ea-737c2e94ee41 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:41 devstack sudo[108836]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-be5a35e9-b5e6-4779-b1ea-737c2e94ee41 1073741824
Nov 04 12:31:41 devstack sudo[108836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:41 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-6d056ef6-7679-42be-9a2a-0b0ae076f87a tempest-ProjectMemberTests-782019947 None] Create snapshot completed successfully
Nov 04 12:31:41 devstack sudo[108836]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5541020b-91ab-4004-93b8-d92bd0873a36 tempest-ProjectReaderTests-956727562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-be5a35e9-b5e6-4779-b1ea-737c2e94ee41 1073741824" returned: 0 in 0.393s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5541020b-91ab-4004-93b8-d92bd0873a36 tempest-ProjectReaderTests-956727562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-be5a35e9-b5e6-4779-b1ea-737c2e94ee41 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:41 devstack sudo[108841]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-be5a35e9-b5e6-4779-b1ea-737c2e94ee41
Nov 04 12:31:41 devstack sudo[108841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:41 devstack sudo[108841]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-5541020b-91ab-4004-93b8-d92bd0873a36 tempest-ProjectReaderTests-956727562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-be5a35e9-b5e6-4779-b1ea-737c2e94ee41" returned: 0 in 0.236s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:41 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-5541020b-91ab-4004-93b8-d92bd0873a36 tempest-ProjectReaderTests-956727562 None] <== create_volume: return (667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:31:41 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-5541020b-91ab-4004-93b8-d92bd0873a36 tempest-ProjectReaderTests-956727562 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.669s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:31:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5541020b-91ab-4004-93b8-d92bd0873a36 tempest-ProjectReaderTests-956727562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa59d518-353c-4a2c-b202-fdd17f9d649d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be5a35e9-b5e6-4779-b1ea-737c2e94ee41', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5541020b-91ab-4004-93b8-d92bd0873a36 tempest-ProjectReaderTests-956727562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eedeaeea-bdd8-47cd-841f-7d94768ab7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:31:41 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-5541020b-91ab-4004-93b8-d92bd0873a36 tempest-ProjectReaderTests-956727562 None] Volume volume-be5a35e9-b5e6-4779-b1ea-737c2e94ee41 (be5a35e9-b5e6-4779-b1ea-737c2e94ee41): created successfully
Nov 04 12:31:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5541020b-91ab-4004-93b8-d92bd0873a36 tempest-ProjectReaderTests-956727562 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eedeaeea-bdd8-47cd-841f-7d94768ab7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:31:41 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-5541020b-91ab-4004-93b8-d92bd0873a36 tempest-ProjectReaderTests-956727562 None] Flow 'volume_create_manager' (422c2ea1-f76f-4f89-bcba-5bd9938c8266) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:31:41 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-5541020b-91ab-4004-93b8-d92bd0873a36 tempest-ProjectReaderTests-956727562 None] Created volume successfully.
Nov 04 12:31:42 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-21c9ced1-1a55-4776-917b-9a49f5a8c79e tempest-ProjectMemberTests-782019947 None] Acquiring lock "cinder-7bb21ad5-a9d6-46aa-8e7d-853f1de105aa-delete_snapshot" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:31:42 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-21c9ced1-1a55-4776-917b-9a49f5a8c79e tempest-ProjectMemberTests-782019947 None] Lock "cinder-7bb21ad5-a9d6-46aa-8e7d-853f1de105aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:31:42 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-21c9ced1-1a55-4776-917b-9a49f5a8c79e tempest-ProjectMemberTests-782019947 None] Acquiring lock "cinder-quobyte-646be475-b514-47c9-994f-5c7d4627c6b6" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:31:42 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-21c9ced1-1a55-4776-917b-9a49f5a8c79e tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-646be475-b514-47c9-994f-5c7d4627c6b6" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:31:42 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-21c9ced1-1a55-4776-917b-9a49f5a8c79e tempest-ProjectMemberTests-782019947 None] Acquiring lock "cinder-quobyte-7bb21ad5-a9d6-46aa-8e7d-853f1de105aa" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:31:42 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-21c9ced1-1a55-4776-917b-9a49f5a8c79e tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-7bb21ad5-a9d6-46aa-8e7d-853f1de105aa" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:31:42 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-21c9ced1-1a55-4776-917b-9a49f5a8c79e tempest-ProjectMemberTests-782019947 None] Deleting offline snapshot 7bb21ad5-a9d6-46aa-8e7d-853f1de105aa of volume 646be475-b514-47c9-994f-5c7d4627c6b6 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:31:42 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-21c9ced1-1a55-4776-917b-9a49f5a8c79e tempest-ProjectMemberTests-782019947 None] snapshot_file for this snap is: volume-646be475-b514-47c9-994f-5c7d4627c6b6.7bb21ad5-a9d6-46aa-8e7d-853f1de105aa {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:31:42 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5168682-d389-4a8b-a21e-7021714960e5]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:31:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-21c9ced1-1a55-4776-917b-9a49f5a8c79e tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6.7bb21ad5-a9d6-46aa-8e7d-853f1de105aa {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:42 devstack sudo[108845]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6.7bb21ad5-a9d6-46aa-8e7d-853f1de105aa
Nov 04 12:31:42 devstack sudo[108845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:42 devstack sudo[108845]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-21c9ced1-1a55-4776-917b-9a49f5a8c79e tempest-ProjectMemberTests-782019947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6.7bb21ad5-a9d6-46aa-8e7d-853f1de105aa" returned: 0 in 0.358s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:42 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-21c9ced1-1a55-4776-917b-9a49f5a8c79e tempest-ProjectMemberTests-782019947 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-646be475-b514-47c9-994f-5c7d4627c6b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:31:42 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b02b5e-79d3-4dbd-9ae6-0e2f8a27b0aa]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:31:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-21c9ced1-1a55-4776-917b-9a49f5a8c79e tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:42 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-19c09b18-8206-484d-af7d-28cf4ab100f8 tempest-ProjectReaderTests-956727562 None] Acquiring lock "cinder-be5a35e9-b5e6-4779-b1ea-737c2e94ee41-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:31:42 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-19c09b18-8206-484d-af7d-28cf4ab100f8 tempest-ProjectReaderTests-956727562 None] Lock "cinder-be5a35e9-b5e6-4779-b1ea-737c2e94ee41-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:31:42 devstack sudo[108850]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6
Nov 04 12:31:42 devstack sudo[108850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:42 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-19c09b18-8206-484d-af7d-28cf4ab100f8 tempest-ProjectReaderTests-956727562 None] Acquiring lock "cinder-quobyte-be5a35e9-b5e6-4779-b1ea-737c2e94ee41" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:31:42 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-19c09b18-8206-484d-af7d-28cf4ab100f8 tempest-ProjectReaderTests-956727562 None] Lock "cinder-quobyte-be5a35e9-b5e6-4779-b1ea-737c2e94ee41" acquired by "delete_volume" :: waited 0.020s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:31:42 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f96adb-4b51-4e72-a4f5-50945bdfe81c]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:31:42 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-19c09b18-8206-484d-af7d-28cf4ab100f8 tempest-ProjectReaderTests-956727562 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-be5a35e9-b5e6-4779-b1ea-737c2e94ee41 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:43 devstack sudo[108853]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-be5a35e9-b5e6-4779-b1ea-737c2e94ee41
Nov 04 12:31:43 devstack sudo[108853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:43 devstack sudo[108850]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-21c9ced1-1a55-4776-917b-9a49f5a8c79e tempest-ProjectMemberTests-782019947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6" returned: 0 in 0.368s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-21c9ced1-1a55-4776-917b-9a49f5a8c79e tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6.7bb21ad5-a9d6-46aa-8e7d-853f1de105aa {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:43 devstack sudo[108858]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6.7bb21ad5-a9d6-46aa-8e7d-853f1de105aa
Nov 04 12:31:43 devstack sudo[108858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:43 devstack sudo[108853]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-19c09b18-8206-484d-af7d-28cf4ab100f8 tempest-ProjectReaderTests-956727562 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-be5a35e9-b5e6-4779-b1ea-737c2e94ee41" returned: 0 in 0.357s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-19c09b18-8206-484d-af7d-28cf4ab100f8 tempest-ProjectReaderTests-956727562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-be5a35e9-b5e6-4779-b1ea-737c2e94ee41 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:43 devstack sudo[108863]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-be5a35e9-b5e6-4779-b1ea-737c2e94ee41
Nov 04 12:31:43 devstack sudo[108863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:43 devstack sudo[108858]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-21c9ced1-1a55-4776-917b-9a49f5a8c79e tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6.7bb21ad5-a9d6-46aa-8e7d-853f1de105aa" returned: 0 in 0.321s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-21c9ced1-1a55-4776-917b-9a49f5a8c79e tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6.7bb21ad5-a9d6-46aa-8e7d-853f1de105aa {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:43 devstack sudo[108868]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6.7bb21ad5-a9d6-46aa-8e7d-853f1de105aa
Nov 04 12:31:43 devstack sudo[108868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:43 devstack sudo[108863]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-19c09b18-8206-484d-af7d-28cf4ab100f8 tempest-ProjectReaderTests-956727562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-be5a35e9-b5e6-4779-b1ea-737c2e94ee41" returned: 0 in 0.255s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:43 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-19c09b18-8206-484d-af7d-28cf4ab100f8 tempest-ProjectReaderTests-956727562 None] Lock "cinder-quobyte-be5a35e9-b5e6-4779-b1ea-737c2e94ee41" released by "delete_volume" :: held 0.662s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:31:43 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-19c09b18-8206-484d-af7d-28cf4ab100f8 tempest-ProjectReaderTests-956727562 None] Created reservations ['5acd045d-f34a-4b5c-af79-8c62084f56fc', '55d64e58-616d-49c7-a154-8bfb811eccce', 'c937e47e-ebcd-4599-a59c-66ad4cf03ba9', '720252f6-6fbb-4a74-9975-7d13e24be0e8'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:31:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-19c09b18-8206-484d-af7d-28cf4ab100f8 tempest-ProjectReaderTests-956727562 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:31:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-19c09b18-8206-484d-af7d-28cf4ab100f8 tempest-ProjectReaderTests-956727562 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:31:43 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-19c09b18-8206-484d-af7d-28cf4ab100f8 tempest-ProjectReaderTests-956727562 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:31:43 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-19c09b18-8206-484d-af7d-28cf4ab100f8 tempest-ProjectReaderTests-956727562 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:31:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-19c09b18-8206-484d-af7d-28cf4ab100f8 tempest-ProjectReaderTests-956727562 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:31:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-19c09b18-8206-484d-af7d-28cf4ab100f8 tempest-ProjectReaderTests-956727562 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:43 devstack sudo[108872]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:31:43 devstack sudo[108872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:43 devstack sudo[108868]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-21c9ced1-1a55-4776-917b-9a49f5a8c79e tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6.7bb21ad5-a9d6-46aa-8e7d-853f1de105aa" returned: 0 in 0.256s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:43 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-21c9ced1-1a55-4776-917b-9a49f5a8c79e tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-7bb21ad5-a9d6-46aa-8e7d-853f1de105aa" released by "_delete_snapshot" :: held 1.412s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:31:43 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-21c9ced1-1a55-4776-917b-9a49f5a8c79e tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-646be475-b514-47c9-994f-5c7d4627c6b6" released by "delete_snapshot" :: held 1.437s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:31:43 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-21c9ced1-1a55-4776-917b-9a49f5a8c79e tempest-ProjectMemberTests-782019947 None] Created reservations ['dcb58906-a5fb-4160-baff-c6783a896243', 'a944850a-65ae-4939-89f9-320f068f7049', '1e400616-6b85-429c-82c8-1aa068e66ae8', 'bbe2e787-280e-4b58-94f6-db0a15f43117'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:31:43 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-21c9ced1-1a55-4776-917b-9a49f5a8c79e tempest-ProjectMemberTests-782019947 None] Delete snapshot completed successfully.
Nov 04 12:31:43 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-21c9ced1-1a55-4776-917b-9a49f5a8c79e tempest-ProjectMemberTests-782019947 None] Lock "cinder-7bb21ad5-a9d6-46aa-8e7d-853f1de105aa-delete_snapshot" released by "delete_snapshot" :: held 1.575s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:31:43 devstack sudo[108872]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:43 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-19c09b18-8206-484d-af7d-28cf4ab100f8 tempest-ProjectReaderTests-956727562 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.266s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:43 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-19c09b18-8206-484d-af7d-28cf4ab100f8 tempest-ProjectReaderTests-956727562 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:31:43 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-19c09b18-8206-484d-af7d-28cf4ab100f8 tempest-ProjectReaderTests-956727562 None] Deleted volume successfully.
Nov 04 12:31:44 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-19c09b18-8206-484d-af7d-28cf4ab100f8 tempest-ProjectReaderTests-956727562 None] Lock "cinder-be5a35e9-b5e6-4779-b1ea-737c2e94ee41-delete_volume" released by "delete_volume" :: held 1.125s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:31:44 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-383fab81-ef5f-4590-bb57-f7c617d54088 tempest-ProjectMemberTests-782019947 None] Acquiring lock "cinder-646be475-b514-47c9-994f-5c7d4627c6b6-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:31:44 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-383fab81-ef5f-4590-bb57-f7c617d54088 tempest-ProjectMemberTests-782019947 None] Lock "cinder-646be475-b514-47c9-994f-5c7d4627c6b6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:31:44 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-383fab81-ef5f-4590-bb57-f7c617d54088 tempest-ProjectMemberTests-782019947 None] Acquiring lock "cinder-quobyte-646be475-b514-47c9-994f-5c7d4627c6b6" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:31:44 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-383fab81-ef5f-4590-bb57-f7c617d54088 tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-646be475-b514-47c9-994f-5c7d4627c6b6" acquired by "delete_volume" :: waited 0.014s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:31:44 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[e110edd6-72f5-42bb-8112-f811af7d2d3e]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:31:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-383fab81-ef5f-4590-bb57-f7c617d54088 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:44 devstack sudo[108875]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6
Nov 04 12:31:44 devstack sudo[108875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:44 devstack sudo[108875]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-383fab81-ef5f-4590-bb57-f7c617d54088 tempest-ProjectMemberTests-782019947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6" returned: 0 in 0.385s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:44 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-383fab81-ef5f-4590-bb57-f7c617d54088 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:45 devstack sudo[108880]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6
Nov 04 12:31:45 devstack sudo[108880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:45 devstack sudo[108880]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-383fab81-ef5f-4590-bb57-f7c617d54088 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-646be475-b514-47c9-994f-5c7d4627c6b6" returned: 0 in 0.255s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:45 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-383fab81-ef5f-4590-bb57-f7c617d54088 tempest-ProjectMemberTests-782019947 None] Lock "cinder-quobyte-646be475-b514-47c9-994f-5c7d4627c6b6" released by "delete_volume" :: held 0.709s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:31:45 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-383fab81-ef5f-4590-bb57-f7c617d54088 tempest-ProjectMemberTests-782019947 None] Created reservations ['7dc3bbe3-0a28-4489-9360-7be4b6cc7189', '1bd0a3a0-fd4b-431e-b6d1-48f3ab7404e0', 'd10263fb-32ac-4552-a88e-dca6534e8c0e', '38ad0c34-dee8-4c24-8fa7-3a3107740b88'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:31:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-383fab81-ef5f-4590-bb57-f7c617d54088 tempest-ProjectMemberTests-782019947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:31:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-383fab81-ef5f-4590-bb57-f7c617d54088 tempest-ProjectMemberTests-782019947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:31:45 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-383fab81-ef5f-4590-bb57-f7c617d54088 tempest-ProjectMemberTests-782019947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:31:45 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-383fab81-ef5f-4590-bb57-f7c617d54088 tempest-ProjectMemberTests-782019947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:31:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-383fab81-ef5f-4590-bb57-f7c617d54088 tempest-ProjectMemberTests-782019947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:31:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-383fab81-ef5f-4590-bb57-f7c617d54088 tempest-ProjectMemberTests-782019947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:45 devstack sudo[108883]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:31:45 devstack sudo[108883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:45 devstack sudo[108883]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:45 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-383fab81-ef5f-4590-bb57-f7c617d54088 tempest-ProjectMemberTests-782019947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.279s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:45 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-383fab81-ef5f-4590-bb57-f7c617d54088 tempest-ProjectMemberTests-782019947 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:31:45 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-383fab81-ef5f-4590-bb57-f7c617d54088 tempest-ProjectMemberTests-782019947 None] Deleted volume successfully.
Nov 04 12:31:45 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-383fab81-ef5f-4590-bb57-f7c617d54088 tempest-ProjectMemberTests-782019947 None] Lock "cinder-646be475-b514-47c9-994f-5c7d4627c6b6-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:31:49 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:31:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:31:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:31:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:31:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:31:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:31:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:31:49 devstack sudo[108886]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:31:49 devstack sudo[108886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:31:50 devstack sudo[108886]: pam_unix(sudo:session): session closed for user root
Nov 04 12:31:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.250s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:31:50 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:31:50 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager._thread_info {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:31:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread count: 28 {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 12:31:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread info: [<_MainThread(MainThread, started 137165867425920)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137165754678912)>, <Thread(Thread-3 (stat_writer), started daemon 137165754130752)>, <Thread(Rabbit-heartbeat, started daemon 137165752997504)>, <Thread(Thread-5 (_runner), started daemon 137165753227712)>, <Thread(Thread-7 (_runner), started daemon 137165751273856)>, <Thread(fd_logger, started daemon 137165755322048)>, <Thread(privsep_reader, started daemon 137165748896704)>, <Thread(tpool_thread_0, started daemon 137165742520000)>, <Thread(tpool_thread_1, started daemon 137165734127296)>, <Thread(tpool_thread_2, started daemon 137165725734592)>, <Thread(tpool_thread_3, started daemon 137165717341888)>, <Thread(tpool_thread_4, started daemon 137165708949184)>, <Thread(tpool_thread_5, started daemon 137165700556480)>, <Thread(tpool_thread_6, started daemon 137165692163776)>, <Thread(tpool_thread_7, started daemon 137165683771072)>, <Thread(tpool_thread_8, started daemon 137165675378368)>, <Thread(tpool_thread_9, started daemon 137165666985664)>, <Thread(tpool_thread_10, started daemon 137165658592960)>, <Thread(tpool_thread_11, started daemon 137165650183872)>, <Thread(tpool_thread_12, started daemon 137165641774784)>, <Thread(tpool_thread_13, started daemon 137165633365696)>, <Thread(tpool_thread_14, started daemon 137165624956608)>, <Thread(tpool_thread_15, started daemon 137165616547520)>, <Thread(tpool_thread_16, started daemon 137165608138432)>, <Thread(tpool_thread_17, started daemon 137165599729344)>, <Thread(tpool_thread_18, started daemon 137165591320256)>, <Thread(tpool_thread_19, started daemon 137165582911168)>] {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}
Nov 04 12:31:55 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=48,cinder:DELETE=4,cinder:UPDATE=77,cinder:INSERT=15 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:31:55 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=57,cinder:INSERT=24,cinder:UPDATE=67,cinder:DELETE=8 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:32:08 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:32:08 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf9a8eb4-979b-4104-9bf9-da96a98204cc tempest-SnapshotDependencyTests-500591891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:32:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-cf9a8eb4-979b-4104-9bf9-da96a98204cc tempest-SnapshotDependencyTests-500591891 None] Flow 'volume_create_manager' (5c927508-84cb-41b9-beee-737cce7298d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:32:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-cf9a8eb4-979b-4104-9bf9-da96a98204cc tempest-SnapshotDependencyTests-500591891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb281bbc-58b0-42b0-a718-488a7e8a05ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:32:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-cf9a8eb4-979b-4104-9bf9-da96a98204cc tempest-SnapshotDependencyTests-500591891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb281bbc-58b0-42b0-a718-488a7e8a05ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-391122259',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c801078aa94c3495df726fe30aee6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:32:09Z,use_quota=True,user_id='586b186b965740479a4588550bdee437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:32:08 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-cf9a8eb4-979b-4104-9bf9-da96a98204cc tempest-SnapshotDependencyTests-500591891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ccb37df-57de-4d67-971d-00040be7075b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:32:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-cf9a8eb4-979b-4104-9bf9-da96a98204cc tempest-SnapshotDependencyTests-500591891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ccb37df-57de-4d67-971d-00040be7075b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:32:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-cf9a8eb4-979b-4104-9bf9-da96a98204cc tempest-SnapshotDependencyTests-500591891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df879ad5-3537-496f-9203-3823b3c966cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:32:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-cf9a8eb4-979b-4104-9bf9-da96a98204cc tempest-SnapshotDependencyTests-500591891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df879ad5-3537-496f-9203-3823b3c966cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1', 'volume_name': 'volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:32:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-cf9a8eb4-979b-4104-9bf9-da96a98204cc tempest-SnapshotDependencyTests-500591891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ff83bf4-70e2-4768-b899-c754f17cacdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:32:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-cf9a8eb4-979b-4104-9bf9-da96a98204cc tempest-SnapshotDependencyTests-500591891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ff83bf4-70e2-4768-b899-c754f17cacdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:32:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-cf9a8eb4-979b-4104-9bf9-da96a98204cc tempest-SnapshotDependencyTests-500591891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3784a580-b09e-4789-b393-0e99b61f9208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:32:09 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-cf9a8eb4-979b-4104-9bf9-da96a98204cc tempest-SnapshotDependencyTests-500591891 None] Volume c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1', 'volume_size': 1}
Nov 04 12:32:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-cf9a8eb4-979b-4104-9bf9-da96a98204cc tempest-SnapshotDependencyTests-500591891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:32:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-cf9a8eb4-979b-4104-9bf9-da96a98204cc tempest-SnapshotDependencyTests-500591891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:32:09 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-cf9a8eb4-979b-4104-9bf9-da96a98204cc tempest-SnapshotDependencyTests-500591891 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7cc0646b59d0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-391122259',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c801078aa94c3495df726fe30aee6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:32:09Z,use_quota=True,user_id='586b186b965740479a4588550bdee437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)}" {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}}
Nov 04 12:32:09 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-cf9a8eb4-979b-4104-9bf9-da96a98204cc tempest-SnapshotDependencyTests-500591891 None] Creating volume c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1 {{(pid=87169) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}}
Nov 04 12:32:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-cf9a8eb4-979b-4104-9bf9-da96a98204cc tempest-SnapshotDependencyTests-500591891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:32:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-cf9a8eb4-979b-4104-9bf9-da96a98204cc tempest-SnapshotDependencyTests-500591891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:32:09 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-cf9a8eb4-979b-4104-9bf9-da96a98204cc tempest-SnapshotDependencyTests-500591891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:32:09 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-cf9a8eb4-979b-4104-9bf9-da96a98204cc tempest-SnapshotDependencyTests-500591891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:32:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-cf9a8eb4-979b-4104-9bf9-da96a98204cc tempest-SnapshotDependencyTests-500591891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:32:09 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-cf9a8eb4-979b-4104-9bf9-da96a98204cc tempest-SnapshotDependencyTests-500591891 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:32:09 devstack cinder-volume[87169]: INFO cinder.volume.drivers.remotefs [None req-cf9a8eb4-979b-4104-9bf9-da96a98204cc tempest-SnapshotDependencyTests-500591891 None] casted to osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79
Nov 04 12:32:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-cf9a8eb4-979b-4104-9bf9-da96a98204cc tempest-SnapshotDependencyTests-500591891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1 1073741824 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:32:09 devstack sudo[108895]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1 1073741824
Nov 04 12:32:09 devstack sudo[108895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:32:09 devstack sudo[108895]: pam_unix(sudo:session): session closed for user root
Nov 04 12:32:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-cf9a8eb4-979b-4104-9bf9-da96a98204cc tempest-SnapshotDependencyTests-500591891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1 1073741824" returned: 0 in 0.403s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:32:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-cf9a8eb4-979b-4104-9bf9-da96a98204cc tempest-SnapshotDependencyTests-500591891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:32:09 devstack sudo[108901]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1
Nov 04 12:32:09 devstack sudo[108901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:32:09 devstack sudo[108901]: pam_unix(sudo:session): session closed for user root
Nov 04 12:32:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-cf9a8eb4-979b-4104-9bf9-da96a98204cc tempest-SnapshotDependencyTests-500591891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1" returned: 0 in 0.243s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:32:09 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-cf9a8eb4-979b-4104-9bf9-da96a98204cc tempest-SnapshotDependencyTests-500591891 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'} {{(pid=87169) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}}
Nov 04 12:32:09 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-cf9a8eb4-979b-4104-9bf9-da96a98204cc tempest-SnapshotDependencyTests-500591891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:32:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-cf9a8eb4-979b-4104-9bf9-da96a98204cc tempest-SnapshotDependencyTests-500591891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3784a580-b09e-4789-b393-0e99b61f9208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1', 'volume_size': 1}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:32:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-cf9a8eb4-979b-4104-9bf9-da96a98204cc tempest-SnapshotDependencyTests-500591891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13121158-5f69-4ea3-96dc-34ef8f0e3ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:32:09 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-cf9a8eb4-979b-4104-9bf9-da96a98204cc tempest-SnapshotDependencyTests-500591891 None] Volume volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1 (c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1): created successfully
Nov 04 12:32:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-cf9a8eb4-979b-4104-9bf9-da96a98204cc tempest-SnapshotDependencyTests-500591891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13121158-5f69-4ea3-96dc-34ef8f0e3ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:32:09 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-cf9a8eb4-979b-4104-9bf9-da96a98204cc tempest-SnapshotDependencyTests-500591891 None] Flow 'volume_create_manager' (5c927508-84cb-41b9-beee-737cce7298d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:32:09 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-cf9a8eb4-979b-4104-9bf9-da96a98204cc tempest-SnapshotDependencyTests-500591891 None] Created volume successfully.
Nov 04 12:32:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ad3b5f24-354f-448f-9262-8729e05a3555 tempest-SnapshotDependencyTests-500591891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:32:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ad3b5f24-354f-448f-9262-8729e05a3555 tempest-SnapshotDependencyTests-500591891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:32:10 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-ad3b5f24-354f-448f-9262-8729e05a3555 tempest-SnapshotDependencyTests-500591891 None] Creating offline snapshot c080b8ea-7bf6-4539-a187-ed5cb43e48f9 of volume c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1 {{(pid=87169) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}}
Nov 04 12:32:10 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[964ae3c2-a811-42ce-b53f-c27d0b90adff]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:32:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ad3b5f24-354f-448f-9262-8729e05a3555 tempest-SnapshotDependencyTests-500591891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:32:10 devstack sudo[108904]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1
Nov 04 12:32:10 devstack sudo[108904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:32:10 devstack sudo[108904]: pam_unix(sudo:session): session closed for user root
Nov 04 12:32:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ad3b5f24-354f-448f-9262-8729e05a3555 tempest-SnapshotDependencyTests-500591891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1" returned: 0 in 0.353s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:32:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ad3b5f24-354f-448f-9262-8729e05a3555 tempest-SnapshotDependencyTests-500591891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1.c080b8ea-7bf6-4539-a187-ed5cb43e48f9 1G {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:32:10 devstack sudo[108909]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1.c080b8ea-7bf6-4539-a187-ed5cb43e48f9 1G
Nov 04 12:32:10 devstack sudo[108909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:32:10 devstack sudo[108909]: pam_unix(sudo:session): session closed for user root
Nov 04 12:32:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ad3b5f24-354f-448f-9262-8729e05a3555 tempest-SnapshotDependencyTests-500591891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1.c080b8ea-7bf6-4539-a187-ed5cb43e48f9 1G" returned: 0 in 0.390s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:32:10 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ad3b5f24-354f-448f-9262-8729e05a3555 tempest-SnapshotDependencyTests-500591891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1.c080b8ea-7bf6-4539-a187-ed5cb43e48f9 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:32:10 devstack sudo[108915]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1.c080b8ea-7bf6-4539-a187-ed5cb43e48f9
Nov 04 12:32:10 devstack sudo[108915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:32:11 devstack sudo[108915]: pam_unix(sudo:session): session closed for user root
Nov 04 12:32:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ad3b5f24-354f-448f-9262-8729e05a3555 tempest-SnapshotDependencyTests-500591891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1 -F qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1.c080b8ea-7bf6-4539-a187-ed5cb43e48f9" returned: 0 in 0.280s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:32:11 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-ad3b5f24-354f-448f-9262-8729e05a3555 tempest-SnapshotDependencyTests-500591891 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1.c080b8ea-7bf6-4539-a187-ed5cb43e48f9 is being set with open permissions: ugo+rw
Nov 04 12:32:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ad3b5f24-354f-448f-9262-8729e05a3555 tempest-SnapshotDependencyTests-500591891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1.c080b8ea-7bf6-4539-a187-ed5cb43e48f9 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:32:11 devstack sudo[108920]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1.c080b8ea-7bf6-4539-a187-ed5cb43e48f9
Nov 04 12:32:11 devstack sudo[108920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:32:11 devstack sudo[108920]: pam_unix(sudo:session): session closed for user root
Nov 04 12:32:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ad3b5f24-354f-448f-9262-8729e05a3555 tempest-SnapshotDependencyTests-500591891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1.c080b8ea-7bf6-4539-a187-ed5cb43e48f9" returned: 0 in 0.232s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:32:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ad3b5f24-354f-448f-9262-8729e05a3555 tempest-SnapshotDependencyTests-500591891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:32:11 devstack sudo[108923]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1.info
Nov 04 12:32:11 devstack sudo[108923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:32:11 devstack sudo[108923]: pam_unix(sudo:session): session closed for user root
Nov 04 12:32:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ad3b5f24-354f-448f-9262-8729e05a3555 tempest-SnapshotDependencyTests-500591891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1.info" returned: 0 in 0.250s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:32:11 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-ad3b5f24-354f-448f-9262-8729e05a3555 tempest-SnapshotDependencyTests-500591891 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1.info is being set with open permissions: ugo+rw
Nov 04 12:32:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ad3b5f24-354f-448f-9262-8729e05a3555 tempest-SnapshotDependencyTests-500591891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1.info {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:32:11 devstack sudo[108927]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1.info
Nov 04 12:32:11 devstack sudo[108927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:32:11 devstack sudo[108927]: pam_unix(sudo:session): session closed for user root
Nov 04 12:32:11 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-ad3b5f24-354f-448f-9262-8729e05a3555 tempest-SnapshotDependencyTests-500591891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1.info" returned: 0 in 0.235s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:32:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-ad3b5f24-354f-448f-9262-8729e05a3555 tempest-SnapshotDependencyTests-500591891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.835s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:32:12 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-ad3b5f24-354f-448f-9262-8729e05a3555 tempest-SnapshotDependencyTests-500591891 None] Create snapshot completed successfully
Nov 04 12:32:12 devstack cinder-volume[87169]: DEBUG cinder.volume.flows.manager.create_volume [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87169) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}}
Nov 04 12:32:12 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Flow 'volume_create_manager' (9a5f2eb2-4248-473f-b0e1-7bf9a64cca9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:32:12 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bea1ceb-b495-423e-9268-6b3abbeed60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:32:12 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8bea1ceb-b495-423e-9268-6b3abbeed60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2026-11-04T11:32:12Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee8c0566-168c-45dc-ab50-efb91fa4ffa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f7c801078aa94c3495df726fe30aee6f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-04T11:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c080b8ea-7bf6-4539-a187-ed5cb43e48f9,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-04T11:32:13Z,use_quota=True,user_id='586b186b965740479a4588550bdee437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef916dbd-98a1-4729-ae00-d4b1ab0060c5),volume_type_id=ef916dbd-98a1-4729-ae00-d4b1ab0060c5)' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:32:12 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c7ba088-35df-4c6e-ba17-b6733c7f1af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:32:12 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c7ba088-35df-4c6e-ba17-b6733c7f1af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:32:12 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c09e57b2-0d83-43ed-a1e8-90d024e828c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:32:12 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c09e57b2-0d83-43ed-a1e8-90d024e828c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ee8c0566-168c-45dc-ab50-efb91fa4ffa6', 'volume_name': 'volume-ee8c0566-168c-45dc-ab50-efb91fa4ffa6', 'volume_size': 1, 'snapshot_id': 'c080b8ea-7bf6-4539-a187-ed5cb43e48f9'}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:32:12 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cf83da7-704f-41cd-b938-1073a5d1a4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:32:12 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cf83da7-704f-41cd-b938-1073a5d1a4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:32:12 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83bad445-03ab-4460-b895-bcfaba4ba905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:32:12 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Volume ee8c0566-168c-45dc-ab50-efb91fa4ffa6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ee8c0566-168c-45dc-ab50-efb91fa4ffa6', 'volume_size': 1, 'snapshot_id': 'c080b8ea-7bf6-4539-a187-ed5cb43e48f9'}
Nov 04 12:32:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:32:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:32:12 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Acquiring lock "cinder-quobyte-c080b8ea-7bf6-4539-a187-ed5cb43e48f9-ee8c0566-168c-45dc-ab50-efb91fa4ffa6" by "_create_volume_from_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:32:12 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Lock "cinder-quobyte-c080b8ea-7bf6-4539-a187-ed5cb43e48f9-ee8c0566-168c-45dc-ab50-efb91fa4ffa6" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:32:12 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Creating volume ee8c0566-168c-45dc-ab50-efb91fa4ffa6 from snapshot c080b8ea-7bf6-4539-a187-ed5cb43e48f9 {{(pid=87169) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}}
Nov 04 12:32:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:32:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:32:12 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:32:12 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:32:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:32:12 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Selected osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79 as target Quobyte volume. {{(pid=87169) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}}
Nov 04 12:32:12 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Acquiring lock "cinder-quobyte-ee8c0566-168c-45dc-ab50-efb91fa4ffa6" by "_copy_volume_from_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:32:12 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Lock "cinder-quobyte-ee8c0566-168c-45dc-ab50-efb91fa4ffa6" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:32:12 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] snapshot: c080b8ea-7bf6-4539-a187-ed5cb43e48f9, volume: ee8c0566-168c-45dc-ab50-efb91fa4ffa6,  {{(pid=87169) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}}
Nov 04 12:32:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:32:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:32:12 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:32:12 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:32:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:32:12 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4785ad-3ee2-4329-ade1-e889c6309c48]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:32:12 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1.c080b8ea-7bf6-4539-a187-ed5cb43e48f9 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:32:13 devstack sudo[108930]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1.c080b8ea-7bf6-4539-a187-ed5cb43e48f9
Nov 04 12:32:13 devstack sudo[108930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:32:13 devstack sudo[108930]: pam_unix(sudo:session): session closed for user root
Nov 04 12:32:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1.c080b8ea-7bf6-4539-a187-ed5cb43e48f9" returned: 0 in 0.343s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:32:13 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:32:13 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[8574e567-c0eb-4d8b-9f8b-c57f39de77e6]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:32:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:32:13 devstack sudo[108935]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1
Nov 04 12:32:13 devstack sudo[108935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:32:13 devstack sudo[108935]: pam_unix(sudo:session): session closed for user root
Nov 04 12:32:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1" returned: 0 in 0.343s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:32:13 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] will copy from snapshot at /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1 {{(pid=87169) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}}
Nov 04 12:32:13 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Creating direct copy from snapshot {{(pid=87169) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}}
Nov 04 12:32:13 devstack cinder-volume[87169]: DEBUG cinder.utils [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Path /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ee8c0566-168c-45dc-ab50-efb91fa4ffa6 not found in is_blk_device check {{(pid=87169) is_blk_device /opt/stack/cinder/cinder/utils.py:627}}
Nov 04 12:32:13 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ee8c0566-168c-45dc-ab50-efb91fa4ffa6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:32:13 devstack sudo[108940]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ee8c0566-168c-45dc-ab50-efb91fa4ffa6
Nov 04 12:32:13 devstack sudo[108940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:32:19 devstack sudo[108940]: pam_unix(sudo:session): session closed for user root
Nov 04 12:32:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ee8c0566-168c-45dc-ab50-efb91fa4ffa6" returned: 0 in 5.877s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:32:19 devstack cinder-volume[87169]: DEBUG cinder.image.image_utils [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Image conversion details: src /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1, size 1024.00 MB, duration 5.88 sec, destination /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ee8c0566-168c-45dc-ab50-efb91fa4ffa6 {{(pid=87169) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}}
Nov 04 12:32:19 devstack cinder-volume[87169]: INFO cinder.image.image_utils [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Converted 1024.00 MB image at 174.21 MB/s
Nov 04 12:32:19 devstack cinder-volume[87169]: WARNING cinder.volume.drivers.remotefs [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ee8c0566-168c-45dc-ab50-efb91fa4ffa6 is being set with open permissions: ugo+rw
Nov 04 12:32:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ee8c0566-168c-45dc-ab50-efb91fa4ffa6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:32:19 devstack sudo[108954]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ee8c0566-168c-45dc-ab50-efb91fa4ffa6
Nov 04 12:32:19 devstack sudo[108954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:32:19 devstack sudo[108954]: pam_unix(sudo:session): session closed for user root
Nov 04 12:32:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ee8c0566-168c-45dc-ab50-efb91fa4ffa6" returned: 0 in 0.238s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:32:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Lock "cinder-quobyte-ee8c0566-168c-45dc-ab50-efb91fa4ffa6" released by "_copy_volume_from_snapshot" :: held 6.880s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:32:19 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Lock "cinder-quobyte-c080b8ea-7bf6-4539-a187-ed5cb43e48f9-ee8c0566-168c-45dc-ab50-efb91fa4ffa6" released by "_create_volume_from_snapshot" :: held 6.938s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:32:19 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.952s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:32:19 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83bad445-03ab-4460-b895-bcfaba4ba905) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee8c0566-168c-45dc-ab50-efb91fa4ffa6', 'volume_size': 1, 'snapshot_id': 'c080b8ea-7bf6-4539-a187-ed5cb43e48f9'}' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:32:19 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6dc057e-b993-479a-bf26-3bc39a11595f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}}
Nov 04 12:32:19 devstack cinder-volume[87169]: INFO cinder.volume.flows.manager.create_volume [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Volume volume-ee8c0566-168c-45dc-ab50-efb91fa4ffa6 (ee8c0566-168c-45dc-ab50-efb91fa4ffa6): created successfully
Nov 04 12:32:19 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6dc057e-b993-479a-bf26-3bc39a11595f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87169) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}}
Nov 04 12:32:19 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Flow 'volume_create_manager' (9a5f2eb2-4248-473f-b0e1-7bf9a64cca9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87169) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}}
Nov 04 12:32:19 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-3931494d-e882-40f5-8543-95d2d6b147d6 tempest-SnapshotDependencyTests-500591891 None] Created volume successfully.
Nov 04 12:32:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-6ec5088c-3f8a-4a3a-9fce-cde0348e5794 tempest-SnapshotDependencyTests-500591891 None] Acquiring lock "cinder-c080b8ea-7bf6-4539-a187-ed5cb43e48f9-delete_snapshot" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:32:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-6ec5088c-3f8a-4a3a-9fce-cde0348e5794 tempest-SnapshotDependencyTests-500591891 None] Lock "cinder-c080b8ea-7bf6-4539-a187-ed5cb43e48f9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:32:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-6ec5088c-3f8a-4a3a-9fce-cde0348e5794 tempest-SnapshotDependencyTests-500591891 None] Acquiring lock "cinder-quobyte-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1" by "delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:32:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-6ec5088c-3f8a-4a3a-9fce-cde0348e5794 tempest-SnapshotDependencyTests-500591891 None] Lock "cinder-quobyte-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:32:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-6ec5088c-3f8a-4a3a-9fce-cde0348e5794 tempest-SnapshotDependencyTests-500591891 None] Acquiring lock "cinder-quobyte-c080b8ea-7bf6-4539-a187-ed5cb43e48f9" by "_delete_snapshot" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:32:20 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-6ec5088c-3f8a-4a3a-9fce-cde0348e5794 tempest-SnapshotDependencyTests-500591891 None] Lock "cinder-quobyte-c080b8ea-7bf6-4539-a187-ed5cb43e48f9" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:32:20 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-6ec5088c-3f8a-4a3a-9fce-cde0348e5794 tempest-SnapshotDependencyTests-500591891 None] Deleting offline snapshot c080b8ea-7bf6-4539-a187-ed5cb43e48f9 of volume c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}}
Nov 04 12:32:20 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-6ec5088c-3f8a-4a3a-9fce-cde0348e5794 tempest-SnapshotDependencyTests-500591891 None] snapshot_file for this snap is: volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1.c080b8ea-7bf6-4539-a187-ed5cb43e48f9 {{(pid=87169) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}}
Nov 04 12:32:20 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[a736ba16-1a79-4102-b296-050d3e08a82f]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:32:20 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6ec5088c-3f8a-4a3a-9fce-cde0348e5794 tempest-SnapshotDependencyTests-500591891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1.c080b8ea-7bf6-4539-a187-ed5cb43e48f9 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:32:20 devstack sudo[108957]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1.c080b8ea-7bf6-4539-a187-ed5cb43e48f9
Nov 04 12:32:20 devstack sudo[108957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:32:21 devstack sudo[108957]: pam_unix(sudo:session): session closed for user root
Nov 04 12:32:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6ec5088c-3f8a-4a3a-9fce-cde0348e5794 tempest-SnapshotDependencyTests-500591891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1.c080b8ea-7bf6-4539-a187-ed5cb43e48f9" returned: 0 in 0.365s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:32:21 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.remotefs [None req-6ec5088c-3f8a-4a3a-9fce-cde0348e5794 tempest-SnapshotDependencyTests-500591891 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87169) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}}
Nov 04 12:32:21 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[c621372e-8a57-49b7-b1ed-dd50bf033e9c]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:32:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6ec5088c-3f8a-4a3a-9fce-cde0348e5794 tempest-SnapshotDependencyTests-500591891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:32:21 devstack sudo[108962]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1
Nov 04 12:32:21 devstack sudo[108962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:32:21 devstack sudo[108962]: pam_unix(sudo:session): session closed for user root
Nov 04 12:32:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6ec5088c-3f8a-4a3a-9fce-cde0348e5794 tempest-SnapshotDependencyTests-500591891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1" returned: 0 in 0.523s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:32:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6ec5088c-3f8a-4a3a-9fce-cde0348e5794 tempest-SnapshotDependencyTests-500591891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1.c080b8ea-7bf6-4539-a187-ed5cb43e48f9 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:32:21 devstack sudo[108968]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1.c080b8ea-7bf6-4539-a187-ed5cb43e48f9
Nov 04 12:32:21 devstack sudo[108968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:32:21 devstack sudo[108968]: pam_unix(sudo:session): session closed for user root
Nov 04 12:32:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6ec5088c-3f8a-4a3a-9fce-cde0348e5794 tempest-SnapshotDependencyTests-500591891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1.c080b8ea-7bf6-4539-a187-ed5cb43e48f9" returned: 0 in 0.322s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:32:21 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6ec5088c-3f8a-4a3a-9fce-cde0348e5794 tempest-SnapshotDependencyTests-500591891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1.c080b8ea-7bf6-4539-a187-ed5cb43e48f9 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:32:22 devstack sudo[108973]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1.c080b8ea-7bf6-4539-a187-ed5cb43e48f9
Nov 04 12:32:22 devstack sudo[108973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:32:22 devstack sudo[108973]: pam_unix(sudo:session): session closed for user root
Nov 04 12:32:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-6ec5088c-3f8a-4a3a-9fce-cde0348e5794 tempest-SnapshotDependencyTests-500591891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1.c080b8ea-7bf6-4539-a187-ed5cb43e48f9" returned: 0 in 0.241s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:32:22 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-6ec5088c-3f8a-4a3a-9fce-cde0348e5794 tempest-SnapshotDependencyTests-500591891 None] Lock "cinder-quobyte-c080b8ea-7bf6-4539-a187-ed5cb43e48f9" released by "_delete_snapshot" :: held 1.555s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:32:22 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-6ec5088c-3f8a-4a3a-9fce-cde0348e5794 tempest-SnapshotDependencyTests-500591891 None] Lock "cinder-quobyte-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1" released by "delete_snapshot" :: held 1.579s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:32:22 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-6ec5088c-3f8a-4a3a-9fce-cde0348e5794 tempest-SnapshotDependencyTests-500591891 None] Created reservations ['715743c7-916e-4b39-849d-af79c2404093', '9999c721-e576-490f-ad4e-246a520516ed', '1ae7c84f-99b4-417d-aaf6-79d97f867782', 'ebdf9351-99cd-4e70-8024-3e731862b80b'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:32:22 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-6ec5088c-3f8a-4a3a-9fce-cde0348e5794 tempest-SnapshotDependencyTests-500591891 None] Delete snapshot completed successfully.
Nov 04 12:32:22 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-6ec5088c-3f8a-4a3a-9fce-cde0348e5794 tempest-SnapshotDependencyTests-500591891 None] Lock "cinder-c080b8ea-7bf6-4539-a187-ed5cb43e48f9-delete_snapshot" released by "delete_snapshot" :: held 1.708s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:32:22 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a75f74d2-f0bc-44e4-a148-f41724bc8b70 tempest-SnapshotDependencyTests-500591891 None] Acquiring lock "cinder-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:32:22 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a75f74d2-f0bc-44e4-a148-f41724bc8b70 tempest-SnapshotDependencyTests-500591891 None] Lock "cinder-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:32:22 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a75f74d2-f0bc-44e4-a148-f41724bc8b70 tempest-SnapshotDependencyTests-500591891 None] Acquiring lock "cinder-quobyte-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:32:22 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a75f74d2-f0bc-44e4-a148-f41724bc8b70 tempest-SnapshotDependencyTests-500591891 None] Lock "cinder-quobyte-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1" acquired by "delete_volume" :: waited 0.015s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:32:22 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[64033922-a3c7-4a6a-bcbd-de56b50d1253]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:32:22 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a75f74d2-f0bc-44e4-a148-f41724bc8b70 tempest-SnapshotDependencyTests-500591891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:32:23 devstack sudo[108976]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1
Nov 04 12:32:23 devstack sudo[108976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:32:23 devstack sudo[108976]: pam_unix(sudo:session): session closed for user root
Nov 04 12:32:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a75f74d2-f0bc-44e4-a148-f41724bc8b70 tempest-SnapshotDependencyTests-500591891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1" returned: 0 in 0.367s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:32:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a75f74d2-f0bc-44e4-a148-f41724bc8b70 tempest-SnapshotDependencyTests-500591891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:32:23 devstack sudo[108982]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1
Nov 04 12:32:23 devstack sudo[108982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:32:23 devstack sudo[108982]: pam_unix(sudo:session): session closed for user root
Nov 04 12:32:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a75f74d2-f0bc-44e4-a148-f41724bc8b70 tempest-SnapshotDependencyTests-500591891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1" returned: 0 in 0.255s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:32:23 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a75f74d2-f0bc-44e4-a148-f41724bc8b70 tempest-SnapshotDependencyTests-500591891 None] Lock "cinder-quobyte-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1" released by "delete_volume" :: held 0.685s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:32:23 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-a75f74d2-f0bc-44e4-a148-f41724bc8b70 tempest-SnapshotDependencyTests-500591891 None] Created reservations ['093b60e8-28c9-46f7-8370-df60f034e51d', '46c5e584-5af2-4895-8fc0-5a76f104519b', '82dca77a-1c3a-4cbb-9e19-a8f6a186a44b', 'c8b75104-7adc-4a06-b655-5f60ab9f9784'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:32:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a75f74d2-f0bc-44e4-a148-f41724bc8b70 tempest-SnapshotDependencyTests-500591891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:32:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a75f74d2-f0bc-44e4-a148-f41724bc8b70 tempest-SnapshotDependencyTests-500591891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:32:23 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a75f74d2-f0bc-44e4-a148-f41724bc8b70 tempest-SnapshotDependencyTests-500591891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:32:23 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a75f74d2-f0bc-44e4-a148-f41724bc8b70 tempest-SnapshotDependencyTests-500591891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:32:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a75f74d2-f0bc-44e4-a148-f41724bc8b70 tempest-SnapshotDependencyTests-500591891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:32:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a75f74d2-f0bc-44e4-a148-f41724bc8b70 tempest-SnapshotDependencyTests-500591891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:32:23 devstack sudo[108985]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:32:23 devstack sudo[108985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:32:23 devstack sudo[108985]: pam_unix(sudo:session): session closed for user root
Nov 04 12:32:23 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a75f74d2-f0bc-44e4-a148-f41724bc8b70 tempest-SnapshotDependencyTests-500591891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.261s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:32:23 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-a75f74d2-f0bc-44e4-a148-f41724bc8b70 tempest-SnapshotDependencyTests-500591891 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:32:23 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-a75f74d2-f0bc-44e4-a148-f41724bc8b70 tempest-SnapshotDependencyTests-500591891 None] Deleted volume successfully.
Nov 04 12:32:23 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-a75f74d2-f0bc-44e4-a148-f41724bc8b70 tempest-SnapshotDependencyTests-500591891 None] Lock "cinder-c91c44f0-dbcc-46fb-b320-fc5ac6cba3b1-delete_volume" released by "delete_volume" :: held 1.145s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:32:23 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-548467dd-1106-4936-88b0-b9f69519db9a tempest-SnapshotDependencyTests-500591891 None] Acquiring lock "cinder-ee8c0566-168c-45dc-ab50-efb91fa4ffa6-delete_volume" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:32:24 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-548467dd-1106-4936-88b0-b9f69519db9a tempest-SnapshotDependencyTests-500591891 None] Lock "cinder-ee8c0566-168c-45dc-ab50-efb91fa4ffa6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:32:24 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-548467dd-1106-4936-88b0-b9f69519db9a tempest-SnapshotDependencyTests-500591891 None] Acquiring lock "cinder-quobyte-ee8c0566-168c-45dc-ab50-efb91fa4ffa6" by "delete_volume" {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:138}}
Nov 04 12:32:24 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-548467dd-1106-4936-88b0-b9f69519db9a tempest-SnapshotDependencyTests-500591891 None] Lock "cinder-quobyte-ee8c0566-168c-45dc-ab50-efb91fa4ffa6" acquired by "delete_volume" :: waited 0.015s {{(pid=87169) __acquire /opt/stack/cinder/cinder/coordination.py:141}}
Nov 04 12:32:24 devstack cinder-volume[87169]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0e59a2-46bc-4c51-827f-d6217a5d1ac0]: (4, 'qcow2') {{(pid=88763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}}
Nov 04 12:32:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-548467dd-1106-4936-88b0-b9f69519db9a tempest-SnapshotDependencyTests-500591891 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ee8c0566-168c-45dc-ab50-efb91fa4ffa6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:32:24 devstack sudo[108988]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ee8c0566-168c-45dc-ab50-efb91fa4ffa6
Nov 04 12:32:24 devstack sudo[108988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:32:24 devstack sudo[108988]: pam_unix(sudo:session): session closed for user root
Nov 04 12:32:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-548467dd-1106-4936-88b0-b9f69519db9a tempest-SnapshotDependencyTests-500591891 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ee8c0566-168c-45dc-ab50-efb91fa4ffa6" returned: 0 in 0.371s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:32:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-548467dd-1106-4936-88b0-b9f69519db9a tempest-SnapshotDependencyTests-500591891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ee8c0566-168c-45dc-ab50-efb91fa4ffa6 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:32:24 devstack sudo[108993]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ee8c0566-168c-45dc-ab50-efb91fa4ffa6
Nov 04 12:32:24 devstack sudo[108993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:32:24 devstack sudo[108993]: pam_unix(sudo:session): session closed for user root
Nov 04 12:32:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-548467dd-1106-4936-88b0-b9f69519db9a tempest-SnapshotDependencyTests-500591891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00/volume-ee8c0566-168c-45dc-ab50-efb91fa4ffa6" returned: 0 in 0.254s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:32:24 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-548467dd-1106-4936-88b0-b9f69519db9a tempest-SnapshotDependencyTests-500591891 None] Lock "cinder-quobyte-ee8c0566-168c-45dc-ab50-efb91fa4ffa6" released by "delete_volume" :: held 0.670s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:32:24 devstack cinder-volume[87169]: DEBUG cinder.quota [None req-548467dd-1106-4936-88b0-b9f69519db9a tempest-SnapshotDependencyTests-500591891 None] Created reservations ['344a7685-76e7-49c1-9f9a-50c0e1613eb4', '542b032c-b058-409a-8715-504ebdeee758', '69eb6bff-79b6-44ad-a165-198cc6299761', '1a28b93a-902d-41fb-9a2b-308401885df4'] {{(pid=87169) reserve /opt/stack/cinder/cinder/quota.py:752}}
Nov 04 12:32:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-548467dd-1106-4936-88b0-b9f69519db9a tempest-SnapshotDependencyTests-500591891 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:32:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-548467dd-1106-4936-88b0-b9f69519db9a tempest-SnapshotDependencyTests-500591891 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:32:24 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-548467dd-1106-4936-88b0-b9f69519db9a tempest-SnapshotDependencyTests-500591891 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:32:24 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-548467dd-1106-4936-88b0-b9f69519db9a tempest-SnapshotDependencyTests-500591891 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:32:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-548467dd-1106-4936-88b0-b9f69519db9a tempest-SnapshotDependencyTests-500591891 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:32:24 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-548467dd-1106-4936-88b0-b9f69519db9a tempest-SnapshotDependencyTests-500591891 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:32:24 devstack sudo[108996]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:32:24 devstack sudo[108996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:32:25 devstack sudo[108996]: pam_unix(sudo:session): session closed for user root
Nov 04 12:32:25 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-548467dd-1106-4936-88b0-b9f69519db9a tempest-SnapshotDependencyTests-500591891 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.257s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:32:25 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-548467dd-1106-4936-88b0-b9f69519db9a tempest-SnapshotDependencyTests-500591891 None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:32:25 devstack cinder-volume[87169]: INFO cinder.volume.manager [None req-548467dd-1106-4936-88b0-b9f69519db9a tempest-SnapshotDependencyTests-500591891 None] Deleted volume successfully.
Nov 04 12:32:25 devstack cinder-volume[87169]: DEBUG cinder.coordination [None req-548467dd-1106-4936-88b0-b9f69519db9a tempest-SnapshotDependencyTests-500591891 None] Lock "cinder-ee8c0566-168c-45dc-ab50-efb91fa4ffa6-delete_volume" released by "delete_volume" :: held 1.117s {{(pid=87169) __release /opt/stack/cinder/cinder/coordination.py:152}}
Nov 04 12:32:34 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:UPDATE=34,cinder:SELECT=19,cinder:INSERT=9 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:32:35 devstack cinder-volume[87169]: DEBUG dbcounter [-] [87169] Writing DB stats cinder:SELECT=30,cinder:INSERT=6,cinder:UPDATE=24,cinder:DELETE=5 {{(pid=87169) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}
Nov 04 12:32:49 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:32:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}}
Nov 04 12:32:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}}
Nov 04 12:32:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79': None} {{(pid=87169) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}}
Nov 04 12:32:49 devstack cinder-volume[87169]: DEBUG cinder.volume.drivers.quobyte [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b383fec0-1dd4-41fe-b389-647eb5082d79'] {{(pid=87169) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}}
Nov 04 12:32:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.lockutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87169) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}}
Nov 04 12:32:49 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00 {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}}
Nov 04 12:32:49 devstack sudo[109319]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00
Nov 04 12:32:49 devstack sudo[109319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Nov 04 12:32:50 devstack sudo[109319]: pam_unix(sudo:session): session closed for user root
Nov 04 12:32:50 devstack cinder-volume[87169]: DEBUG oslo_concurrency.processutils [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/30749277aba6593a057de4e52b8d7e00" returned: 0 in 0.240s {{(pid=87169) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}}
Nov 04 12:32:50 devstack cinder-volume[87169]: DEBUG cinder.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Notifying Schedulers of capabilities ... {{(pid=87169) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}}
Nov 04 12:32:50 devstack cinder-volume[87169]: DEBUG oslo_service.periodic_task [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] Running periodic task VolumeManager._thread_info {{(pid=87169) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}}
Nov 04 12:32:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread count: 28 {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}}
Nov 04 12:32:50 devstack cinder-volume[87169]: DEBUG cinder.volume.manager [None req-a017cc84-ab37-491f-a13a-9f9bd2534cea None None] thread info: [<_MainThread(MainThread, started 137165867425920)>, <Thread(Thread-2 (_beat_forever_until_stopped), started daemon 137165754678912)>, <Thread(Thread-3 (stat_writer), started daemon 137165754130752)>, <Thread(Rabbit-heartbeat, started daemon 137165752997504)>, <Thread(Thread-5 (_runner), started daemon 137165753227712)>, <Thread(Thread-7 (_runner), started daemon 137165751273856)>, <Thread(fd_logger, started daemon 137165755322048)>, <Thread(privsep_reader, started daemon 137165748896704)>, <Thread(tpool_thread_0, started daemon 137165742520000)>, <Thread(tpool_thread_1, started daemon 137165734127296)>, <Thread(tpool_thread_2, started daemon 137165725734592)>, <Thread(tpool_thread_3, started daemon 137165717341888)>, <Thread(tpool_thread_4, started daemon 137165708949184)>, <Thread(tpool_thread_5, started daemon 137165700556480)>, <Thread(tpool_thread_6, started daemon 137165692163776)>, <Thread(tpool_thread_7, started daemon 137165683771072)>, <Thread(tpool_thread_8, started daemon 137165675378368)>, <Thread(tpool_thread_9, started daemon 137165666985664)>, <Thread(tpool_thread_10, started daemon 137165658592960)>, <Thread(tpool_thread_11, started daemon 137165650183872)>, <Thread(tpool_thread_12, started daemon 137165641774784)>, <Thread(tpool_thread_13, started daemon 137165633365696)>, <Thread(tpool_thread_14, started daemon 137165624956608)>, <Thread(tpool_thread_15, started daemon 137165616547520)>, <Thread(tpool_thread_16, started daemon 137165608138432)>, <Thread(tpool_thread_17, started daemon 137165599729344)>, <Thread(tpool_thread_18, started daemon 137165591320256)>, <Thread(tpool_thread_19, started daemon 137165582911168)>] {{(pid=87169) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}